-- Logs begin at Tue 2022-03-08 12:26:03 UTC, end at Tue 2022-03-08 14:12:34 UTC. -- Mar 08 12:58:32.031074 dv-cinder-830091-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Mar 08 12:58:32.039343 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Mar 08 12:58:32.042849 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Mar 8 12:58:32 2022] *** Mar 08 12:58:32.042849 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 08 12:58:32.042849 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 08 12:58:32.042849 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: nodename: dv-cinder-830091-2-iscsi Mar 08 12:58:32.042849 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: machine: x86_64 Mar 08 12:58:32.042849 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: clock source: unix Mar 08 12:58:32.042849 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: pcre jit disabled Mar 08 12:58:32.042849 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: detected number of CPU cores: 4 Mar 08 12:58:32.042849 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: current working directory: / Mar 08 12:58:32.042849 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: detected binary path: /usr/bin/uwsgi-core Mar 08 12:58:32.042849 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: your processes number limit is 47680 Mar 08 12:58:32.042849 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: your memory page size is 4096 bytes Mar 08 12:58:32.042849 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: detected max file descriptor number: 2048 Mar 08 12:58:32.042849 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: lock engine: pthread robust mutexes Mar 08 12:58:32.042849 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: thunder lock: enabled Mar 08 12:58:32.042849 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Mar 08 12:58:32.042849 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 08 12:58:32.095115 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: Python main interpreter initialized at 0x55dad1a369c0 Mar 08 12:58:32.095115 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: python threads support enabled Mar 08 12:58:32.095115 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: your server socket listen backlog is limited to 100 connections Mar 08 12:58:32.095115 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: your mercy for graceful operations on workers is 90 seconds Mar 08 12:58:32.095503 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: mapped 403077 bytes (393 KB) for 2 cores Mar 08 12:58:32.095579 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: *** Operational MODE: preforking *** Mar 08 12:58:32.095831 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: *** uWSGI is running in multiple interpreter mode *** Mar 08 12:58:32.095831 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: spawned uWSGI master process (pid: 79779) Mar 08 12:58:32.096611 dv-cinder-830091-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Mar 08 12:58:32.097529 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: spawned uWSGI worker 1 (pid: 79792, cores: 1) Mar 08 12:58:32.097621 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: spawned uWSGI worker 2 (pid: 79793, cores: 1) Mar 08 12:58:32.097752 dv-cinder-830091-2-iscsi devstack@keystone.service[79779]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 08 12:58:37.920888 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 12:58:37.920888 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: from cryptography.utils import int_from_bytes Mar 08 12:58:37.921655 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 12:58:37.921655 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: from cryptography.utils import int_from_bytes Mar 08 12:58:37.921779 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 12:58:37.921779 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: from cryptography.utils import int_from_bytes Mar 08 12:58:37.922188 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 12:58:37.922188 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: from cryptography.utils import int_from_bytes Mar 08 12:58:37.966610 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 12:58:37.966805 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 12:58:37.966986 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] command line args: [] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 12:58:37.967253 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 12:58:37.967360 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 12:58:37.967452 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ================================================================================ {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 12:58:37.967553 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 12:58:37.967662 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] admin_token = **** {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.967746 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] command line args: [] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 12:58:37.967903 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] config_dir = [] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.967992 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 12:58:37.968090 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.968169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ================================================================================ {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 12:58:37.968268 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] config_source = [] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.968402 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] admin_token = **** {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.968478 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] debug = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.968623 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.968887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] config_dir = [] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.968887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.969015 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.969080 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] config_source = [] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.969147 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.969206 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] debug = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.969377 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.969480 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.969615 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.969701 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.969805 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.969878 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] list_limit = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.970005 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] log_config_append = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.970087 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.970185 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.970266 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.970331 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] log_dir = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.970599 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] log_file = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.970691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] list_limit = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.970795 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.970867 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] log_config_append = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.971090 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.971168 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.971234 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] log_dir = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.971293 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.971350 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] log_file = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.971496 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.971627 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.971703 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.971825 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.971899 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.972018 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.972093 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.972217 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.972298 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.972413 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.972493 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.972569 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.972820 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.972938 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.973011 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.973123 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.973202 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.973314 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.973421 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.973505 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.973665 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.973747 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.973940 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.974033 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.974185 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.974425 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.974542 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.974622 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] publish_errors = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.974700 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.974820 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.975039 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.975179 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.975263 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.975363 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] publish_errors = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.975440 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.975597 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.975712 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.975827 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.975925 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] standard_threads = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.976071 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.976144 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.976240 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.976328 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.976478 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.976555 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.976652 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] use_journal = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.976746 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] standard_threads = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.976858 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] use_json = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.976944 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.977015 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] use_stderr = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.977187 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.977270 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] use_syslog = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.977364 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.977446 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.977524 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] use_journal = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.977651 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.977729 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] use_json = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.977860 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] use_stderr = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.977942 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.978017 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] use_syslog = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.978129 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.978251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 12:58:37.978363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.978507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.978608 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.978748 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.978841 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.979008 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.979090 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.979247 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.979322 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.979495 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.979581 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.979733 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.979814 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.979980 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.980056 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.980211 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.980295 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.980453 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.980536 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.980709 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.980789 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.980955 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.981122 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.981197 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.981271 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.981420 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.981496 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.981655 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.981739 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.981903 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.981979 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.982140 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.982215 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.982374 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.982458 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.982625 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.982706 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.982874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.982949 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.983122 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.983203 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.983366 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.983442 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.983595 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.983670 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.983824 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.983913 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.984054 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.984130 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.984285 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.984367 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.984536 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.984616 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.984805 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.984883 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.985033 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.985109 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.985260 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.985343 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.985503 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.985580 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.985747 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.985857 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.985961 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.986056 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.986711 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.986865 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.986960 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.987052 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.987176 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.987310 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.987418 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.987514 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.987607 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.987709 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.987837 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.987922 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.988065 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.988142 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.988294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.988374 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.988523 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.988608 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.988776 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.988856 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.989007 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.989128 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.989237 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.989323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.989464 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.989542 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.989696 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.989776 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.989928 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.990017 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.990163 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.990241 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.990388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.990464 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.990621 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.990707 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.990853 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.990929 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.991085 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.991165 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.991313 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.991399 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.991544 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.991620 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.991772 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.991857 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.992006 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.992090 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.992239 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.992320 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.992470 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.992546 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.992717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.992848 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.992954 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.993045 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.993190 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.993266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.993415 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.993566 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.993639 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.993709 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.993869 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.993952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.994104 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.994188 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.994335 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.994412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.994571 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.994648 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.994806 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.994890 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.995037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.995112 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.995268 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.995344 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.995497 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.995581 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.995737 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.995814 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.995969 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.996051 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.996201 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.996290 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.996436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.996514 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.996673 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.996750 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.996918 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.996997 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.997148 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.997226 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.997378 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.997455 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.997609 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.997694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.997844 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.997923 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.998075 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.998151 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.998307 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.998385 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.998538 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.998616 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.998777 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.998854 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.999009 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.999085 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.999241 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.999319 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.999473 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.999554 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.999699 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.999775 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:37.999924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.000011 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.000152 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.000229 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.000382 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.000465 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.000609 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.000714 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.000874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.000951 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.001105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.001182 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.001336 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.001419 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.001565 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.001642 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.002370 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.002459 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.002635 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.002704 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.002875 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.002992 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.003104 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] auth.external = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.003184 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.003332 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.003410 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.003624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.003702 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.003855 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.003932 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.004084 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] auth.password = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.004189 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] auth.external = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.004310 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] auth.token = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.004389 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.004552 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.004630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.004799 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.004873 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.005040 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.005121 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] auth.password = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.005269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.005353 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] auth.token = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.005513 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.005597 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.005752 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.005831 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.005978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.006055 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.006211 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] credential.caching = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.006289 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.006454 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.006534 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.006699 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.006776 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.006929 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.007009 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.007156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.007230 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] credential.caching = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.007391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.007469 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.007622 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.007699 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.007871 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.007957 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.008107 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.008184 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.008337 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.008414 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.008573 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.008651 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.008858 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.008947 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.009104 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.009182 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.009336 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.009414 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.009587 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.009665 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.009838 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.009924 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.010070 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] federation.caching = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.010148 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.010302 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.010379 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.010544 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.010634 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.010785 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.010862 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.011011 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.011096 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] federation.caching = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.011253 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.011339 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.011485 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.011563 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.011729 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.011806 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.011959 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.012043 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.012208 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.012318 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.012440 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.012559 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.012702 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.012840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.012920 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] identity.caching = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.013080 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.013157 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.013337 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.013414 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.013577 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.013656 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.013825 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.013903 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.014064 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] identity.caching = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.014142 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.014288 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.014366 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.014528 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.014605 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.014776 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.014853 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.015013 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.015093 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.015238 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.015315 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.015467 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.015544 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.015695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.015773 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.015935 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.016015 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.016177 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.016254 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.016408 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.016486 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.016648 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.016783 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.016914 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.016993 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.017158 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.017238 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.017440 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.017526 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.017676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.017752 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.017906 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.018022 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.018139 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.018277 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.018355 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.018550 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.018635 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.018789 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.018873 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.019029 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.019107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.019262 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.019349 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.019489 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.019567 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.019720 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.019797 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.019964 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.020043 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.020195 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.020273 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.020431 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.020508 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.020720 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.020803 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.020924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.021012 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.021158 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.021237 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.021384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.021464 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.021619 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.021698 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.021852 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.021930 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.022090 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.022175 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.022321 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.022477 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.022558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.022726 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.022812 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.022958 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.023036 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.023196 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.023273 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.023435 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.023520 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.023679 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.023759 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.023917 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.023994 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.024147 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.024231 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.024379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.024457 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.024615 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.024706 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.024865 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.user = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.024954 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.025095 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.025172 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.025345 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.025423 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.025572 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.025657 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.025817 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.025939 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.026050 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.026128 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.026285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.026371 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.026513 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.026590 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.user = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.026740 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.026818 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.026978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.027064 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.027211 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.027290 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.027443 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.027521 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.027669 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.027755 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.027913 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.027994 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.028148 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.028225 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.028378 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.028464 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.028613 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.028711 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.028872 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.028952 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.029097 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.029187 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.029326 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.029403 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.029564 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.029647 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.029799 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.029951 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.030026 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.030097 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.030252 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.030330 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.030494 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.030583 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.030721 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.030798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.030959 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.031032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.031192 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.031267 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.031427 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.031494 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.031658 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.031725 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.031889 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.031964 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.032122 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.032190 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.032355 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.032423 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.032592 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.032727 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.032854 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.032921 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.033162 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.033235 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.033399 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.033624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.033694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] resource.caching = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.033871 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.033938 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.034115 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.034182 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.034595 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.034671 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.034851 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.034918 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.035096 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.035173 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.035332 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.035399 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.035568 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.035676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.035810 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] resource.caching = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.035911 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.036061 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.036140 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.036311 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.036390 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] role.caching = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.036552 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.036637 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] role.driver = sql {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.036829 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.036908 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.037077 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.037153 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.037313 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.037407 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.037560 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.037636 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.037804 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.037885 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.038044 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.038130 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.038280 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] role.caching = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.038357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.038522 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.038599 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] role.driver = sql {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.038749 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.038834 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.038986 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.039063 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.039232 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.039316 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.039477 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.039563 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.039723 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.039800 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.039963 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.040040 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.040214 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.040357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.040461 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.040590 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.040733 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.040862 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.040967 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.041111 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.041214 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.041357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.041461 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.041605 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.041708 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.041838 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.041954 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.042089 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.042339 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.042415 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.042576 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.042654 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.042803 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.042880 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.043032 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.043110 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.043269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.043349 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.043519 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.043597 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.043751 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.043828 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.044005 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.044084 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.044238 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.044315 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.044471 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.044549 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.044724 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.044805 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.044958 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.045036 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] token.caching = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.045190 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.045268 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.045433 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.045512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.045668 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.045746 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.045931 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.046008 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.046169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.046410 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.046487 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.046641 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.046790 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.046868 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] token.caching = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.047037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.047117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.047282 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.047360 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.047530 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.047609 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.047766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.047852 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.048005 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.048083 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.048240 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.048319 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.048484 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.048562 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.049266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.049347 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.049497 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.049700 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.049781 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.049947 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.050015 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.050189 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.050257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] database.connection = **** {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.050427 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.050504 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.050676 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.050813 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.050929 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.051159 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.051333 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.051401 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.051646 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.051715 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.051885 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.051953 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] database.connection = **** {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.052123 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.052200 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.052359 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.052427 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.052595 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.052708 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.052866 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.052934 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.053099 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.053166 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.053340 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.053409 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.053576 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.053644 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.053822 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.053890 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.054056 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.054138 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.054298 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.054375 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.054528 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.054597 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.054763 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.054833 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.054996 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.055063 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.055168 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 12:58:38.055244 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.055462 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.055700 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.055939 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.056175 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 12:58:38.056343 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 12:58:38.086996 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.087221 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.087449 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.089801 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.090039 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.090267 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.097465 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.101106 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.127475 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.127694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.135293 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.135524 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.180929 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.181921 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.231550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.231775 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.232090 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.232324 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.297047 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.297272 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.297490 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.297707 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.297921 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.298133 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.298999 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.299346 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.299575 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.299793 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.300006 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.300217 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.322937 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.323158 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.323383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.323604 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.323686 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.323819 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.323902 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.324031 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.324115 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.324243 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.324324 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.324496 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.324744 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.324959 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.336292 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.336882 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.349298 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.349528 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.349750 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.349842 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.349965 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.350046 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.350179 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.350263 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.350389 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.350471 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.350599 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.350689 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.350810 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.351021 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 12:58:38.367699 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.367903 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 08 12:58:38.368236 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.368436 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 08 12:58:38.368519 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.368725 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.368812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 08 12:58:38.368988 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.369173 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.369257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.369374 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 08 12:58:38.369480 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.369823 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.370084 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.370341 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.370595 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.381021 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.381295 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.381557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.381674 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.381830 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.381943 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.382205 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.382476 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.389750 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.390384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.393737 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.394011 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.394394 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.394536 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.394672 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.394812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.394945 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.395089 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.395199 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.395363 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.395447 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.395636 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.395717 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.395887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.395969 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.396148 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.396231 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.396412 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.396494 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.396696 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.396971 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.397231 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.422463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.423386 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.424257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.424536 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.425170 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.425449 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.429693 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.429973 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.430246 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.430573 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.430852 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.437778 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.438139 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.438429 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.443484 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.443773 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.444049 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.444323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.444800 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.445077 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.445341 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.445603 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.447448 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.447740 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.454153 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.454436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.454715 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.455711 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.456200 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.456725 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.457342 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.457691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.464760 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.465034 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.469779 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.473572 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.473858 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.478768 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.482070 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.482349 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.482444 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.486631 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.486926 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.487288 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.487369 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.487571 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.487844 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.488132 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.490940 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.491232 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.496285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.499862 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.504013 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.504312 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.504594 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.504902 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.505196 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.505478 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.507374 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.507652 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.507912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.508167 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.515801 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.517523 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.517919 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.520929 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.521216 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.521492 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.521768 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.522046 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.524232 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.524521 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.524809 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.525071 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.532753 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.534721 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.534986 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.535508 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.535784 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.536057 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.536334 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.536610 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.536903 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.537173 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.537983 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.538270 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.538671 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.538961 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.539241 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.552847 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.553127 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.553584 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.553868 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.554148 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.554422 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.554718 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.556528 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.559732 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.562981 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.565117 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.566712 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.566995 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.567286 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.573165 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.576919 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.580976 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.582784 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.585889 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.586176 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.586468 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.593871 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.596062 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.600037 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.600340 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.600622 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.600924 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.677890 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.679520 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.682763 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.683057 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.683340 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.683610 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.693687 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.693910 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.694185 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.701986 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.702269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.702542 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.702808 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.703072 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.703336 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.703609 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.703876 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.704147 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.704524 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.704912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.705751 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.706025 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.706287 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.710601 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.710906 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.711187 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.718923 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 12:58:38.719200 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.719475 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.719743 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.720009 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.720283 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.720583 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.721184 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.721466 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.721738 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.722007 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.722272 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.722535 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.722804 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 12:58:38.744506 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dad1a369c0 pid: 79793 (default app) Mar 08 12:58:38.748147 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ade60-6c1a-4f3b-91ab-9eb2ac2fb914 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:38.748431 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ade60-6c1a-4f3b-91ab-9eb2ac2fb914 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:38.748733 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ade60-6c1a-4f3b-91ab-9eb2ac2fb914 None None] PATH_INFO: `/v3` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:38.754167 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 791 bytes} [Tue Mar 8 12:58:38 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:58:38.768571 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dad1a369c0 pid: 79792 (default app) Mar 08 12:58:48.162438 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b03d6-995d-43a3-b2e0-1080affb592f None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:48.163024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b03d6-995d-43a3-b2e0-1080affb592f None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:48.163024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b03d6-995d-43a3-b2e0-1080affb592f None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:48.165089 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:58:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 12:58:48.172486 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b458a56-2368-4cfc-83ca-a204be9d9fe5 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:48.172952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b458a56-2368-4cfc-83ca-a204be9d9fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:48.173749 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b458a56-2368-4cfc-83ca-a204be9d9fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:48.202837 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG oslo_db.sqlalchemy.engines [None req-2b458a56-2368-4cfc-83ca-a204be9d9fe5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 12:58:48.389425 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG passlib.handlers.bcrypt [None req-2b458a56-2368-4cfc-83ca-a204be9d9fe5 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79792) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 08 12:58:48.389845 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG passlib.handlers.bcrypt [None req-2b458a56-2368-4cfc-83ca-a204be9d9fe5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79792) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 08 12:58:48.446636 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-2b458a56-2368-4cfc-83ca-a204be9d9fe5 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:58:48.448224 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-2b458a56-2368-4cfc-83ca-a204be9d9fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:58:48.569997 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1/3] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:58:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Mar 08 12:58:48.748274 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b03d6-995d-43a3-b2e0-1080affb592f None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:48.781765 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG oslo_db.sqlalchemy.engines [None req-725b03d6-995d-43a3-b2e0-1080affb592f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 12:58:48.917656 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b03d6-995d-43a3-b2e0-1080affb592f None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:48.924085 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46574ff2-f725-425a-afaa-77ec1574c217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:48.924928 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46574ff2-f725-425a-afaa-77ec1574c217 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:48.925417 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46574ff2-f725-425a-afaa-77ec1574c217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:48.925908 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46574ff2-f725-425a-afaa-77ec1574c217 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:48.938265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46574ff2-f725-425a-afaa-77ec1574c217 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:48.995562 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.common.rbac_enforcer.enforcer [None req-46574ff2-f725-425a-afaa-77ec1574c217 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 08 12:58:48.995908 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46574ff2-f725-425a-afaa-77ec1574c217 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:49.006048 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 3/4] 10.222.0.52 () {58 vars in 1324 bytes} [Tue Mar 8 12:58:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 08 12:58:49.011891 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b458a56-2368-4cfc-83ca-a204be9d9fe5 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:49.026713 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b458a56-2368-4cfc-83ca-a204be9d9fe5 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:49.031072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497328c2-749b-4806-9b86-0df6803b69f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:49.032222 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497328c2-749b-4806-9b86-0df6803b69f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:49.033110 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497328c2-749b-4806-9b86-0df6803b69f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:49.033390 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497328c2-749b-4806-9b86-0df6803b69f0 admin admin] PATH_INFO: `/v3/projects/9bf8304032614352a7ca4a6088a17c23` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:49.035261 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497328c2-749b-4806-9b86-0df6803b69f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=9bf8304032614352a7ca4a6088a17c23)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:49.086831 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.common.rbac_enforcer.enforcer [None req-497328c2-749b-4806-9b86-0df6803b69f0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 08 12:58:49.087166 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497328c2-749b-4806-9b86-0df6803b69f0 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:49.092058 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 2/5] 10.222.0.52 () {56 vars in 1207 bytes} [Tue Mar 8 12:58:49 2022] GET /identity/v3/projects/9bf8304032614352a7ca4a6088a17c23 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:58:51.350135 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3dc6-92ab-4f96-a875-3f74c66c3fa4 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:51.350528 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3dc6-92ab-4f96-a875-3f74c66c3fa4 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:51.350689 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3dc6-92ab-4f96-a875-3f74c66c3fa4 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:51.355209 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 4/6] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:58:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:58:51.360856 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e91adc-9977-46bd-baca-4076149b0d9c None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:51.361289 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e91adc-9977-46bd-baca-4076149b0d9c None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:51.361420 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e91adc-9977-46bd-baca-4076149b0d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:51.380160 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-f0e91adc-9977-46bd-baca-4076149b0d9c None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:58:51.381716 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f0e91adc-9977-46bd-baca-4076149b0d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:58:51.389422 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 3/7] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:58:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 08 12:58:51.412787 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d3dc6-92ab-4f96-a875-3f74c66c3fa4 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:51.424881 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d3dc6-92ab-4f96-a875-3f74c66c3fa4 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:51.429016 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce12682-ad95-4a25-b5f9-8c894b63b18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:51.429644 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce12682-ad95-4a25-b5f9-8c894b63b18b admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:51.429929 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce12682-ad95-4a25-b5f9-8c894b63b18b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:51.430206 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce12682-ad95-4a25-b5f9-8c894b63b18b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:51.437766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce12682-ad95-4a25-b5f9-8c894b63b18b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:51.439690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce12682-ad95-4a25-b5f9-8c894b63b18b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:51.448224 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 5/8] 10.222.0.52 () {58 vars in 1324 bytes} [Tue Mar 8 12:58:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 12:58:51.453312 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e91adc-9977-46bd-baca-4076149b0d9c None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:51.462686 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e91adc-9977-46bd-baca-4076149b0d9c None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:51.467004 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf357bb-c8ce-45fd-bed9-cca278cd3a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:51.467857 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf357bb-c8ce-45fd-bed9-cca278cd3a06 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:51.468143 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf357bb-c8ce-45fd-bed9-cca278cd3a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:51.468421 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf357bb-c8ce-45fd-bed9-cca278cd3a06 admin admin] PATH_INFO: `/v3/users/ea423af17abb444a87ac0e8ed4f3af6b` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:51.470595 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf357bb-c8ce-45fd-bed9-cca278cd3a06 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea423af17abb444a87ac0e8ed4f3af6b)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:51.472366 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf357bb-c8ce-45fd-bed9-cca278cd3a06 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:51.473980 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 4/9] 10.222.0.52 () {56 vars in 1198 bytes} [Tue Mar 8 12:58:51 2022] GET /identity/v3/users/ea423af17abb444a87ac0e8ed4f3af6b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:58:53.940396 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f093e65-4659-4c1e-821e-981ddfaf61ec None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:53.940957 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f093e65-4659-4c1e-821e-981ddfaf61ec None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:53.940957 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f093e65-4659-4c1e-821e-981ddfaf61ec None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:53.942909 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:58:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:58:53.947786 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a868e-9ff3-4009-9d33-559e2cdf3c2c None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:53.948176 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a868e-9ff3-4009-9d33-559e2cdf3c2c None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:53.948459 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a868e-9ff3-4009-9d33-559e2cdf3c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:53.965634 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-2e2a868e-9ff3-4009-9d33-559e2cdf3c2c None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:58:53.966819 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-2e2a868e-9ff3-4009-9d33-559e2cdf3c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:58:54.017238 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517f64e-a761-4fca-81ba-b34ae7ce8b2f None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:54.017517 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517f64e-a761-4fca-81ba-b34ae7ce8b2f None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:54.017960 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517f64e-a761-4fca-81ba-b34ae7ce8b2f None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:54.019695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 7/11] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 12:58:54.025002 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3588217-e73c-4e77-ba2c-655485233daf None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:54.025287 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3588217-e73c-4e77-ba2c-655485233daf None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:54.025558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3588217-e73c-4e77-ba2c-655485233daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:54.045162 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 5/12] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:58:54.068010 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG passlib.handlers.bcrypt [None req-e3588217-e73c-4e77-ba2c-655485233daf None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79793) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 08 12:58:54.068419 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG passlib.handlers.bcrypt [None req-e3588217-e73c-4e77-ba2c-655485233daf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79793) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 08 12:58:54.079983 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a868e-9ff3-4009-9d33-559e2cdf3c2c None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:54.115648 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-e3588217-e73c-4e77-ba2c-655485233daf None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:58:54.117267 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e3588217-e73c-4e77-ba2c-655485233daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:58:54.182080 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a868e-9ff3-4009-9d33-559e2cdf3c2c None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:54.213934 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 8/13] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 12:58:54.214790 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f0dcc-b16a-447b-819c-a878b0a22d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:54.215578 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f0dcc-b16a-447b-819c-a878b0a22d18 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:54.215857 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f0dcc-b16a-447b-819c-a878b0a22d18 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:54.216129 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f0dcc-b16a-447b-819c-a878b0a22d18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:54.227357 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f0dcc-b16a-447b-819c-a878b0a22d18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:58:54.234139 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-9f8f0dcc-b16a-447b-819c-a878b0a22d18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 12:58:54.236309 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 6/14] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 12:58:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 12:58:54.236578 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3588217-e73c-4e77-ba2c-655485233daf None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:54.241907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f0dcc-b16a-447b-819c-a878b0a22d18 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:54.330994 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3588217-e73c-4e77-ba2c-655485233daf None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:54.335794 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f0dcc-b16a-447b-819c-a878b0a22d18 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:54.363014 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6910d-6f33-4470-9dac-02dae00e206d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:54.363902 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6910d-6f33-4470-9dac-02dae00e206d None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:54.364183 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6910d-6f33-4470-9dac-02dae00e206d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:54.364456 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6910d-6f33-4470-9dac-02dae00e206d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:54.368423 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfb124-49d6-4fed-9b9b-e145687052ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:54.369115 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfb124-49d6-4fed-9b9b-e145687052ab None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:54.369403 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfb124-49d6-4fed-9b9b-e145687052ab None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:54.369678 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfb124-49d6-4fed-9b9b-e145687052ab None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:54.370431 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfb124-49d6-4fed-9b9b-e145687052ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:58:54.370739 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfb124-49d6-4fed-9b9b-e145687052ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:54.372150 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfb124-49d6-4fed-9b9b-e145687052ab None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:54.384712 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 7/15] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:58:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:58:54.390123 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfb124-49d6-4fed-9b9b-e145687052ab None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:54.434934 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6910d-6f33-4470-9dac-02dae00e206d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:54.436471 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6910d-6f33-4470-9dac-02dae00e206d None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:54.484733 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfb124-49d6-4fed-9b9b-e145687052ab None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:54.517236 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426e94c-4e9f-4a74-8f99-05c487e5a6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:54.518101 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426e94c-4e9f-4a74-8f99-05c487e5a6d7 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:54.518378 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426e94c-4e9f-4a74-8f99-05c487e5a6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:54.518657 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426e94c-4e9f-4a74-8f99-05c487e5a6d7 None admin] PATH_INFO: `/v3/users/ea423af17abb444a87ac0e8ed4f3af6b` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:54.519850 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426e94c-4e9f-4a74-8f99-05c487e5a6d7 None admin] RBAC: Authorizing `identity:get_user(user_id=ea423af17abb444a87ac0e8ed4f3af6b)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:54.521348 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426e94c-4e9f-4a74-8f99-05c487e5a6d7 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:54.522941 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 8/16] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:58:54 2022] GET /identity/v3/users/ea423af17abb444a87ac0e8ed4f3af6b => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:58:54.528093 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426e94c-4e9f-4a74-8f99-05c487e5a6d7 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:54.529438 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 9/17] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:58:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 12:58:54.535080 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6910d-6f33-4470-9dac-02dae00e206d None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:54.620026 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426e94c-4e9f-4a74-8f99-05c487e5a6d7 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:54.627470 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6910d-6f33-4470-9dac-02dae00e206d None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:54.651781 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c6bc7-aedc-4cd3-9308-e194ca7d4dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:54.652563 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c6bc7-aedc-4cd3-9308-e194ca7d4dbb None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:54.652871 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c6bc7-aedc-4cd3-9308-e194ca7d4dbb None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:54.653149 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c6bc7-aedc-4cd3-9308-e194ca7d4dbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:54.654319 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c6bc7-aedc-4cd3-9308-e194ca7d4dbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:54.655764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c6bc7-aedc-4cd3-9308-e194ca7d4dbb None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:54.657876 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 9/18] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 12:58:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:58:54.659869 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f67c38-ae18-448e-ac92-832c5a918c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:54.660675 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f67c38-ae18-448e-ac92-832c5a918c20 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:54.660967 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f67c38-ae18-448e-ac92-832c5a918c20 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:54.661240 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f67c38-ae18-448e-ac92-832c5a918c20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:54.663790 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c6bc7-aedc-4cd3-9308-e194ca7d4dbb None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:54.680138 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f67c38-ae18-448e-ac92-832c5a918c20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:54.681635 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f67c38-ae18-448e-ac92-832c5a918c20 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:54.697808 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-18f67c38-ae18-448e-ac92-832c5a918c20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 12:58:54.699005 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 10/19] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 12:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 12:58:54.704686 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f67c38-ae18-448e-ac92-832c5a918c20 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:54.777529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c6bc7-aedc-4cd3-9308-e194ca7d4dbb None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:54.826742 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b2e26-ceff-4bd1-b20a-a11bdf2abc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:54.827768 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b2e26-ceff-4bd1-b20a-a11bdf2abc7d None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:54.828228 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b2e26-ceff-4bd1-b20a-a11bdf2abc7d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:54.828633 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b2e26-ceff-4bd1-b20a-a11bdf2abc7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:54.830234 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b2e26-ceff-4bd1-b20a-a11bdf2abc7d None admin] RBAC: Adding query filter params (role.id=f9ec85924a914e078096b38cae4e6caa, scope.domain.id=default, user.id=ea423af17abb444a87ac0e8ed4f3af6b) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:58:54.830546 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b2e26-ceff-4bd1-b20a-a11bdf2abc7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:54.831995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b2e26-ceff-4bd1-b20a-a11bdf2abc7d None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:54.836851 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f67c38-ae18-448e-ac92-832c5a918c20 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:54.838466 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 10/20] 10.222.0.52 () {56 vars in 1322 bytes} [Tue Mar 8 12:58:54 2022] GET /identity/v3/role_assignments?user.id=ea423af17abb444a87ac0e8ed4f3af6b&scope.domain.id=default&role.id=f9ec85924a914e078096b38cae4e6caa => generated 233 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:58:54.872920 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0616791-b1d7-4928-8b45-08ef7e4e3223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:54.873597 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0616791-b1d7-4928-8b45-08ef7e4e3223 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:54.873879 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0616791-b1d7-4928-8b45-08ef7e4e3223 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:54.874154 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0616791-b1d7-4928-8b45-08ef7e4e3223 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:54.874897 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0616791-b1d7-4928-8b45-08ef7e4e3223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:58:54.875201 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0616791-b1d7-4928-8b45-08ef7e4e3223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:54.877461 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0616791-b1d7-4928-8b45-08ef7e4e3223 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:54.897048 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 11/21] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 12:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:58:57.449099 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af53220-990d-42b7-8b5f-221b088b06a4 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:57.450095 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af53220-990d-42b7-8b5f-221b088b06a4 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:57.450602 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af53220-990d-42b7-8b5f-221b088b06a4 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:57.453134 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 11/22] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:58:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:58:57.459111 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5db2b9-2119-4897-80db-1ec13f6a5633 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:57.460011 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5db2b9-2119-4897-80db-1ec13f6a5633 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:57.460492 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5db2b9-2119-4897-80db-1ec13f6a5633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:57.483020 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-6f5db2b9-2119-4897-80db-1ec13f6a5633 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:58:57.484575 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-6f5db2b9-2119-4897-80db-1ec13f6a5633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:58:57.570503 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 12/23] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:58:57.604187 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af53220-990d-42b7-8b5f-221b088b06a4 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:57.733347 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af53220-990d-42b7-8b5f-221b088b06a4 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:57.779957 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1d202-5d9b-4b9a-a36b-f2c80800babc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:57.781216 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1d202-5d9b-4b9a-a36b-f2c80800babc None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:57.782841 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1d202-5d9b-4b9a-a36b-f2c80800babc None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:57.783884 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1d202-5d9b-4b9a-a36b-f2c80800babc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:57.794665 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb422e4-18fa-41bd-899a-580e73c497f4 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:57.795274 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb422e4-18fa-41bd-899a-580e73c497f4 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:57.795771 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb422e4-18fa-41bd-899a-580e73c497f4 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:57.798639 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:58:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 12:58:57.804247 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f9330-fb4d-48d4-9f00-aec3b2cd1c86 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:57.804852 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f9330-fb4d-48d4-9f00-aec3b2cd1c86 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:57.805324 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f9330-fb4d-48d4-9f00-aec3b2cd1c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:57.812387 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1d202-5d9b-4b9a-a36b-f2c80800babc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:58:57.820100 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-6ac1d202-5d9b-4b9a-a36b-f2c80800babc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 12:58:57.825181 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 12/25] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 12:58:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:58:57.832866 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1d202-5d9b-4b9a-a36b-f2c80800babc None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:57.840834 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-c14f9330-fb4d-48d4-9f00-aec3b2cd1c86 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:58:57.842263 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-c14f9330-fb4d-48d4-9f00-aec3b2cd1c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:58:57.986303 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 14/26] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 12:58:58.022088 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f9330-fb4d-48d4-9f00-aec3b2cd1c86 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:58.027861 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1d202-5d9b-4b9a-a36b-f2c80800babc None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:58.076182 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac1c33-10e8-4d0e-890b-88c2e2036850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:58.076882 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac1c33-10e8-4d0e-890b-88c2e2036850 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:58.077157 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac1c33-10e8-4d0e-890b-88c2e2036850 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:58.077442 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac1c33-10e8-4d0e-890b-88c2e2036850 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:58.078198 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac1c33-10e8-4d0e-890b-88c2e2036850 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:58:58.079178 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac1c33-10e8-4d0e-890b-88c2e2036850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:58.080586 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac1c33-10e8-4d0e-890b-88c2e2036850 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:58.097564 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 13/27] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:58:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:58:58.103625 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac1c33-10e8-4d0e-890b-88c2e2036850 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:58.239690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f9330-fb4d-48d4-9f00-aec3b2cd1c86 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:58.290193 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac1c33-10e8-4d0e-890b-88c2e2036850 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:58.304643 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b32aa-deed-4f84-a05b-7e72a1dae567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:58.305338 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b32aa-deed-4f84-a05b-7e72a1dae567 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:58.305622 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b32aa-deed-4f84-a05b-7e72a1dae567 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:58.305899 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b32aa-deed-4f84-a05b-7e72a1dae567 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:58.306656 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b32aa-deed-4f84-a05b-7e72a1dae567 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:58.308064 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b32aa-deed-4f84-a05b-7e72a1dae567 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:58.348550 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb88e0e-b512-4401-8065-d5d61f15d18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:58.349552 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb88e0e-b512-4401-8065-d5d61f15d18a None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:58.349951 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb88e0e-b512-4401-8065-d5d61f15d18a None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:58.350348 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb88e0e-b512-4401-8065-d5d61f15d18a None admin] PATH_INFO: `/v3/users/ea423af17abb444a87ac0e8ed4f3af6b` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:58.351630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb88e0e-b512-4401-8065-d5d61f15d18a None admin] RBAC: Authorizing `identity:get_user(user_id=ea423af17abb444a87ac0e8ed4f3af6b)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:58.353259 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb88e0e-b512-4401-8065-d5d61f15d18a None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:58.355334 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 14/28] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:58:58 2022] GET /identity/v3/users/ea423af17abb444a87ac0e8ed4f3af6b => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:58:58.356717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74927683-80ab-4e92-9d5d-31872ec8030e None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:58.357008 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74927683-80ab-4e92-9d5d-31872ec8030e None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:58.357296 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74927683-80ab-4e92-9d5d-31872ec8030e None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:58.359216 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 15/29] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:58:58.360883 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74927683-80ab-4e92-9d5d-31872ec8030e None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:58.475586 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74927683-80ab-4e92-9d5d-31872ec8030e None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:58.519220 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e59ec-2fc6-42ff-81f2-be42dbebe34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:58.519220 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e59ec-2fc6-42ff-81f2-be42dbebe34c None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:58.519220 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e59ec-2fc6-42ff-81f2-be42dbebe34c None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:58.519220 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e59ec-2fc6-42ff-81f2-be42dbebe34c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:58.519607 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e59ec-2fc6-42ff-81f2-be42dbebe34c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:58.519607 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e59ec-2fc6-42ff-81f2-be42dbebe34c None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:58.520591 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 16/30] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 12:58:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:58:58.525928 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c61a4b-9028-4c42-b8f7-ee811dcb6a9a None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:58.526222 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c61a4b-9028-4c42-b8f7-ee811dcb6a9a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:58.526507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c61a4b-9028-4c42-b8f7-ee811dcb6a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:58.544110 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-21c61a4b-9028-4c42-b8f7-ee811dcb6a9a None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:58:58.548597 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-21c61a4b-9028-4c42-b8f7-ee811dcb6a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:58:58.568907 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 15/31] 10.222.0.52 () {60 vars in 1131 bytes} [Tue Mar 8 12:58:58 2022] POST /identity/v3/roles => generated 219 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:58:58.570567 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b32aa-deed-4f84-a05b-7e72a1dae567 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:58.627212 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 17/32] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:58:58.629110 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091f9df-4b02-4324-ab27-a57a7aa1c9d9 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:58.629404 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091f9df-4b02-4324-ab27-a57a7aa1c9d9 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:58.629679 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091f9df-4b02-4324-ab27-a57a7aa1c9d9 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:58.631628 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 18/33] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:58:58.638308 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caef8f9-c2f9-471d-bb81-6d9cebe61955 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:58.638584 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caef8f9-c2f9-471d-bb81-6d9cebe61955 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:58.638864 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caef8f9-c2f9-471d-bb81-6d9cebe61955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:58.671324 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-3caef8f9-c2f9-471d-bb81-6d9cebe61955 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:58:58.672626 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-3caef8f9-c2f9-471d-bb81-6d9cebe61955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:58:58.701250 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b32aa-deed-4f84-a05b-7e72a1dae567 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:58.738155 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e935e7e-fb3e-4560-8c75-92686c4bdcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:58.739053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e935e7e-fb3e-4560-8c75-92686c4bdcd5 None admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:58.739335 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e935e7e-fb3e-4560-8c75-92686c4bdcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:58.739616 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e935e7e-fb3e-4560-8c75-92686c4bdcd5 None admin] PATH_INFO: `/v3/domains/default/users/ea423af17abb444a87ac0e8ed4f3af6b/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:58.742269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e935e7e-fb3e-4560-8c75-92686c4bdcd5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ea423af17abb444a87ac0e8ed4f3af6b, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:58.743844 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e935e7e-fb3e-4560-8c75-92686c4bdcd5 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:58.775249 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 19/34] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 12:58:58.776147 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caef8f9-c2f9-471d-bb81-6d9cebe61955 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:58.857170 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 16/35] 10.222.0.52 () {58 vars in 1361 bytes} [Tue Mar 8 12:58:58 2022] PUT /identity/v3/domains/default/users/ea423af17abb444a87ac0e8ed4f3af6b/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:58:58.858063 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e935e7e-fb3e-4560-8c75-92686c4bdcd5 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:58.888620 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caef8f9-c2f9-471d-bb81-6d9cebe61955 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:58.931650 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed130de4-8442-4dcc-9db4-bce8489baf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:58.932472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed130de4-8442-4dcc-9db4-bce8489baf7f None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:58.932788 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed130de4-8442-4dcc-9db4-bce8489baf7f None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:58.933064 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed130de4-8442-4dcc-9db4-bce8489baf7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:58.948060 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed130de4-8442-4dcc-9db4-bce8489baf7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:58.949617 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed130de4-8442-4dcc-9db4-bce8489baf7f None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:58.968870 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-ed130de4-8442-4dcc-9db4-bce8489baf7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 12:58:58.971260 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 20/36] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 12:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:58:58.978933 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed130de4-8442-4dcc-9db4-bce8489baf7f None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:59.090135 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e935e7e-fb3e-4560-8c75-92686c4bdcd5 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:59.098875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed130de4-8442-4dcc-9db4-bce8489baf7f None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:59.140912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37944904-942f-4be3-b49c-b05e0e64874c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:59.141801 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37944904-942f-4be3-b49c-b05e0e64874c None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:59.142088 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37944904-942f-4be3-b49c-b05e0e64874c None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:59.142453 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37944904-942f-4be3-b49c-b05e0e64874c None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:59.143410 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37944904-942f-4be3-b49c-b05e0e64874c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:59.143723 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950dd3c-30ff-4cc7-960c-e44197e061e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:59.144400 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950dd3c-30ff-4cc7-960c-e44197e061e7 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:59.144717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950dd3c-30ff-4cc7-960c-e44197e061e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:59.144901 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37944904-942f-4be3-b49c-b05e0e64874c None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:59.145075 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950dd3c-30ff-4cc7-960c-e44197e061e7 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:59.145736 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950dd3c-30ff-4cc7-960c-e44197e061e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:58:59.146046 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950dd3c-30ff-4cc7-960c-e44197e061e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:59.147504 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950dd3c-30ff-4cc7-960c-e44197e061e7 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:59.167856 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 21/37] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 12:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:58:59.173651 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950dd3c-30ff-4cc7-960c-e44197e061e7 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:59.230223 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 17/38] 10.222.0.52 () {60 vars in 1131 bytes} [Tue Mar 8 12:58:58 2022] POST /identity/v3/roles => generated 225 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:58:59.304746 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950dd3c-30ff-4cc7-960c-e44197e061e7 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:59.306029 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba048cfa-d539-4c7a-a076-1770ec28fba9 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:59.306332 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba048cfa-d539-4c7a-a076-1770ec28fba9 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:59.306602 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba048cfa-d539-4c7a-a076-1770ec28fba9 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:59.308632 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 18/39] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:58:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 12:58:59.326636 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae685c48-84c2-4a75-89f3-cbed49c24da7 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:59.326919 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae685c48-84c2-4a75-89f3-cbed49c24da7 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:59.327198 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae685c48-84c2-4a75-89f3-cbed49c24da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:59.361865 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-ae685c48-84c2-4a75-89f3-cbed49c24da7 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:58:59.364867 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-ae685c48-84c2-4a75-89f3-cbed49c24da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:58:59.380058 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cad21d-2809-478b-bff6-cf5e23515d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:59.381128 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cad21d-2809-478b-bff6-cf5e23515d05 None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:59.381613 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cad21d-2809-478b-bff6-cf5e23515d05 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:59.382063 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cad21d-2809-478b-bff6-cf5e23515d05 None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:59.382980 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cad21d-2809-478b-bff6-cf5e23515d05 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:59.384689 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cad21d-2809-478b-bff6-cf5e23515d05 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:59.465820 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 19/40] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 12:58:59.490413 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae685c48-84c2-4a75-89f3-cbed49c24da7 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:59.591559 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae685c48-84c2-4a75-89f3-cbed49c24da7 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:59.632332 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 22/41] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 12:58:59 2022] POST /identity/v3/projects => generated 301 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:58:59.632332 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b294b1-491c-4a08-b010-7a77c7b7e40f None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:59.632332 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b294b1-491c-4a08-b010-7a77c7b7e40f None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:59.632332 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b294b1-491c-4a08-b010-7a77c7b7e40f None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:59.632332 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 23/42] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:58:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:58:59.634459 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4efb3-082c-459f-9654-c4b2b256d4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:59.634807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33c572-ceca-4fa6-96bb-e49ed1a2ee1b None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:59.635095 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33c572-ceca-4fa6-96bb-e49ed1a2ee1b None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:59.635373 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33c572-ceca-4fa6-96bb-e49ed1a2ee1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:59.635474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4efb3-082c-459f-9654-c4b2b256d4f9 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:59.635809 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4efb3-082c-459f-9654-c4b2b256d4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:59.636171 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4efb3-082c-459f-9654-c4b2b256d4f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:59.637624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4efb3-082c-459f-9654-c4b2b256d4f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:59.639137 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4efb3-082c-459f-9654-c4b2b256d4f9 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:59.641630 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 20/43] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 12:58:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:58:59.647258 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4efb3-082c-459f-9654-c4b2b256d4f9 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:59.655602 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-6e33c572-ceca-4fa6-96bb-e49ed1a2ee1b None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:58:59.657971 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6e33c572-ceca-4fa6-96bb-e49ed1a2ee1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:58:59.733837 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 24/44] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 12:58:59.757606 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33c572-ceca-4fa6-96bb-e49ed1a2ee1b None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:58:59.768849 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4efb3-082c-459f-9654-c4b2b256d4f9 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:59.821669 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1bd55-2f2f-49ac-b060-91c0c4bde81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:59.823384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1bd55-2f2f-49ac-b060-91c0c4bde81c None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:59.823672 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1bd55-2f2f-49ac-b060-91c0c4bde81c None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:59.826762 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1bd55-2f2f-49ac-b060-91c0c4bde81c None admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:59.826762 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1bd55-2f2f-49ac-b060-91c0c4bde81c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:59.827720 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1bd55-2f2f-49ac-b060-91c0c4bde81c None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:59.870090 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33c572-ceca-4fa6-96bb-e49ed1a2ee1b None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:58:59.905872 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca506bb-88c6-4991-9897-5062d1f55a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:58:59.907054 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca506bb-88c6-4991-9897-5062d1f55a0b None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:58:59.907516 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca506bb-88c6-4991-9897-5062d1f55a0b None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:58:59.907888 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca506bb-88c6-4991-9897-5062d1f55a0b None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:58:59.909013 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca506bb-88c6-4991-9897-5062d1f55a0b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:58:59.910616 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca506bb-88c6-4991-9897-5062d1f55a0b None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:58:59.935555 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 21/45] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 12:58:59 2022] POST /identity/v3/projects => generated 312 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:59:00.015442 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 25/46] 10.222.0.52 () {60 vars in 1131 bytes} [Tue Mar 8 12:58:59 2022] POST /identity/v3/roles => generated 223 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:59:01.472843 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217920d5-18c3-4f3f-8368-dd7ee03ad5a9 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:01.473373 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217920d5-18c3-4f3f-8368-dd7ee03ad5a9 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:01.473475 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217920d5-18c3-4f3f-8368-dd7ee03ad5a9 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:01.475211 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 22/47] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:01.480499 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008fba0-aa6f-471b-8af0-073bff5e2558 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:01.480926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008fba0-aa6f-471b-8af0-073bff5e2558 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:01.481108 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008fba0-aa6f-471b-8af0-073bff5e2558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:01.497668 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-4008fba0-aa6f-471b-8af0-073bff5e2558 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:01.498868 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-4008fba0-aa6f-471b-8af0-073bff5e2558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:01.563800 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 26/48] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:01.587271 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217920d5-18c3-4f3f-8368-dd7ee03ad5a9 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:01.684222 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217920d5-18c3-4f3f-8368-dd7ee03ad5a9 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:01.716232 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b57fa2-9de5-4615-be23-88f172d3c25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:01.717053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b57fa2-9de5-4615-be23-88f172d3c25d None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:01.717339 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b57fa2-9de5-4615-be23-88f172d3c25d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:01.717618 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b57fa2-9de5-4615-be23-88f172d3c25d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:01.728835 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b57fa2-9de5-4615-be23-88f172d3c25d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:01.736167 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-55b57fa2-9de5-4615-be23-88f172d3c25d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 12:59:01.737381 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 23/49] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 12:59:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:01.743311 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008fba0-aa6f-471b-8af0-073bff5e2558 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:01.836574 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008fba0-aa6f-471b-8af0-073bff5e2558 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:01.868519 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b53d6-1afc-4ee1-a00f-f641bb0d57b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:01.869230 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b53d6-1afc-4ee1-a00f-f641bb0d57b7 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:01.869517 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b53d6-1afc-4ee1-a00f-f641bb0d57b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:01.869796 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b53d6-1afc-4ee1-a00f-f641bb0d57b7 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:01.870547 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b53d6-1afc-4ee1-a00f-f641bb0d57b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:01.870858 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b53d6-1afc-4ee1-a00f-f641bb0d57b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:01.872275 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b53d6-1afc-4ee1-a00f-f641bb0d57b7 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:01.881014 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 27/50] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:01.886391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b57fa2-9de5-4615-be23-88f172d3c25d None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:01.985479 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b57fa2-9de5-4615-be23-88f172d3c25d None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:02.018492 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9ac9e-bf88-46f6-82cf-160286bd63b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:02.019363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9ac9e-bf88-46f6-82cf-160286bd63b5 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:02.019644 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9ac9e-bf88-46f6-82cf-160286bd63b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:02.019918 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9ac9e-bf88-46f6-82cf-160286bd63b5 None admin] PATH_INFO: `/v3/users/ea423af17abb444a87ac0e8ed4f3af6b` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:02.021129 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9ac9e-bf88-46f6-82cf-160286bd63b5 None admin] RBAC: Authorizing `identity:get_user(user_id=ea423af17abb444a87ac0e8ed4f3af6b)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:02.022592 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9ac9e-bf88-46f6-82cf-160286bd63b5 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:02.024183 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 24/51] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:01 2022] GET /identity/v3/users/ea423af17abb444a87ac0e8ed4f3af6b => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:02.029496 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b53d6-1afc-4ee1-a00f-f641bb0d57b7 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:02.123268 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b53d6-1afc-4ee1-a00f-f641bb0d57b7 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:02.162458 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d64d5a-97ee-4d6f-bd8e-9d44a3a3a2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:02.163251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d64d5a-97ee-4d6f-bd8e-9d44a3a3a2b9 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:02.163537 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d64d5a-97ee-4d6f-bd8e-9d44a3a3a2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:02.163816 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d64d5a-97ee-4d6f-bd8e-9d44a3a3a2b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:02.165018 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d64d5a-97ee-4d6f-bd8e-9d44a3a3a2b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:02.166475 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d64d5a-97ee-4d6f-bd8e-9d44a3a3a2b9 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:02.168076 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 28/52] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 12:59:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:02.174501 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9ac9e-bf88-46f6-82cf-160286bd63b5 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:02.267917 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9ac9e-bf88-46f6-82cf-160286bd63b5 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:02.301685 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc720e49-b781-430f-a179-4219e67d615d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:02.302341 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc720e49-b781-430f-a179-4219e67d615d None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:02.302626 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc720e49-b781-430f-a179-4219e67d615d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:02.302903 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc720e49-b781-430f-a179-4219e67d615d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:02.303721 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc720e49-b781-430f-a179-4219e67d615d None admin] RBAC: Adding query filter params (role.id=f9ec85924a914e078096b38cae4e6caa, scope.domain.id=default, user.id=ea423af17abb444a87ac0e8ed4f3af6b) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:02.304030 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc720e49-b781-430f-a179-4219e67d615d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:02.305496 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc720e49-b781-430f-a179-4219e67d615d None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:02.313188 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdd0bb-1a8b-452a-93bb-1b6d9e439d1f None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:02.313481 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdd0bb-1a8b-452a-93bb-1b6d9e439d1f None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:02.313808 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdd0bb-1a8b-452a-93bb-1b6d9e439d1f None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:02.314357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 25/53] 10.222.0.52 () {56 vars in 1322 bytes} [Tue Mar 8 12:59:02 2022] GET /identity/v3/role_assignments?user.id=ea423af17abb444a87ac0e8ed4f3af6b&scope.domain.id=default&role.id=f9ec85924a914e078096b38cae4e6caa => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:02.315601 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 29/54] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 12:59:02.321345 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69ae75-4b79-464a-ba02-4a5519ec9e14 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:02.321647 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69ae75-4b79-464a-ba02-4a5519ec9e14 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:02.321933 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69ae75-4b79-464a-ba02-4a5519ec9e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:02.339970 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-af69ae75-4b79-464a-ba02-4a5519ec9e14 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:02.341260 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-af69ae75-4b79-464a-ba02-4a5519ec9e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:02.411943 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 26/55] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 12:59:02.435607 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdd0bb-1a8b-452a-93bb-1b6d9e439d1f None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:02.537168 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdd0bb-1a8b-452a-93bb-1b6d9e439d1f None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:02.570052 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9340ff9-02f3-437c-930a-b90b76db2bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:02.570838 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9340ff9-02f3-437c-930a-b90b76db2bea None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:02.571121 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9340ff9-02f3-437c-930a-b90b76db2bea None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:02.571393 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9340ff9-02f3-437c-930a-b90b76db2bea None admin] PATH_INFO: `/v3/domains/default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:02.572567 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9340ff9-02f3-437c-930a-b90b76db2bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:02.574080 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9340ff9-02f3-437c-930a-b90b76db2bea None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:02.575672 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 30/56] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 12:59:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:02.581655 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69ae75-4b79-464a-ba02-4a5519ec9e14 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:02.675348 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69ae75-4b79-464a-ba02-4a5519ec9e14 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:02.707270 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94160354-2120-4d35-9eab-35d2fb82a348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:02.707917 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94160354-2120-4d35-9eab-35d2fb82a348 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:02.708201 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94160354-2120-4d35-9eab-35d2fb82a348 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:02.708478 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94160354-2120-4d35-9eab-35d2fb82a348 None admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:02.709218 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94160354-2120-4d35-9eab-35d2fb82a348 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:02.710663 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94160354-2120-4d35-9eab-35d2fb82a348 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:02.833353 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 27/57] 10.222.0.52 () {60 vars in 1140 bytes} [Tue Mar 8 12:59:02 2022] POST /identity/v3/projects => generated 298 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:59:05.138097 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113ab42-f19e-41e8-b3a2-3924d7b16937 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:05.138631 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113ab42-f19e-41e8-b3a2-3924d7b16937 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:05.138631 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113ab42-f19e-41e8-b3a2-3924d7b16937 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:05.140472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 31/58] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:05.145721 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c46e7-06c6-44a8-a0ff-4cc440a69765 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:05.146118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c46e7-06c6-44a8-a0ff-4cc440a69765 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:05.146284 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c46e7-06c6-44a8-a0ff-4cc440a69765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:05.164602 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-1c6c46e7-06c6-44a8-a0ff-4cc440a69765 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:05.165817 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-1c6c46e7-06c6-44a8-a0ff-4cc440a69765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:05.227883 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 28/59] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:05.257944 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113ab42-f19e-41e8-b3a2-3924d7b16937 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:05.361779 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113ab42-f19e-41e8-b3a2-3924d7b16937 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:05.393090 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb999f8c-b7d2-4982-8f65-29b27101c147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:05.393813 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb999f8c-b7d2-4982-8f65-29b27101c147 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:05.394097 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb999f8c-b7d2-4982-8f65-29b27101c147 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:05.394372 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb999f8c-b7d2-4982-8f65-29b27101c147 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:05.395539 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb999f8c-b7d2-4982-8f65-29b27101c147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:05.397044 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb999f8c-b7d2-4982-8f65-29b27101c147 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:05.398639 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 32/60] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 12:59:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:05.404169 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c46e7-06c6-44a8-a0ff-4cc440a69765 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:05.499119 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c46e7-06c6-44a8-a0ff-4cc440a69765 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:05.531565 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e7399-c3bb-4bdc-a23d-0d498497fbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:05.532245 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e7399-c3bb-4bdc-a23d-0d498497fbc1 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:05.532533 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e7399-c3bb-4bdc-a23d-0d498497fbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:05.533104 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e7399-c3bb-4bdc-a23d-0d498497fbc1 None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:05.533820 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e7399-c3bb-4bdc-a23d-0d498497fbc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:05.535307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e7399-c3bb-4bdc-a23d-0d498497fbc1 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:05.648206 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 29/61] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 12:59:05 2022] POST /identity/v3/users => generated 275 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:59:09.164368 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdeb1b-0f81-4dc1-a442-f8aa16012680 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:09.165424 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdeb1b-0f81-4dc1-a442-f8aa16012680 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:09.165935 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdeb1b-0f81-4dc1-a442-f8aa16012680 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:09.168932 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 33/62] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:09.178565 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8167d7-2f8b-4187-bc81-88b221a793c1 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:09.180034 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8167d7-2f8b-4187-bc81-88b221a793c1 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:09.180849 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8167d7-2f8b-4187-bc81-88b221a793c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:09.209910 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-7c8167d7-2f8b-4187-bc81-88b221a793c1 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:09.211532 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-7c8167d7-2f8b-4187-bc81-88b221a793c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:09.302564 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 30/63] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:09.330094 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e76d23-7608-4f33-be49-8c8eb54ad353 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:09.330834 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e76d23-7608-4f33-be49-8c8eb54ad353 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:09.331345 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e76d23-7608-4f33-be49-8c8eb54ad353 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:09.333469 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 34/64] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:09.339016 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a927b-103c-435e-9cda-faf359311d88 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:09.339308 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a927b-103c-435e-9cda-faf359311d88 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:09.339589 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a927b-103c-435e-9cda-faf359311d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:09.348789 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e76d23-7608-4f33-be49-8c8eb54ad353 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:09.370559 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-739a927b-103c-435e-9cda-faf359311d88 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:09.371749 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-739a927b-103c-435e-9cda-faf359311d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:09.496150 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 31/65] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:09.507575 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca6ffb-c3c1-4821-9dc5-24e1169de098 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:09.510327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e76d23-7608-4f33-be49-8c8eb54ad353 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:09.511920 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca6ffb-c3c1-4821-9dc5-24e1169de098 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:09.512211 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca6ffb-c3c1-4821-9dc5-24e1169de098 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:09.514163 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 32/66] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:09 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:09.521119 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dba28c-be25-4f3e-88ab-1526913fe9f2 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:09.521405 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dba28c-be25-4f3e-88ab-1526913fe9f2 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:09.521684 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dba28c-be25-4f3e-88ab-1526913fe9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:09.543401 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-d8dba28c-be25-4f3e-88ab-1526913fe9f2 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:09.544849 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-d8dba28c-be25-4f3e-88ab-1526913fe9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:09.560221 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcda55a-08c1-46a8-afae-bf1923569d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:09.561518 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcda55a-08c1-46a8-afae-bf1923569d1d None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:09.562880 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcda55a-08c1-46a8-afae-bf1923569d1d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:09.563611 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcda55a-08c1-46a8-afae-bf1923569d1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:09.576727 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcda55a-08c1-46a8-afae-bf1923569d1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:09.585578 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-4fcda55a-08c1-46a8-afae-bf1923569d1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 12:59:09.592864 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 35/67] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 12:59:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 12:59:09.594844 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcda55a-08c1-46a8-afae-bf1923569d1d None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:09.627116 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 33/68] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:09.628308 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dba28c-be25-4f3e-88ab-1526913fe9f2 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:09.710218 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcda55a-08c1-46a8-afae-bf1923569d1d None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:09.725565 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dba28c-be25-4f3e-88ab-1526913fe9f2 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:09.743819 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327d2c3-c002-48a9-83e6-9a9350bb158a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:09.744953 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327d2c3-c002-48a9-83e6-9a9350bb158a None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:09.745437 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327d2c3-c002-48a9-83e6-9a9350bb158a None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:09.745911 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327d2c3-c002-48a9-83e6-9a9350bb158a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:09.756138 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327d2c3-c002-48a9-83e6-9a9350bb158a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:09.759138 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e91b8-32c8-4a08-8d5a-43bb8442447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:09.759808 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e91b8-32c8-4a08-8d5a-43bb8442447d None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:09.760096 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e91b8-32c8-4a08-8d5a-43bb8442447d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:09.760376 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e91b8-32c8-4a08-8d5a-43bb8442447d None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:09.761156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e91b8-32c8-4a08-8d5a-43bb8442447d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:09.761464 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e91b8-32c8-4a08-8d5a-43bb8442447d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:09.762865 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e91b8-32c8-4a08-8d5a-43bb8442447d None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:09.763522 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-2327d2c3-c002-48a9-83e6-9a9350bb158a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 12:59:09.769539 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 36/69] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:09.769539 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e3b18-90b5-4626-99ee-9fc63da41951 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:09.769539 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e3b18-90b5-4626-99ee-9fc63da41951 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:09.769539 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e3b18-90b5-4626-99ee-9fc63da41951 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:09.769539 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 37/70] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:09.772539 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e3b18-90b5-4626-99ee-9fc63da41951 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:09.784564 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 34/71] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:09.784564 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e91b8-32c8-4a08-8d5a-43bb8442447d None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:09.870775 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e3b18-90b5-4626-99ee-9fc63da41951 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:09.895197 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e91b8-32c8-4a08-8d5a-43bb8442447d None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:09.903347 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910bf13-533e-4047-b7cf-14b8e75ea9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:09.904162 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910bf13-533e-4047-b7cf-14b8e75ea9b5 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:09.904456 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910bf13-533e-4047-b7cf-14b8e75ea9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:09.904767 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910bf13-533e-4047-b7cf-14b8e75ea9b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:09.915394 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910bf13-533e-4047-b7cf-14b8e75ea9b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:09.923411 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-b910bf13-533e-4047-b7cf-14b8e75ea9b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 12:59:09.924594 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 38/72] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 12:59:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:09.929952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f3e7b-e7b9-4367-81b0-12a32f22da50 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:09.929952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f3e7b-e7b9-4367-81b0-12a32f22da50 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:09.929952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f3e7b-e7b9-4367-81b0-12a32f22da50 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:09.930156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd28409-4506-4b66-b1e2-35f65dd3925a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:09.930240 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 39/73] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:09.930316 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd28409-4506-4b66-b1e2-35f65dd3925a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:09.930316 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd28409-4506-4b66-b1e2-35f65dd3925a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:09.930432 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4ab06-1340-4b72-adf5-b01fc849c61a None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:09.930495 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd28409-4506-4b66-b1e2-35f65dd3925a None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:09.930557 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4ab06-1340-4b72-adf5-b01fc849c61a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:09.930557 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4ab06-1340-4b72-adf5-b01fc849c61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:09.930680 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd28409-4506-4b66-b1e2-35f65dd3925a None admin] RBAC: Adding query filter params (name=member) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:09.930680 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd28409-4506-4b66-b1e2-35f65dd3925a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:09.931811 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd28409-4506-4b66-b1e2-35f65dd3925a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:09.940841 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 35/74] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:09.941499 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd28409-4506-4b66-b1e2-35f65dd3925a None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:09.950566 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-91b4ab06-1340-4b72-adf5-b01fc849c61a None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:09.951854 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-91b4ab06-1340-4b72-adf5-b01fc849c61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:10.014252 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 40/75] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:10.015092 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4ab06-1340-4b72-adf5-b01fc849c61a None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:10.037358 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd28409-4506-4b66-b1e2-35f65dd3925a None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:10.070149 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d68742-9f92-4b38-ae30-b83391fd1819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:10.071021 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d68742-9f92-4b38-ae30-b83391fd1819 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:10.071313 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d68742-9f92-4b38-ae30-b83391fd1819 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:10.071594 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d68742-9f92-4b38-ae30-b83391fd1819 None admin] PATH_INFO: `/v3/users/ea423af17abb444a87ac0e8ed4f3af6b` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:10.072829 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d68742-9f92-4b38-ae30-b83391fd1819 None admin] RBAC: Authorizing `identity:get_user(user_id=ea423af17abb444a87ac0e8ed4f3af6b)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:10.074294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d68742-9f92-4b38-ae30-b83391fd1819 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:10.075914 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 36/76] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:09 2022] GET /identity/v3/users/ea423af17abb444a87ac0e8ed4f3af6b => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:10.077072 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c778c15-2c17-4857-877a-993c556a047b None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:10.077362 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c778c15-2c17-4857-877a-993c556a047b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:10.077674 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c778c15-2c17-4857-877a-993c556a047b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:10.093507 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-7c778c15-2c17-4857-877a-993c556a047b None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:10.094850 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-7c778c15-2c17-4857-877a-993c556a047b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:10.112973 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4ab06-1340-4b72-adf5-b01fc849c61a None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:10.144946 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ae64d-4484-4c3e-a579-c96981951bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:10.145821 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ae64d-4484-4c3e-a579-c96981951bae None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:10.146305 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ae64d-4484-4c3e-a579-c96981951bae None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:10.146778 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ae64d-4484-4c3e-a579-c96981951bae None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:10.147755 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ae64d-4484-4c3e-a579-c96981951bae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:10.148072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ae64d-4484-4c3e-a579-c96981951bae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:10.149500 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ae64d-4484-4c3e-a579-c96981951bae None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:10.158761 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 37/77] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:10.159607 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c778c15-2c17-4857-877a-993c556a047b None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:10.164480 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 41/78] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 12:59:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:10.165429 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ae64d-4484-4c3e-a579-c96981951bae None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:10.255320 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c778c15-2c17-4857-877a-993c556a047b None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:10.258854 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ae64d-4484-4c3e-a579-c96981951bae None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:10.286948 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21c384-e3be-435a-a3db-255c705c7081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:10.287836 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21c384-e3be-435a-a3db-255c705c7081 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:10.288123 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21c384-e3be-435a-a3db-255c705c7081 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:10.288403 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21c384-e3be-435a-a3db-255c705c7081 None admin] PATH_INFO: `/v3/users/be52c2e382db45d0af34429705c6405e` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:10.290294 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3751084-7d0a-4d49-a467-539731b75120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:10.291093 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3751084-7d0a-4d49-a467-539731b75120 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:10.291381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3751084-7d0a-4d49-a467-539731b75120 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:10.291663 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3751084-7d0a-4d49-a467-539731b75120 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:10.292890 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3751084-7d0a-4d49-a467-539731b75120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:10.294374 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3751084-7d0a-4d49-a467-539731b75120 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:10.301180 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 42/79] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 12:59:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:10.301180 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3751084-7d0a-4d49-a467-539731b75120 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:10.303606 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21c384-e3be-435a-a3db-255c705c7081 None admin] RBAC: Authorizing `identity:get_user(user_id=be52c2e382db45d0af34429705c6405e)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:10.305101 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21c384-e3be-435a-a3db-255c705c7081 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:10.306935 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 38/80] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:10 2022] GET /identity/v3/users/be52c2e382db45d0af34429705c6405e => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:10.307588 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21c384-e3be-435a-a3db-255c705c7081 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:10.396594 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3751084-7d0a-4d49-a467-539731b75120 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:10.401591 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21c384-e3be-435a-a3db-255c705c7081 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:10.429020 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00e12a-87d0-4f1f-a57f-60115e23d737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:10.429673 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00e12a-87d0-4f1f-a57f-60115e23d737 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:10.429963 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00e12a-87d0-4f1f-a57f-60115e23d737 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:10.430246 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00e12a-87d0-4f1f-a57f-60115e23d737 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:10.434114 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f3d9d-786e-4e6d-af20-6bb0961a148f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:10.434983 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f3d9d-786e-4e6d-af20-6bb0961a148f None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:10.435268 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f3d9d-786e-4e6d-af20-6bb0961a148f None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:10.435542 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f3d9d-786e-4e6d-af20-6bb0961a148f None admin] PATH_INFO: `/v3/users/be52c2e382db45d0af34429705c6405e` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:10.436753 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f3d9d-786e-4e6d-af20-6bb0961a148f None admin] RBAC: Authorizing `identity:get_user(user_id=be52c2e382db45d0af34429705c6405e)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:10.438429 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f3d9d-786e-4e6d-af20-6bb0961a148f None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:10.440214 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 39/81] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:10 2022] GET /identity/v3/users/be52c2e382db45d0af34429705c6405e => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:10.440914 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f3d9d-786e-4e6d-af20-6bb0961a148f None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:10.499340 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00e12a-87d0-4f1f-a57f-60115e23d737 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:10.500855 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00e12a-87d0-4f1f-a57f-60115e23d737 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:10.533422 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f3d9d-786e-4e6d-af20-6bb0961a148f None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:10.565632 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10b711-a55e-4186-8a4c-e3937cb32bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:10.566360 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10b711-a55e-4186-8a4c-e3937cb32bae None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:10.566648 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10b711-a55e-4186-8a4c-e3937cb32bae None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:10.566928 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10b711-a55e-4186-8a4c-e3937cb32bae None admin] PATH_INFO: `/v3/roles/member` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:10.576500 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10b711-a55e-4186-8a4c-e3937cb32bae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:10.583719 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-cf10b711-a55e-4186-8a4c-e3937cb32bae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 12:59:10.584919 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 40/82] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:10.585687 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10b711-a55e-4186-8a4c-e3937cb32bae None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:10.592308 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 43/83] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:10.594193 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00e12a-87d0-4f1f-a57f-60115e23d737 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:10.680144 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10b711-a55e-4186-8a4c-e3937cb32bae None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:10.686803 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00e12a-87d0-4f1f-a57f-60115e23d737 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:10.713333 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae07dad-9d90-45f7-ab83-2277bc57a373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:10.713996 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae07dad-9d90-45f7-ab83-2277bc57a373 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:10.714281 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae07dad-9d90-45f7-ab83-2277bc57a373 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:10.714555 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae07dad-9d90-45f7-ab83-2277bc57a373 None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:10.715273 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae07dad-9d90-45f7-ab83-2277bc57a373 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:10.716751 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae07dad-9d90-45f7-ab83-2277bc57a373 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:10.719551 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5a539-5333-4900-aa2f-bff010df7b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:10.720199 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5a539-5333-4900-aa2f-bff010df7b73 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:10.720489 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5a539-5333-4900-aa2f-bff010df7b73 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:10.720815 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5a539-5333-4900-aa2f-bff010df7b73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:10.786652 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5a539-5333-4900-aa2f-bff010df7b73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:10.788154 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5a539-5333-4900-aa2f-bff010df7b73 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:10.828822 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 41/84] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 12:59:10 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:59:10.828822 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae07dad-9d90-45f7-ab83-2277bc57a373 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:10.887691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 44/85] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:10.888607 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5a539-5333-4900-aa2f-bff010df7b73 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:10.924647 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae07dad-9d90-45f7-ab83-2277bc57a373 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:10.959069 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfade7f9-c7d9-47c4-b4aa-6caff5e58172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:10.959742 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfade7f9-c7d9-47c4-b4aa-6caff5e58172 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:10.960024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfade7f9-c7d9-47c4-b4aa-6caff5e58172 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:10.960300 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfade7f9-c7d9-47c4-b4aa-6caff5e58172 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:10.991862 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5a539-5333-4900-aa2f-bff010df7b73 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:11.030322 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfade7f9-c7d9-47c4-b4aa-6caff5e58172 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:11.030710 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ed382-6db7-4fb6-affb-b5cb72adb518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:11.031390 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ed382-6db7-4fb6-affb-b5cb72adb518 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:11.031673 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ed382-6db7-4fb6-affb-b5cb72adb518 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:11.031948 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ed382-6db7-4fb6-affb-b5cb72adb518 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:11.032038 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfade7f9-c7d9-47c4-b4aa-6caff5e58172 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:11.033055 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ed382-6db7-4fb6-affb-b5cb72adb518 None admin] RBAC: Adding query filter params (name=member) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:11.033363 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ed382-6db7-4fb6-affb-b5cb72adb518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:11.034917 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ed382-6db7-4fb6-affb-b5cb72adb518 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:11.044580 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 45/86] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:11.044580 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ed382-6db7-4fb6-affb-b5cb72adb518 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:11.134508 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 42/87] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:11.135375 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfade7f9-c7d9-47c4-b4aa-6caff5e58172 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:11.149624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ed382-6db7-4fb6-affb-b5cb72adb518 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:11.185416 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886d27d-3fc6-484b-be15-a0d343e4a970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:11.186286 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886d27d-3fc6-484b-be15-a0d343e4a970 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:11.186571 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886d27d-3fc6-484b-be15-a0d343e4a970 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:11.186960 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886d27d-3fc6-484b-be15-a0d343e4a970 None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:11.188182 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886d27d-3fc6-484b-be15-a0d343e4a970 None admin] RBAC: Authorizing `identity:get_project(project_id=5e8582daaa764afcaf9c73a4aab00169)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:11.189691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886d27d-3fc6-484b-be15-a0d343e4a970 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:11.191393 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 46/88] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:11 2022] GET /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:11.192170 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886d27d-3fc6-484b-be15-a0d343e4a970 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:11.247835 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfade7f9-c7d9-47c4-b4aa-6caff5e58172 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:11.284537 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3751d4-607e-4b73-94b0-e0052d527ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:11.285470 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3751d4-607e-4b73-94b0-e0052d527ef9 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:11.285761 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3751d4-607e-4b73-94b0-e0052d527ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:11.286047 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3751d4-607e-4b73-94b0-e0052d527ef9 None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:11.287269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3751d4-607e-4b73-94b0-e0052d527ef9 None admin] RBAC: Authorizing `identity:get_project(project_id=5e8582daaa764afcaf9c73a4aab00169)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:11.288831 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3751d4-607e-4b73-94b0-e0052d527ef9 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:11.290900 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 43/89] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:11 2022] GET /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:11.291757 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3751d4-607e-4b73-94b0-e0052d527ef9 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:11.293892 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886d27d-3fc6-484b-be15-a0d343e4a970 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:11.328080 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910e1f9-8c85-4a48-9204-67f93babfff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:11.329035 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910e1f9-8c85-4a48-9204-67f93babfff4 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:11.329324 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910e1f9-8c85-4a48-9204-67f93babfff4 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:11.329607 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910e1f9-8c85-4a48-9204-67f93babfff4 None admin] PATH_INFO: `/v3/users/be52c2e382db45d0af34429705c6405e` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:11.330844 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910e1f9-8c85-4a48-9204-67f93babfff4 None admin] RBAC: Authorizing `identity:get_user(user_id=be52c2e382db45d0af34429705c6405e)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:11.332308 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910e1f9-8c85-4a48-9204-67f93babfff4 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:11.334151 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 47/90] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:11 2022] GET /identity/v3/users/be52c2e382db45d0af34429705c6405e => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:11.334744 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910e1f9-8c85-4a48-9204-67f93babfff4 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:11.396587 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3751d4-607e-4b73-94b0-e0052d527ef9 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:11.432145 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93953f89-2859-41c5-90cc-626049a96aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:11.433047 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93953f89-2859-41c5-90cc-626049a96aa6 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:11.433347 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93953f89-2859-41c5-90cc-626049a96aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:11.433616 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93953f89-2859-41c5-90cc-626049a96aa6 None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:11.434805 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93953f89-2859-41c5-90cc-626049a96aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=5e8582daaa764afcaf9c73a4aab00169)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:11.436278 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93953f89-2859-41c5-90cc-626049a96aa6 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:11.439105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 44/91] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:11 2022] GET /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:11.439515 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910e1f9-8c85-4a48-9204-67f93babfff4 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:11.439964 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93953f89-2859-41c5-90cc-626049a96aa6 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:11.474479 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176a22b-2234-4099-b545-f669d145d34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:11.475148 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176a22b-2234-4099-b545-f669d145d34d None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:11.475437 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176a22b-2234-4099-b545-f669d145d34d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:11.475719 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176a22b-2234-4099-b545-f669d145d34d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:11.476552 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176a22b-2234-4099-b545-f669d145d34d None admin] RBAC: Adding query filter params (role.id=f9ec85924a914e078096b38cae4e6caa, scope.project.id=5e8582daaa764afcaf9c73a4aab00169, user.id=ea423af17abb444a87ac0e8ed4f3af6b) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:11.476908 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176a22b-2234-4099-b545-f669d145d34d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:11.478363 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176a22b-2234-4099-b545-f669d145d34d None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:11.484838 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 48/92] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 12:59:11 2022] GET /identity/v3/role_assignments?user.id=ea423af17abb444a87ac0e8ed4f3af6b&scope.project.id=5e8582daaa764afcaf9c73a4aab00169&role.id=f9ec85924a914e078096b38cae4e6caa => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:11.485652 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176a22b-2234-4099-b545-f669d145d34d None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:11.552272 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93953f89-2859-41c5-90cc-626049a96aa6 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:11.589112 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04956cb8-4ebc-41d9-ad80-236dce87298c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:11.589790 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04956cb8-4ebc-41d9-ad80-236dce87298c None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:11.590081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04956cb8-4ebc-41d9-ad80-236dce87298c None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:11.590415 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04956cb8-4ebc-41d9-ad80-236dce87298c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:11.590566 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176a22b-2234-4099-b545-f669d145d34d None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:11.591201 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04956cb8-4ebc-41d9-ad80-236dce87298c None admin] RBAC: Adding query filter params (role.id=e34b765cca514a83bef6eb9cff7ef871, scope.project.id=5e8582daaa764afcaf9c73a4aab00169, user.id=be52c2e382db45d0af34429705c6405e) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:11.591519 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04956cb8-4ebc-41d9-ad80-236dce87298c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:11.593113 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04956cb8-4ebc-41d9-ad80-236dce87298c None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:11.600280 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 45/93] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 12:59:11 2022] GET /identity/v3/role_assignments?user.id=be52c2e382db45d0af34429705c6405e&scope.project.id=5e8582daaa764afcaf9c73a4aab00169&role.id=e34b765cca514a83bef6eb9cff7ef871 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:11.601169 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04956cb8-4ebc-41d9-ad80-236dce87298c None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:11.628999 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44b9a7-17d5-46be-9a7e-c8bdacd5d33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:11.629665 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44b9a7-17d5-46be-9a7e-c8bdacd5d33c None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:11.629955 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44b9a7-17d5-46be-9a7e-c8bdacd5d33c None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:11.630237 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44b9a7-17d5-46be-9a7e-c8bdacd5d33c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:11.703161 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44b9a7-17d5-46be-9a7e-c8bdacd5d33c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:11.704674 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44b9a7-17d5-46be-9a7e-c8bdacd5d33c None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:11.712687 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04956cb8-4ebc-41d9-ad80-236dce87298c None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:11.768715 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c35d1-7f83-4d46-b9aa-1c07f383c952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:11.769395 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c35d1-7f83-4d46-b9aa-1c07f383c952 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:11.769687 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c35d1-7f83-4d46-b9aa-1c07f383c952 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:11.769975 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c35d1-7f83-4d46-b9aa-1c07f383c952 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:11.770822 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c35d1-7f83-4d46-b9aa-1c07f383c952 None admin] RBAC: Adding query filter params (role.id=a08ab7d3851a43ac8ed5339681d7de91, scope.project.id=5e8582daaa764afcaf9c73a4aab00169, user.id=be52c2e382db45d0af34429705c6405e) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:11.771139 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c35d1-7f83-4d46-b9aa-1c07f383c952 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:11.772699 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c35d1-7f83-4d46-b9aa-1c07f383c952 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:11.778781 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 46/94] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 12:59:11 2022] GET /identity/v3/role_assignments?user.id=be52c2e382db45d0af34429705c6405e&scope.project.id=5e8582daaa764afcaf9c73a4aab00169&role.id=a08ab7d3851a43ac8ed5339681d7de91 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:11.824204 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 49/95] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:11.830695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c35d1-7f83-4d46-b9aa-1c07f383c952 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:11.951006 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c35d1-7f83-4d46-b9aa-1c07f383c952 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:11.995116 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3dbf2-ec5a-4188-a08b-12405634d76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:11.995928 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3dbf2-ec5a-4188-a08b-12405634d76d None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:11.996217 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3dbf2-ec5a-4188-a08b-12405634d76d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:11.996497 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3dbf2-ec5a-4188-a08b-12405634d76d None admin] PATH_INFO: `/v3/projects/c3028825f71d4cf8bdcd974c7dda14fa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:11.997897 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3dbf2-ec5a-4188-a08b-12405634d76d None admin] RBAC: Authorizing `identity:get_project(project_id=c3028825f71d4cf8bdcd974c7dda14fa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:11.999982 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3dbf2-ec5a-4188-a08b-12405634d76d None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:12.001833 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 47/96] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:11 2022] GET /identity/v3/projects/c3028825f71d4cf8bdcd974c7dda14fa => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:12.007736 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44b9a7-17d5-46be-9a7e-c8bdacd5d33c None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:12.117607 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44b9a7-17d5-46be-9a7e-c8bdacd5d33c None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:12.152611 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931a268-3c47-49e0-b1d7-fc79bfd7edb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:12.153304 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931a268-3c47-49e0-b1d7-fc79bfd7edb1 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:12.153591 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931a268-3c47-49e0-b1d7-fc79bfd7edb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:12.153871 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931a268-3c47-49e0-b1d7-fc79bfd7edb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:12.154713 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931a268-3c47-49e0-b1d7-fc79bfd7edb1 None admin] RBAC: Adding query filter params (role.id=e34b765cca514a83bef6eb9cff7ef871, scope.project.id=c3028825f71d4cf8bdcd974c7dda14fa, user.id=be52c2e382db45d0af34429705c6405e) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:12.155025 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931a268-3c47-49e0-b1d7-fc79bfd7edb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:12.156765 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931a268-3c47-49e0-b1d7-fc79bfd7edb1 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:12.162760 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 50/97] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 12:59:12 2022] GET /identity/v3/role_assignments?user.id=be52c2e382db45d0af34429705c6405e&scope.project.id=c3028825f71d4cf8bdcd974c7dda14fa&role.id=e34b765cca514a83bef6eb9cff7ef871 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:14.036034 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a795e-f74c-426d-86bf-b0723cd7ccec None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:14.036596 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a795e-f74c-426d-86bf-b0723cd7ccec None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:14.036596 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a795e-f74c-426d-86bf-b0723cd7ccec None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:14.038404 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 48/98] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:14.043765 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a187b23-3c77-439b-ab0a-11f9e1b39fbd None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:14.044577 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a187b23-3c77-439b-ab0a-11f9e1b39fbd None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:14.045072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a187b23-3c77-439b-ab0a-11f9e1b39fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:14.076533 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-6a187b23-3c77-439b-ab0a-11f9e1b39fbd None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:14.078422 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6a187b23-3c77-439b-ab0a-11f9e1b39fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:14.164472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 51/99] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 12:59:14.201030 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a795e-f74c-426d-86bf-b0723cd7ccec None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:14.326498 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a795e-f74c-426d-86bf-b0723cd7ccec None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:14.369383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132abe86-a8da-4e2c-952c-9f21fb3bdfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:14.370198 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132abe86-a8da-4e2c-952c-9f21fb3bdfe5 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:14.370488 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132abe86-a8da-4e2c-952c-9f21fb3bdfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:14.370766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132abe86-a8da-4e2c-952c-9f21fb3bdfe5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:14.385661 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132abe86-a8da-4e2c-952c-9f21fb3bdfe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:14.396792 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-132abe86-a8da-4e2c-952c-9f21fb3bdfe5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 12:59:14.398397 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 49/100] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:14.403890 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a187b23-3c77-439b-ab0a-11f9e1b39fbd None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:14.628150 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a187b23-3c77-439b-ab0a-11f9e1b39fbd None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:14.687593 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39268fda-7e59-4485-9fbb-f6ac34d4e90c None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:14.687921 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39268fda-7e59-4485-9fbb-f6ac34d4e90c None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:14.688162 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39268fda-7e59-4485-9fbb-f6ac34d4e90c None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:14.690221 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 50/101] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 12:59:14.695964 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f0455-bac8-46e4-b758-a59232f0ab13 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:14.696261 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f0455-bac8-46e4-b758-a59232f0ab13 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:14.696534 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f0455-bac8-46e4-b758-a59232f0ab13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:14.728349 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-e98f0455-bac8-46e4-b758-a59232f0ab13 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:14.729603 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e98f0455-bac8-46e4-b758-a59232f0ab13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:14.771415 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cd2db-157b-44d0-8751-a21ac8cdc7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:14.772101 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cd2db-157b-44d0-8751-a21ac8cdc7a5 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:14.772389 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cd2db-157b-44d0-8751-a21ac8cdc7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:14.772685 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cd2db-157b-44d0-8751-a21ac8cdc7a5 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:14.777525 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cd2db-157b-44d0-8751-a21ac8cdc7a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:14.777849 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cd2db-157b-44d0-8751-a21ac8cdc7a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:14.779260 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cd2db-157b-44d0-8751-a21ac8cdc7a5 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:14.801629 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 52/102] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:14.804742 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cd2db-157b-44d0-8751-a21ac8cdc7a5 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:14.875307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 51/103] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 12:59:14.922168 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f0455-bac8-46e4-b758-a59232f0ab13 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:14.981300 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cd2db-157b-44d0-8751-a21ac8cdc7a5 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:15.046005 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9596a7-5732-46e8-9d40-14bfecb16a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:15.046914 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9596a7-5732-46e8-9d40-14bfecb16a19 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:15.047192 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9596a7-5732-46e8-9d40-14bfecb16a19 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:15.047476 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9596a7-5732-46e8-9d40-14bfecb16a19 None admin] PATH_INFO: `/v3/users/6bf77d11104f4d9c96052ec1a6de9831` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:15.073851 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f0455-bac8-46e4-b758-a59232f0ab13 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:15.076950 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9596a7-5732-46e8-9d40-14bfecb16a19 None admin] RBAC: Authorizing `identity:get_user(user_id=6bf77d11104f4d9c96052ec1a6de9831)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:15.078752 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9596a7-5732-46e8-9d40-14bfecb16a19 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:15.080647 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 53/104] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:14 2022] GET /identity/v3/users/6bf77d11104f4d9c96052ec1a6de9831 => generated 289 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:15.081747 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3a37e-16a7-4509-a815-9d7c955ee9c6 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:15.082033 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3a37e-16a7-4509-a815-9d7c955ee9c6 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:15.082315 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3a37e-16a7-4509-a815-9d7c955ee9c6 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:15.084058 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 54/105] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:15.096301 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3a37e-16a7-4509-a815-9d7c955ee9c6 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:15.154332 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccde282-ee75-4d89-a718-a912d5e1197e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:15.155655 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccde282-ee75-4d89-a718-a912d5e1197e None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:15.155961 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccde282-ee75-4d89-a718-a912d5e1197e None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:15.157854 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccde282-ee75-4d89-a718-a912d5e1197e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:15.170514 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccde282-ee75-4d89-a718-a912d5e1197e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:15.178314 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-eccde282-ee75-4d89-a718-a912d5e1197e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 12:59:15.179688 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 52/106] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 12:59:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 12:59:15.184230 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd345fc9-14f4-48f5-b1f5-315bb65f3d9e None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:15.184230 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd345fc9-14f4-48f5-b1f5-315bb65f3d9e None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:15.184230 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd345fc9-14f4-48f5-b1f5-315bb65f3d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:15.203800 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-fd345fc9-14f4-48f5-b1f5-315bb65f3d9e None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:15.206134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-fd345fc9-14f4-48f5-b1f5-315bb65f3d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:15.234594 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3a37e-16a7-4509-a815-9d7c955ee9c6 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:15.274661 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a482e29-0b03-4eaa-86ab-b6a879e1c6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:15.275309 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a482e29-0b03-4eaa-86ab-b6a879e1c6e5 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:15.275592 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a482e29-0b03-4eaa-86ab-b6a879e1c6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:15.275864 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a482e29-0b03-4eaa-86ab-b6a879e1c6e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:15.281858 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 53/107] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:15.283249 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0f292-66d6-425e-9b14-cb480cf17e0e None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:15.283538 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0f292-66d6-425e-9b14-cb480cf17e0e None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:15.283813 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0f292-66d6-425e-9b14-cb480cf17e0e None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:15.285631 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 54/108] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:15.290119 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0f292-66d6-425e-9b14-cb480cf17e0e None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:15.354952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a482e29-0b03-4eaa-86ab-b6a879e1c6e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:15.356493 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a482e29-0b03-4eaa-86ab-b6a879e1c6e5 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:15.408429 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0f292-66d6-425e-9b14-cb480cf17e0e None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:15.445669 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ab118-bdda-41b6-a845-c8c497b7a79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:15.446269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ab118-bdda-41b6-a845-c8c497b7a79a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:15.446553 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ab118-bdda-41b6-a845-c8c497b7a79a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:15.446832 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ab118-bdda-41b6-a845-c8c497b7a79a None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:15.447581 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ab118-bdda-41b6-a845-c8c497b7a79a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:15.447911 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ab118-bdda-41b6-a845-c8c497b7a79a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:15.449305 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ab118-bdda-41b6-a845-c8c497b7a79a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:15.462026 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 55/109] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:15.462026 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521c7ce-50a2-4562-83dc-23054037f067 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:15.462026 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521c7ce-50a2-4562-83dc-23054037f067 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:15.462026 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521c7ce-50a2-4562-83dc-23054037f067 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:15.462371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 55/110] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:15.462371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a7846-6e8d-42bf-91e7-c90730f15daa None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:15.462371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a7846-6e8d-42bf-91e7-c90730f15daa None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:15.462371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a7846-6e8d-42bf-91e7-c90730f15daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:15.465855 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 56/111] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:15.466445 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521c7ce-50a2-4562-83dc-23054037f067 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:15.478597 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-d36a7846-6e8d-42bf-91e7-c90730f15daa None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:15.479796 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-d36a7846-6e8d-42bf-91e7-c90730f15daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:15.548983 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 56/112] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:15.550210 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a7846-6e8d-42bf-91e7-c90730f15daa None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:15.590630 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521c7ce-50a2-4562-83dc-23054037f067 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:15.628161 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac58de5-0f65-4044-ab9a-b4b369c3dd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:15.628988 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac58de5-0f65-4044-ab9a-b4b369c3dd3a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:15.629281 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac58de5-0f65-4044-ab9a-b4b369c3dd3a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:15.629557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac58de5-0f65-4044-ab9a-b4b369c3dd3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:15.630726 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac58de5-0f65-4044-ab9a-b4b369c3dd3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:15.632171 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac58de5-0f65-4044-ab9a-b4b369c3dd3a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:15.638214 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 57/113] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 12:59:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:15.639029 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac58de5-0f65-4044-ab9a-b4b369c3dd3a None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:15.656154 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a7846-6e8d-42bf-91e7-c90730f15daa None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:15.690380 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9cdc1-1d45-4c9b-8f23-6d06584e3198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:15.691256 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9cdc1-1d45-4c9b-8f23-6d06584e3198 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:15.691539 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9cdc1-1d45-4c9b-8f23-6d06584e3198 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:15.691837 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9cdc1-1d45-4c9b-8f23-6d06584e3198 None admin] PATH_INFO: `/v3/users/ea423af17abb444a87ac0e8ed4f3af6b` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:15.693065 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9cdc1-1d45-4c9b-8f23-6d06584e3198 None admin] RBAC: Authorizing `identity:get_user(user_id=ea423af17abb444a87ac0e8ed4f3af6b)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:15.700843 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9cdc1-1d45-4c9b-8f23-6d06584e3198 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:15.700843 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 57/114] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:15 2022] GET /identity/v3/users/ea423af17abb444a87ac0e8ed4f3af6b => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:15.700843 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35400e-920d-4bc0-8fb8-1688bab97c19 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:15.700843 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35400e-920d-4bc0-8fb8-1688bab97c19 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:15.700843 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35400e-920d-4bc0-8fb8-1688bab97c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:15.714252 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-ec35400e-920d-4bc0-8fb8-1688bab97c19 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:15.715436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-ec35400e-920d-4bc0-8fb8-1688bab97c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:15.741919 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac58de5-0f65-4044-ab9a-b4b369c3dd3a None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:15.773652 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14d193-d08a-47fa-9d23-7ccbea2ca160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:15.774540 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14d193-d08a-47fa-9d23-7ccbea2ca160 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:15.774826 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14d193-d08a-47fa-9d23-7ccbea2ca160 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:15.775122 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14d193-d08a-47fa-9d23-7ccbea2ca160 None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:15.776402 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14d193-d08a-47fa-9d23-7ccbea2ca160 None admin] RBAC: Authorizing `identity:get_project(project_id=5e8582daaa764afcaf9c73a4aab00169)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:15.777889 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14d193-d08a-47fa-9d23-7ccbea2ca160 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:15.785204 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 58/115] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:15.785330 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 58/116] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:15 2022] GET /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:15.785330 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14d193-d08a-47fa-9d23-7ccbea2ca160 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:15.785498 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35400e-920d-4bc0-8fb8-1688bab97c19 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:15.885610 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35400e-920d-4bc0-8fb8-1688bab97c19 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:15.893108 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14d193-d08a-47fa-9d23-7ccbea2ca160 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:15.926288 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d043956-c07f-49ac-a6e7-0b626fa58d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:15.926943 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d043956-c07f-49ac-a6e7-0b626fa58d54 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:15.927231 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d043956-c07f-49ac-a6e7-0b626fa58d54 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:15.927506 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d043956-c07f-49ac-a6e7-0b626fa58d54 None admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:15.928210 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d043956-c07f-49ac-a6e7-0b626fa58d54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:15.929478 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b3f8d-5aac-4863-8317-18982f459f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:15.929674 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d043956-c07f-49ac-a6e7-0b626fa58d54 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:15.930438 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b3f8d-5aac-4863-8317-18982f459f18 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:15.930808 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b3f8d-5aac-4863-8317-18982f459f18 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:15.931188 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b3f8d-5aac-4863-8317-18982f459f18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:15.941876 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b3f8d-5aac-4863-8317-18982f459f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:15.948776 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-318b3f8d-5aac-4863-8317-18982f459f18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 12:59:15.949967 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 59/117] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:15.950817 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b3f8d-5aac-4863-8317-18982f459f18 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:16.043141 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b3f8d-5aac-4863-8317-18982f459f18 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:16.071478 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 59/118] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 12:59:15 2022] POST /identity/v3/projects => generated 302 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:59:16.072794 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99155476-8dfb-4c2f-b00a-1ebef8b74222 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:16.073081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99155476-8dfb-4c2f-b00a-1ebef8b74222 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:16.073358 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99155476-8dfb-4c2f-b00a-1ebef8b74222 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:16.075044 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 60/119] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:16.075844 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99155476-8dfb-4c2f-b00a-1ebef8b74222 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:16.084373 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68245c8b-2568-4b40-88ac-4baac7ab2338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:16.085420 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68245c8b-2568-4b40-88ac-4baac7ab2338 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:16.085698 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68245c8b-2568-4b40-88ac-4baac7ab2338 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:16.085975 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68245c8b-2568-4b40-88ac-4baac7ab2338 None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:16.087399 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68245c8b-2568-4b40-88ac-4baac7ab2338 None admin] RBAC: Authorizing `identity:get_project(project_id=5e8582daaa764afcaf9c73a4aab00169)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:16.089010 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68245c8b-2568-4b40-88ac-4baac7ab2338 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:16.090859 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 60/120] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:15 2022] GET /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:16.091679 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68245c8b-2568-4b40-88ac-4baac7ab2338 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:16.189579 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99155476-8dfb-4c2f-b00a-1ebef8b74222 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:16.202867 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68245c8b-2568-4b40-88ac-4baac7ab2338 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:16.226245 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ba294-9242-4aed-ad5c-7a90f0ea158d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:16.226912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ba294-9242-4aed-ad5c-7a90f0ea158d None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:16.227193 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ba294-9242-4aed-ad5c-7a90f0ea158d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:16.227467 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ba294-9242-4aed-ad5c-7a90f0ea158d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:16.228312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ba294-9242-4aed-ad5c-7a90f0ea158d None admin] RBAC: Adding query filter params (role.id=02b083eae38b4e7ba220f1d1a33e43a4, scope.project.id=5e8582daaa764afcaf9c73a4aab00169, user.id=6bf77d11104f4d9c96052ec1a6de9831) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:16.228701 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ba294-9242-4aed-ad5c-7a90f0ea158d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:16.230142 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ba294-9242-4aed-ad5c-7a90f0ea158d None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:16.236642 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 61/121] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 12:59:16 2022] GET /identity/v3/role_assignments?user.id=6bf77d11104f4d9c96052ec1a6de9831&scope.project.id=5e8582daaa764afcaf9c73a4aab00169&role.id=02b083eae38b4e7ba220f1d1a33e43a4 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:16.237307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ba294-9242-4aed-ad5c-7a90f0ea158d None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:16.253522 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab6e92-0827-45c9-8a6f-19b1a3632a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:16.254364 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab6e92-0827-45c9-8a6f-19b1a3632a53 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:16.254653 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab6e92-0827-45c9-8a6f-19b1a3632a53 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:16.254943 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab6e92-0827-45c9-8a6f-19b1a3632a53 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:16.267346 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab6e92-0827-45c9-8a6f-19b1a3632a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:16.275714 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-fbab6e92-0827-45c9-8a6f-19b1a3632a53 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 12:59:16.277422 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 61/122] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 12:59:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:16.278688 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc20717-fd01-47ba-b595-5d4393bc9c58 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:16.278985 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc20717-fd01-47ba-b595-5d4393bc9c58 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:16.279265 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc20717-fd01-47ba-b595-5d4393bc9c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:16.298675 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-8bc20717-fd01-47ba-b595-5d4393bc9c58 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:16.299373 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-8bc20717-fd01-47ba-b595-5d4393bc9c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:16.375412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ba294-9242-4aed-ad5c-7a90f0ea158d None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:16.396684 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 62/123] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:16.396684 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc20717-fd01-47ba-b595-5d4393bc9c58 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:16.434820 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276e900-54ba-472c-88f2-aef36da7e808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:16.435863 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276e900-54ba-472c-88f2-aef36da7e808 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:16.437079 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276e900-54ba-472c-88f2-aef36da7e808 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:16.437565 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276e900-54ba-472c-88f2-aef36da7e808 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:16.438588 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276e900-54ba-472c-88f2-aef36da7e808 None admin] RBAC: Adding query filter params (name=member) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:16.439147 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276e900-54ba-472c-88f2-aef36da7e808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:16.440784 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276e900-54ba-472c-88f2-aef36da7e808 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:16.450698 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 62/124] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:16.451356 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276e900-54ba-472c-88f2-aef36da7e808 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:16.504766 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc20717-fd01-47ba-b595-5d4393bc9c58 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:16.540507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a666a-9d2b-4196-8018-72ce5005f954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:16.541430 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a666a-9d2b-4196-8018-72ce5005f954 None admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:16.541788 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a666a-9d2b-4196-8018-72ce5005f954 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:16.542293 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a666a-9d2b-4196-8018-72ce5005f954 None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169/users/ea423af17abb444a87ac0e8ed4f3af6b/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:16.544272 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a666a-9d2b-4196-8018-72ce5005f954 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e8582daaa764afcaf9c73a4aab00169, user_id=ea423af17abb444a87ac0e8ed4f3af6b, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:16.545824 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a666a-9d2b-4196-8018-72ce5005f954 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:16.560905 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276e900-54ba-472c-88f2-aef36da7e808 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:16.594617 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d8b2b-7454-41b2-b58d-ee38f04934e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:16.595515 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d8b2b-7454-41b2-b58d-ee38f04934e2 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:16.601838 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d8b2b-7454-41b2-b58d-ee38f04934e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:16.601838 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d8b2b-7454-41b2-b58d-ee38f04934e2 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:16.601838 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d8b2b-7454-41b2-b58d-ee38f04934e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:16.601838 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d8b2b-7454-41b2-b58d-ee38f04934e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:16.601838 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d8b2b-7454-41b2-b58d-ee38f04934e2 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:16.606398 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 63/125] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 12:59:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:16.607277 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d8b2b-7454-41b2-b58d-ee38f04934e2 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:16.682299 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 63/126] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 12:59:16 2022] PUT /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169/users/ea423af17abb444a87ac0e8ed4f3af6b/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:59:16.683230 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a666a-9d2b-4196-8018-72ce5005f954 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:16.714235 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d8b2b-7454-41b2-b58d-ee38f04934e2 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:16.760539 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041bc591-b037-4f5f-9da6-87295ae99680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:16.762065 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bc591-b037-4f5f-9da6-87295ae99680 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:16.762353 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bc591-b037-4f5f-9da6-87295ae99680 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:16.762628 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bc591-b037-4f5f-9da6-87295ae99680 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:16.774165 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041bc591-b037-4f5f-9da6-87295ae99680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:16.781646 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-041bc591-b037-4f5f-9da6-87295ae99680 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 12:59:16.783204 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 64/127] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:16.784003 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041bc591-b037-4f5f-9da6-87295ae99680 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:16.792692 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a666a-9d2b-4196-8018-72ce5005f954 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:16.829355 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8316d4-360e-42e7-b39a-b03060193d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:16.830169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8316d4-360e-42e7-b39a-b03060193d91 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:16.830455 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8316d4-360e-42e7-b39a-b03060193d91 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:16.830733 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8316d4-360e-42e7-b39a-b03060193d91 None admin] PATH_INFO: `/v3/users/be52c2e382db45d0af34429705c6405e` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:16.832056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8316d4-360e-42e7-b39a-b03060193d91 None admin] RBAC: Authorizing `identity:get_user(user_id=be52c2e382db45d0af34429705c6405e)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:16.833602 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8316d4-360e-42e7-b39a-b03060193d91 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:16.835349 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 64/128] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:16 2022] GET /identity/v3/users/be52c2e382db45d0af34429705c6405e => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:16.836232 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8316d4-360e-42e7-b39a-b03060193d91 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:16.891108 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041bc591-b037-4f5f-9da6-87295ae99680 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:16.925973 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54fb90-e605-4565-8bb1-b0187bfbba02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:16.926871 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54fb90-e605-4565-8bb1-b0187bfbba02 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:16.927156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54fb90-e605-4565-8bb1-b0187bfbba02 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:16.927431 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54fb90-e605-4565-8bb1-b0187bfbba02 None admin] PATH_INFO: `/v3/users/be52c2e382db45d0af34429705c6405e` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:16.928737 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54fb90-e605-4565-8bb1-b0187bfbba02 None admin] RBAC: Authorizing `identity:get_user(user_id=be52c2e382db45d0af34429705c6405e)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:16.930330 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54fb90-e605-4565-8bb1-b0187bfbba02 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:16.933856 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 65/129] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:16 2022] GET /identity/v3/users/be52c2e382db45d0af34429705c6405e => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:16.933856 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54fb90-e605-4565-8bb1-b0187bfbba02 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:16.941828 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8316d4-360e-42e7-b39a-b03060193d91 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:16.978326 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2dbb4-8e80-4515-8ebf-6b07a9a5c82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:16.978997 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2dbb4-8e80-4515-8ebf-6b07a9a5c82d None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:16.979283 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2dbb4-8e80-4515-8ebf-6b07a9a5c82d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:16.979562 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2dbb4-8e80-4515-8ebf-6b07a9a5c82d None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:16.980322 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2dbb4-8e80-4515-8ebf-6b07a9a5c82d None admin] RBAC: Adding query filter params (name=member) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:16.980632 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2dbb4-8e80-4515-8ebf-6b07a9a5c82d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:16.982085 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2dbb4-8e80-4515-8ebf-6b07a9a5c82d None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:16.995992 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 65/130] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:16.997032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2dbb4-8e80-4515-8ebf-6b07a9a5c82d None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:17.053591 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54fb90-e605-4565-8bb1-b0187bfbba02 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:17.096440 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0beae9-b5fd-4605-a84b-d6a64edc6d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:17.097264 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0beae9-b5fd-4605-a84b-d6a64edc6d61 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:17.097542 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0beae9-b5fd-4605-a84b-d6a64edc6d61 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:17.097822 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0beae9-b5fd-4605-a84b-d6a64edc6d61 None admin] PATH_INFO: `/v3/projects/c3028825f71d4cf8bdcd974c7dda14fa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:17.099156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0beae9-b5fd-4605-a84b-d6a64edc6d61 None admin] RBAC: Authorizing `identity:get_project(project_id=c3028825f71d4cf8bdcd974c7dda14fa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:17.100477 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0beae9-b5fd-4605-a84b-d6a64edc6d61 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:17.102589 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 66/131] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:16 2022] GET /identity/v3/projects/c3028825f71d4cf8bdcd974c7dda14fa => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:17.103384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0beae9-b5fd-4605-a84b-d6a64edc6d61 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:17.121011 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2dbb4-8e80-4515-8ebf-6b07a9a5c82d None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:17.154857 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd032a09-fe39-4f98-b5a2-bd04d792bf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:17.156252 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd032a09-fe39-4f98-b5a2-bd04d792bf4b None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:17.156651 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd032a09-fe39-4f98-b5a2-bd04d792bf4b None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:17.156956 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd032a09-fe39-4f98-b5a2-bd04d792bf4b None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:17.158504 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd032a09-fe39-4f98-b5a2-bd04d792bf4b None admin] RBAC: Authorizing `identity:get_project(project_id=5e8582daaa764afcaf9c73a4aab00169)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:17.159983 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd032a09-fe39-4f98-b5a2-bd04d792bf4b None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:17.162396 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 66/132] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:16 2022] GET /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:17.163230 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd032a09-fe39-4f98-b5a2-bd04d792bf4b None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:17.212556 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0beae9-b5fd-4605-a84b-d6a64edc6d61 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:17.248205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48538866-b376-4b9f-8ec1-d8927ebca274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:17.249739 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48538866-b376-4b9f-8ec1-d8927ebca274 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:17.250024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48538866-b376-4b9f-8ec1-d8927ebca274 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:17.250296 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48538866-b376-4b9f-8ec1-d8927ebca274 None admin] PATH_INFO: `/v3/users/be52c2e382db45d0af34429705c6405e` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:17.251558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48538866-b376-4b9f-8ec1-d8927ebca274 None admin] RBAC: Authorizing `identity:get_user(user_id=be52c2e382db45d0af34429705c6405e)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:17.253090 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48538866-b376-4b9f-8ec1-d8927ebca274 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:17.254721 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 67/133] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:17 2022] GET /identity/v3/users/be52c2e382db45d0af34429705c6405e => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:17.255520 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48538866-b376-4b9f-8ec1-d8927ebca274 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:17.269743 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd032a09-fe39-4f98-b5a2-bd04d792bf4b None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:17.305458 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf2d3d-7bcc-481a-8da0-ebc49fead341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:17.306350 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf2d3d-7bcc-481a-8da0-ebc49fead341 None admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:17.306636 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf2d3d-7bcc-481a-8da0-ebc49fead341 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:17.306917 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf2d3d-7bcc-481a-8da0-ebc49fead341 None admin] PATH_INFO: `/v3/projects/c3028825f71d4cf8bdcd974c7dda14fa/users/be52c2e382db45d0af34429705c6405e/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:17.308916 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf2d3d-7bcc-481a-8da0-ebc49fead341 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3028825f71d4cf8bdcd974c7dda14fa, user_id=be52c2e382db45d0af34429705c6405e, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:17.310378 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf2d3d-7bcc-481a-8da0-ebc49fead341 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:17.364997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48538866-b376-4b9f-8ec1-d8927ebca274 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:17.399574 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fa72f-e2d6-44fa-9b70-72524989498c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:17.400526 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fa72f-e2d6-44fa-9b70-72524989498c None admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:17.400908 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fa72f-e2d6-44fa-9b70-72524989498c None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:17.401190 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fa72f-e2d6-44fa-9b70-72524989498c None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169/users/be52c2e382db45d0af34429705c6405e/roles/a08ab7d3851a43ac8ed5339681d7de91` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:17.403482 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fa72f-e2d6-44fa-9b70-72524989498c None admin] RBAC: Authorizing `identity:create_grant(project_id=5e8582daaa764afcaf9c73a4aab00169, user_id=be52c2e382db45d0af34429705c6405e, role_id=a08ab7d3851a43ac8ed5339681d7de91)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:17.404985 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fa72f-e2d6-44fa-9b70-72524989498c None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:17.446676 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 67/134] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 12:59:17 2022] PUT /identity/v3/projects/c3028825f71d4cf8bdcd974c7dda14fa/users/be52c2e382db45d0af34429705c6405e/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:59:17.447573 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf2d3d-7bcc-481a-8da0-ebc49fead341 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:17.537004 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 68/135] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 12:59:17 2022] PUT /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169/users/be52c2e382db45d0af34429705c6405e/roles/a08ab7d3851a43ac8ed5339681d7de91 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:59:17.604193 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf2d3d-7bcc-481a-8da0-ebc49fead341 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:17.642747 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7268e-4e22-49d8-8214-064d7b98cc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:17.643635 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7268e-4e22-49d8-8214-064d7b98cc67 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:17.643926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7268e-4e22-49d8-8214-064d7b98cc67 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:17.644276 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7268e-4e22-49d8-8214-064d7b98cc67 None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:17.645678 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7268e-4e22-49d8-8214-064d7b98cc67 None admin] RBAC: Authorizing `identity:get_project(project_id=5e8582daaa764afcaf9c73a4aab00169)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:17.647242 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7268e-4e22-49d8-8214-064d7b98cc67 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:17.649103 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 68/136] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:17 2022] GET /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:17.654980 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fa72f-e2d6-44fa-9b70-72524989498c None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:17.800133 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fa72f-e2d6-44fa-9b70-72524989498c None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:17.839189 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613fea2-630f-40c6-adef-a8aeefc20165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:17.840098 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613fea2-630f-40c6-adef-a8aeefc20165 None admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:17.840384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613fea2-630f-40c6-adef-a8aeefc20165 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:17.840688 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613fea2-630f-40c6-adef-a8aeefc20165 None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169/users/be52c2e382db45d0af34429705c6405e/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:17.842742 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613fea2-630f-40c6-adef-a8aeefc20165 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e8582daaa764afcaf9c73a4aab00169, user_id=be52c2e382db45d0af34429705c6405e, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:17.844537 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613fea2-630f-40c6-adef-a8aeefc20165 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:17.928817 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 69/137] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 12:59:17 2022] PUT /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169/users/be52c2e382db45d0af34429705c6405e/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:59:19.227270 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0725dd-0a80-494f-99b2-152b5ae04503 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:19.227811 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0725dd-0a80-494f-99b2-152b5ae04503 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:19.227811 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0725dd-0a80-494f-99b2-152b5ae04503 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:19.229927 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 69/138] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:19.236112 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb7d17-05ab-46a6-b25a-90722afe88f0 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:19.236549 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb7d17-05ab-46a6-b25a-90722afe88f0 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:19.236757 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb7d17-05ab-46a6-b25a-90722afe88f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:19.256940 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-08fb7d17-05ab-46a6-b25a-90722afe88f0 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:19.258059 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-08fb7d17-05ab-46a6-b25a-90722afe88f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:19.358892 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 70/139] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:19.397866 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0725dd-0a80-494f-99b2-152b5ae04503 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:19.533500 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0725dd-0a80-494f-99b2-152b5ae04503 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:19.580361 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fb2ff-1719-4e41-97c6-44f9f085d1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:19.581206 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fb2ff-1719-4e41-97c6-44f9f085d1fa None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:19.581497 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fb2ff-1719-4e41-97c6-44f9f085d1fa None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:19.581779 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fb2ff-1719-4e41-97c6-44f9f085d1fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:19.584166 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9fb2ff-1719-4e41-97c6-44f9f085d1fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:19.585452 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c23c79-849e-4d5b-9f7e-41ddfd29526d None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:19.585697 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9fb2ff-1719-4e41-97c6-44f9f085d1fa None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:19.585811 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c23c79-849e-4d5b-9f7e-41ddfd29526d None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:19.586017 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c23c79-849e-4d5b-9f7e-41ddfd29526d None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:19.587377 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 70/140] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 12:59:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:19.588339 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 71/141] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:19.594141 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fb2ff-1719-4e41-97c6-44f9f085d1fa None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:19.595127 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130c5ca-86e6-4bd7-aa33-d5eb2cb3b305 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:19.595427 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130c5ca-86e6-4bd7-aa33-d5eb2cb3b305 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:19.595714 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130c5ca-86e6-4bd7-aa33-d5eb2cb3b305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:19.613928 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-4130c5ca-86e6-4bd7-aa33-d5eb2cb3b305 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:19.615142 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-4130c5ca-86e6-4bd7-aa33-d5eb2cb3b305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:19.714492 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fb2ff-1719-4e41-97c6-44f9f085d1fa None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:19.755354 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bc883-58ef-4c7e-b230-bcbf6fd88f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:19.756040 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bc883-58ef-4c7e-b230-bcbf6fd88f4d None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:19.756330 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bc883-58ef-4c7e-b230-bcbf6fd88f4d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:19.756612 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bc883-58ef-4c7e-b230-bcbf6fd88f4d None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:19.757386 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bc883-58ef-4c7e-b230-bcbf6fd88f4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:19.758852 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bc883-58ef-4c7e-b230-bcbf6fd88f4d None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:19.778229 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 72/142] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 12:59:19.809801 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130c5ca-86e6-4bd7-aa33-d5eb2cb3b305 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:19.902905 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 71/143] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 12:59:19 2022] POST /identity/v3/users => generated 283 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:59:19.943627 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130c5ca-86e6-4bd7-aa33-d5eb2cb3b305 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:19.980976 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88148f07-641a-4d88-b57c-4b64beb88b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:19.981806 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88148f07-641a-4d88-b57c-4b64beb88b88 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:19.982087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88148f07-641a-4d88-b57c-4b64beb88b88 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:19.982362 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88148f07-641a-4d88-b57c-4b64beb88b88 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:19.993928 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88148f07-641a-4d88-b57c-4b64beb88b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:20.002008 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-88148f07-641a-4d88-b57c-4b64beb88b88 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 12:59:20.003542 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 73/144] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:20.009421 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bc883-58ef-4c7e-b230-bcbf6fd88f4d None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:20.115496 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bc883-58ef-4c7e-b230-bcbf6fd88f4d None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:20.150073 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7a76a-ed32-409d-8d5e-d5e6c1c49055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:20.150761 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7a76a-ed32-409d-8d5e-d5e6c1c49055 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:20.151043 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7a76a-ed32-409d-8d5e-d5e6c1c49055 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:20.151326 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7a76a-ed32-409d-8d5e-d5e6c1c49055 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:20.152209 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7a76a-ed32-409d-8d5e-d5e6c1c49055 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:20.152520 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7a76a-ed32-409d-8d5e-d5e6c1c49055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:20.154132 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7a76a-ed32-409d-8d5e-d5e6c1c49055 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:20.164410 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 72/145] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:20.170116 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88148f07-641a-4d88-b57c-4b64beb88b88 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:20.278008 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88148f07-641a-4d88-b57c-4b64beb88b88 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:20.320231 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ec9ab-19a9-4361-bb12-44a65a08f13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:20.321549 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ec9ab-19a9-4361-bb12-44a65a08f13d None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:20.322036 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ec9ab-19a9-4361-bb12-44a65a08f13d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:20.322541 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ec9ab-19a9-4361-bb12-44a65a08f13d None admin] PATH_INFO: `/v3/users/6bf77d11104f4d9c96052ec1a6de9831` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:20.325580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ec9ab-19a9-4361-bb12-44a65a08f13d None admin] RBAC: Authorizing `identity:get_user(user_id=6bf77d11104f4d9c96052ec1a6de9831)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:20.327645 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ec9ab-19a9-4361-bb12-44a65a08f13d None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:20.329436 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 74/146] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:20 2022] GET /identity/v3/users/6bf77d11104f4d9c96052ec1a6de9831 => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:20.335001 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7a76a-ed32-409d-8d5e-d5e6c1c49055 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:20.452973 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7a76a-ed32-409d-8d5e-d5e6c1c49055 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:20.464943 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b7a68-f5ed-4aea-a458-9b28c0d4d79b None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:20.465553 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b7a68-f5ed-4aea-a458-9b28c0d4d79b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:20.466024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b7a68-f5ed-4aea-a458-9b28c0d4d79b None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:20.468537 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 75/147] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 12:59:20.473913 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e5bad-5f3b-4308-a9f2-9b1326c7b6c2 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:20.474437 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e5bad-5f3b-4308-a9f2-9b1326c7b6c2 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:20.474912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e5bad-5f3b-4308-a9f2-9b1326c7b6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:20.494011 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab12b7-f1dc-41ad-8918-f132251c6c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:20.494889 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab12b7-f1dc-41ad-8918-f132251c6c07 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:20.495177 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab12b7-f1dc-41ad-8918-f132251c6c07 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:20.495461 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab12b7-f1dc-41ad-8918-f132251c6c07 None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:20.497605 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab12b7-f1dc-41ad-8918-f132251c6c07 None admin] RBAC: Authorizing `identity:get_project(project_id=5e8582daaa764afcaf9c73a4aab00169)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:20.499205 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab12b7-f1dc-41ad-8918-f132251c6c07 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:20.501238 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 73/148] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:20 2022] GET /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:20.509287 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab12b7-f1dc-41ad-8918-f132251c6c07 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:20.513680 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-9a0e5bad-5f3b-4308-a9f2-9b1326c7b6c2 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:20.515848 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9a0e5bad-5f3b-4308-a9f2-9b1326c7b6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:20.628266 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab12b7-f1dc-41ad-8918-f132251c6c07 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:20.669328 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54659771-160f-4354-9822-375fd30cdc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:20.670518 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54659771-160f-4354-9822-375fd30cdc9d None admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:20.670953 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54659771-160f-4354-9822-375fd30cdc9d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:20.671374 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54659771-160f-4354-9822-375fd30cdc9d None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169/users/6bf77d11104f4d9c96052ec1a6de9831/roles/02b083eae38b4e7ba220f1d1a33e43a4` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:20.674011 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54659771-160f-4354-9822-375fd30cdc9d None admin] RBAC: Authorizing `identity:create_grant(project_id=5e8582daaa764afcaf9c73a4aab00169, user_id=6bf77d11104f4d9c96052ec1a6de9831, role_id=02b083eae38b4e7ba220f1d1a33e43a4)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:20.675809 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54659771-160f-4354-9822-375fd30cdc9d None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:20.682980 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 76/149] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:20.708352 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e5bad-5f3b-4308-a9f2-9b1326c7b6c2 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:20.764767 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 74/150] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 12:59:20 2022] PUT /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169/users/6bf77d11104f4d9c96052ec1a6de9831/roles/02b083eae38b4e7ba220f1d1a33e43a4 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:59:20.808104 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05339c8-5646-4295-8062-374bdc4f19c8 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:20.808696 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05339c8-5646-4295-8062-374bdc4f19c8 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:20.809128 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05339c8-5646-4295-8062-374bdc4f19c8 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:20.811870 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 75/151] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 12:59:20.819148 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703160a-9cc3-4f03-b14f-b739823e4741 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:20.819662 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703160a-9cc3-4f03-b14f-b739823e4741 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:20.820181 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703160a-9cc3-4f03-b14f-b739823e4741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:20.849421 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-9703160a-9cc3-4f03-b14f-b739823e4741 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:20.852243 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-9703160a-9cc3-4f03-b14f-b739823e4741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:20.872128 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e5bad-5f3b-4308-a9f2-9b1326c7b6c2 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:20.914612 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c78f9-3e1a-4822-bc45-08bf8645e5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:20.915784 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c78f9-3e1a-4822-bc45-08bf8645e5c5 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:20.916212 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c78f9-3e1a-4822-bc45-08bf8645e5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:20.916627 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c78f9-3e1a-4822-bc45-08bf8645e5c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:20.929406 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c78f9-3e1a-4822-bc45-08bf8645e5c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:20.938181 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-647c78f9-3e1a-4822-bc45-08bf8645e5c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 12:59:20.940335 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 77/152] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 12:59:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 12:59:20.947483 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c78f9-3e1a-4822-bc45-08bf8645e5c5 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:20.995511 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 76/153] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 12:59:21.034231 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703160a-9cc3-4f03-b14f-b739823e4741 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:21.065550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c78f9-3e1a-4822-bc45-08bf8645e5c5 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:21.120117 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406609ba-fbd5-4cd1-8817-013e3ac27237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:21.121222 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406609ba-fbd5-4cd1-8817-013e3ac27237 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:21.121681 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406609ba-fbd5-4cd1-8817-013e3ac27237 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:21.122144 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406609ba-fbd5-4cd1-8817-013e3ac27237 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:21.123117 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406609ba-fbd5-4cd1-8817-013e3ac27237 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:21.124471 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406609ba-fbd5-4cd1-8817-013e3ac27237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:21.126206 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406609ba-fbd5-4cd1-8817-013e3ac27237 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:21.141359 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 78/154] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:21.147217 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406609ba-fbd5-4cd1-8817-013e3ac27237 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:21.215721 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703160a-9cc3-4f03-b14f-b739823e4741 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:21.256132 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fc425-754f-4208-a76c-50271aa66611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:21.256898 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fc425-754f-4208-a76c-50271aa66611 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:21.257177 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fc425-754f-4208-a76c-50271aa66611 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:21.257451 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fc425-754f-4208-a76c-50271aa66611 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:21.268581 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260fc425-754f-4208-a76c-50271aa66611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:21.269869 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406609ba-fbd5-4cd1-8817-013e3ac27237 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:21.280897 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-260fc425-754f-4208-a76c-50271aa66611 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 12:59:21.282463 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 77/155] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 12:59:21.283789 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420903e-56b0-4826-8fdf-f862c678badd None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:21.284072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420903e-56b0-4826-8fdf-f862c678badd None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:21.284358 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420903e-56b0-4826-8fdf-f862c678badd None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:21.290519 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 78/156] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:21.297101 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c1715-9cb0-4180-b25b-14fadabc0728 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:21.297398 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c1715-9cb0-4180-b25b-14fadabc0728 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:21.297674 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c1715-9cb0-4180-b25b-14fadabc0728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:21.322012 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546955e8-fc7e-4497-908d-f204063a6484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:21.322534 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-f53c1715-9cb0-4180-b25b-14fadabc0728 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:21.322914 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546955e8-fc7e-4497-908d-f204063a6484 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:21.323256 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546955e8-fc7e-4497-908d-f204063a6484 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:21.323485 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546955e8-fc7e-4497-908d-f204063a6484 None admin] PATH_INFO: `/v3/users/ea423af17abb444a87ac0e8ed4f3af6b` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:21.323655 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f53c1715-9cb0-4180-b25b-14fadabc0728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:21.329521 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546955e8-fc7e-4497-908d-f204063a6484 None admin] RBAC: Authorizing `identity:get_user(user_id=ea423af17abb444a87ac0e8ed4f3af6b)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:21.331007 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546955e8-fc7e-4497-908d-f204063a6484 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:21.332732 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 79/157] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:21 2022] GET /identity/v3/users/ea423af17abb444a87ac0e8ed4f3af6b => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:21.333525 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546955e8-fc7e-4497-908d-f204063a6484 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:21.409931 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 79/158] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:21.412638 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c1715-9cb0-4180-b25b-14fadabc0728 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:21.523794 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546955e8-fc7e-4497-908d-f204063a6484 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:21.543877 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c1715-9cb0-4180-b25b-14fadabc0728 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:21.582543 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71684f37-d47e-4024-b938-ae206a2317c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:21.584059 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71684f37-d47e-4024-b938-ae206a2317c0 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:21.585032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71684f37-d47e-4024-b938-ae206a2317c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:21.585466 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71684f37-d47e-4024-b938-ae206a2317c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:21.595183 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ed815-d114-4e2e-bcff-cc77e1f3304f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:21.597066 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ed815-d114-4e2e-bcff-cc77e1f3304f None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:21.599373 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ed815-d114-4e2e-bcff-cc77e1f3304f None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:21.599797 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ed815-d114-4e2e-bcff-cc77e1f3304f None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:21.600865 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ed815-d114-4e2e-bcff-cc77e1f3304f None admin] RBAC: Adding query filter params (name=member) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:21.603658 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ed815-d114-4e2e-bcff-cc77e1f3304f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:21.605309 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ed815-d114-4e2e-bcff-cc77e1f3304f None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:21.622917 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 80/159] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:21.626115 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ed815-d114-4e2e-bcff-cc77e1f3304f None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:21.728746 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71684f37-d47e-4024-b938-ae206a2317c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:21.730223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71684f37-d47e-4024-b938-ae206a2317c0 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:21.843107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ed815-d114-4e2e-bcff-cc77e1f3304f None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:21.892434 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08413196-f7fe-4015-8ba9-7d3d4aa56ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:21.893394 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08413196-f7fe-4015-8ba9-7d3d4aa56ff7 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:21.893623 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08413196-f7fe-4015-8ba9-7d3d4aa56ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:21.893835 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08413196-f7fe-4015-8ba9-7d3d4aa56ff7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:21.904166 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08413196-f7fe-4015-8ba9-7d3d4aa56ff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:21.919647 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-08413196-f7fe-4015-8ba9-7d3d4aa56ff7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 12:59:21.920997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 81/160] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 12:59:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:21.921890 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08413196-f7fe-4015-8ba9-7d3d4aa56ff7 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:21.944990 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 80/161] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:21.945686 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71684f37-d47e-4024-b938-ae206a2317c0 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:22.038128 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08413196-f7fe-4015-8ba9-7d3d4aa56ff7 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:22.078428 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f8df6-1997-4d23-94f3-fae0cab88b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:22.079305 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f8df6-1997-4d23-94f3-fae0cab88b15 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:22.079586 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f8df6-1997-4d23-94f3-fae0cab88b15 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:22.079861 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f8df6-1997-4d23-94f3-fae0cab88b15 None admin] PATH_INFO: `/v3/users/be52c2e382db45d0af34429705c6405e` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:22.083800 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f8df6-1997-4d23-94f3-fae0cab88b15 None admin] RBAC: Authorizing `identity:get_user(user_id=be52c2e382db45d0af34429705c6405e)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:22.087955 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f8df6-1997-4d23-94f3-fae0cab88b15 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:22.091027 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 82/162] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:21 2022] GET /identity/v3/users/be52c2e382db45d0af34429705c6405e => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:22.094309 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03100d-2f67-43ed-aee7-cee553aeb481 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:22.094441 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03100d-2f67-43ed-aee7-cee553aeb481 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:22.099676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03100d-2f67-43ed-aee7-cee553aeb481 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:22.099676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 83/163] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:22.099676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03100d-2f67-43ed-aee7-cee553aeb481 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:22.128908 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71684f37-d47e-4024-b938-ae206a2317c0 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:22.174947 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36670bb5-8bac-45be-a028-b95b62b97670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:22.175677 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36670bb5-8bac-45be-a028-b95b62b97670 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:22.175959 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36670bb5-8bac-45be-a028-b95b62b97670 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:22.176236 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36670bb5-8bac-45be-a028-b95b62b97670 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:22.178159 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36670bb5-8bac-45be-a028-b95b62b97670 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:22.178159 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36670bb5-8bac-45be-a028-b95b62b97670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:22.179504 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36670bb5-8bac-45be-a028-b95b62b97670 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:22.208083 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 81/164] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 12:59:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:22.208706 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36670bb5-8bac-45be-a028-b95b62b97670 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:22.313371 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03100d-2f67-43ed-aee7-cee553aeb481 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:22.369391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ade23-b32a-4c25-9e49-4799c4fa17db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:22.370282 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ade23-b32a-4c25-9e49-4799c4fa17db None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:22.370562 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ade23-b32a-4c25-9e49-4799c4fa17db None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:22.370830 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ade23-b32a-4c25-9e49-4799c4fa17db None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:22.372081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ade23-b32a-4c25-9e49-4799c4fa17db None admin] RBAC: Authorizing `identity:get_project(project_id=5e8582daaa764afcaf9c73a4aab00169)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:22.374222 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ade23-b32a-4c25-9e49-4799c4fa17db None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:22.376019 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 84/165] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:22 2022] GET /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:22.377203 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e378f-1b74-4b59-9e68-ca2d2e046180 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:22.377483 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e378f-1b74-4b59-9e68-ca2d2e046180 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:22.377755 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e378f-1b74-4b59-9e68-ca2d2e046180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:22.392478 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36670bb5-8bac-45be-a028-b95b62b97670 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:22.408286 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-a76e378f-1b74-4b59-9e68-ca2d2e046180 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:22.409498 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a76e378f-1b74-4b59-9e68-ca2d2e046180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:22.435298 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd360de-10e4-4594-88ae-009f283b45c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:22.436516 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd360de-10e4-4594-88ae-009f283b45c3 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:22.436824 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd360de-10e4-4594-88ae-009f283b45c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:22.440678 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd360de-10e4-4594-88ae-009f283b45c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:22.502052 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 85/166] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:22.502921 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e378f-1b74-4b59-9e68-ca2d2e046180 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:22.508785 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd360de-10e4-4594-88ae-009f283b45c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:22.510267 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd360de-10e4-4594-88ae-009f283b45c3 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:22.609342 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 82/167] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:22.610150 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd360de-10e4-4594-88ae-009f283b45c3 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:22.669568 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e378f-1b74-4b59-9e68-ca2d2e046180 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:22.715293 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd360de-10e4-4594-88ae-009f283b45c3 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:22.727622 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86620b3-bdeb-4803-80ac-97c6cd526f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:22.728506 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86620b3-bdeb-4803-80ac-97c6cd526f20 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:22.728806 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86620b3-bdeb-4803-80ac-97c6cd526f20 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:22.729081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86620b3-bdeb-4803-80ac-97c6cd526f20 None admin] PATH_INFO: `/v3/users/be52c2e382db45d0af34429705c6405e` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:22.733979 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86620b3-bdeb-4803-80ac-97c6cd526f20 None admin] RBAC: Authorizing `identity:get_user(user_id=be52c2e382db45d0af34429705c6405e)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:22.735447 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86620b3-bdeb-4803-80ac-97c6cd526f20 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:22.737138 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 86/168] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:22 2022] GET /identity/v3/users/be52c2e382db45d0af34429705c6405e => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:22.737906 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86620b3-bdeb-4803-80ac-97c6cd526f20 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:22.762458 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074515ff-7b3d-48c3-8a01-e97e1b13a9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:22.763144 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074515ff-7b3d-48c3-8a01-e97e1b13a9d2 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:22.763427 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074515ff-7b3d-48c3-8a01-e97e1b13a9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:22.763706 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074515ff-7b3d-48c3-8a01-e97e1b13a9d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:22.765485 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074515ff-7b3d-48c3-8a01-e97e1b13a9d2 None admin] RBAC: Adding query filter params (role.id=f9ec85924a914e078096b38cae4e6caa, scope.project.id=5e8582daaa764afcaf9c73a4aab00169, user.id=ea423af17abb444a87ac0e8ed4f3af6b) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:22.765807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074515ff-7b3d-48c3-8a01-e97e1b13a9d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:22.767352 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074515ff-7b3d-48c3-8a01-e97e1b13a9d2 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:22.779099 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 83/169] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 12:59:22 2022] GET /identity/v3/role_assignments?user.id=ea423af17abb444a87ac0e8ed4f3af6b&scope.project.id=5e8582daaa764afcaf9c73a4aab00169&role.id=f9ec85924a914e078096b38cae4e6caa => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:22.780742 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074515ff-7b3d-48c3-8a01-e97e1b13a9d2 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:22.862979 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86620b3-bdeb-4803-80ac-97c6cd526f20 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:22.936606 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d77dc-abed-4b0e-a531-8eed08bc54a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:22.937583 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d77dc-abed-4b0e-a531-8eed08bc54a4 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:22.937863 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d77dc-abed-4b0e-a531-8eed08bc54a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:22.938131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d77dc-abed-4b0e-a531-8eed08bc54a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:22.965347 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d77dc-abed-4b0e-a531-8eed08bc54a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:22.972522 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-883d77dc-abed-4b0e-a531-8eed08bc54a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 12:59:22.985526 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 87/170] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:22.986668 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d77dc-abed-4b0e-a531-8eed08bc54a4 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:22.988956 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074515ff-7b3d-48c3-8a01-e97e1b13a9d2 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:23.080607 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5205a1-c271-4754-86e5-8aee8d67b2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:23.081501 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5205a1-c271-4754-86e5-8aee8d67b2a3 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:23.081776 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5205a1-c271-4754-86e5-8aee8d67b2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:23.082046 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5205a1-c271-4754-86e5-8aee8d67b2a3 None admin] PATH_INFO: `/v3/projects/c3028825f71d4cf8bdcd974c7dda14fa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:23.083228 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5205a1-c271-4754-86e5-8aee8d67b2a3 None admin] RBAC: Authorizing `identity:get_project(project_id=c3028825f71d4cf8bdcd974c7dda14fa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:23.084707 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5205a1-c271-4754-86e5-8aee8d67b2a3 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:23.086393 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 84/171] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:22 2022] GET /identity/v3/projects/c3028825f71d4cf8bdcd974c7dda14fa => generated 312 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:23.087156 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5205a1-c271-4754-86e5-8aee8d67b2a3 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:23.196254 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d77dc-abed-4b0e-a531-8eed08bc54a4 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:23.281348 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551d3c0-bcd3-4b91-892e-399a5b7ff5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:23.282605 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551d3c0-bcd3-4b91-892e-399a5b7ff5f2 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:23.283103 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551d3c0-bcd3-4b91-892e-399a5b7ff5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:23.283566 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551d3c0-bcd3-4b91-892e-399a5b7ff5f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:23.297469 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5205a1-c271-4754-86e5-8aee8d67b2a3 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:23.366907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35431005-c1d2-4706-a27b-46fc42b7965f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:23.367923 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35431005-c1d2-4706-a27b-46fc42b7965f None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:23.368404 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35431005-c1d2-4706-a27b-46fc42b7965f None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:23.368890 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35431005-c1d2-4706-a27b-46fc42b7965f None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:23.369831 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35431005-c1d2-4706-a27b-46fc42b7965f None admin] RBAC: Adding query filter params (name=member) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:23.370325 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35431005-c1d2-4706-a27b-46fc42b7965f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:23.371913 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35431005-c1d2-4706-a27b-46fc42b7965f None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:23.403401 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 85/172] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:23.405159 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35431005-c1d2-4706-a27b-46fc42b7965f None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:23.445467 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551d3c0-bcd3-4b91-892e-399a5b7ff5f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:23.447752 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551d3c0-bcd3-4b91-892e-399a5b7ff5f2 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:23.689508 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35431005-c1d2-4706-a27b-46fc42b7965f None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:23.716941 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 88/173] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 731 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:23.718200 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551d3c0-bcd3-4b91-892e-399a5b7ff5f2 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:23.749954 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084ee9a-4327-4364-a9fe-28955cc1eb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:23.750629 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084ee9a-4327-4364-a9fe-28955cc1eb20 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:23.750910 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084ee9a-4327-4364-a9fe-28955cc1eb20 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:23.751346 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084ee9a-4327-4364-a9fe-28955cc1eb20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:23.752332 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084ee9a-4327-4364-a9fe-28955cc1eb20 None admin] RBAC: Adding query filter params (role.id=e34b765cca514a83bef6eb9cff7ef871, scope.project.id=c3028825f71d4cf8bdcd974c7dda14fa, user.id=be52c2e382db45d0af34429705c6405e) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:23.752821 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084ee9a-4327-4364-a9fe-28955cc1eb20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:23.754422 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084ee9a-4327-4364-a9fe-28955cc1eb20 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:23.768692 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 86/174] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 12:59:23 2022] GET /identity/v3/role_assignments?user.id=be52c2e382db45d0af34429705c6405e&scope.project.id=c3028825f71d4cf8bdcd974c7dda14fa&role.id=e34b765cca514a83bef6eb9cff7ef871 => generated 608 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:23.770021 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084ee9a-4327-4364-a9fe-28955cc1eb20 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:23.931011 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084ee9a-4327-4364-a9fe-28955cc1eb20 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:23.931215 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551d3c0-bcd3-4b91-892e-399a5b7ff5f2 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:23.985745 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c73147-06e0-4dca-aa75-5673ff906693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:23.987213 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c73147-06e0-4dca-aa75-5673ff906693 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:23.987641 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c73147-06e0-4dca-aa75-5673ff906693 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:23.988150 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c73147-06e0-4dca-aa75-5673ff906693 None admin] PATH_INFO: `/v3/users/be52c2e382db45d0af34429705c6405e` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:23.989624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c73147-06e0-4dca-aa75-5673ff906693 None admin] RBAC: Authorizing `identity:get_user(user_id=be52c2e382db45d0af34429705c6405e)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:23.991244 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c73147-06e0-4dca-aa75-5673ff906693 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:23.993232 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 89/175] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:23 2022] GET /identity/v3/users/be52c2e382db45d0af34429705c6405e => generated 275 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:23.995711 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195afb3-dd3b-46ae-ad47-fe16b5d02715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:23.995711 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195afb3-dd3b-46ae-ad47-fe16b5d02715 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:23.995711 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195afb3-dd3b-46ae-ad47-fe16b5d02715 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:23.995711 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195afb3-dd3b-46ae-ad47-fe16b5d02715 None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:23.996363 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195afb3-dd3b-46ae-ad47-fe16b5d02715 None admin] RBAC: Authorizing `identity:get_project(project_id=5e8582daaa764afcaf9c73a4aab00169)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:23.997872 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195afb3-dd3b-46ae-ad47-fe16b5d02715 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:24.000033 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c73147-06e0-4dca-aa75-5673ff906693 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:24.000537 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 87/176] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:23 2022] GET /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:24.006462 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195afb3-dd3b-46ae-ad47-fe16b5d02715 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:24.154074 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195afb3-dd3b-46ae-ad47-fe16b5d02715 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:24.212397 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc3f82-e56e-4b2c-b597-4380da7f35c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:24.213352 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc3f82-e56e-4b2c-b597-4380da7f35c7 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:24.213806 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc3f82-e56e-4b2c-b597-4380da7f35c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:24.214247 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc3f82-e56e-4b2c-b597-4380da7f35c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:24.215261 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc3f82-e56e-4b2c-b597-4380da7f35c7 None admin] RBAC: Adding query filter params (role.id=a08ab7d3851a43ac8ed5339681d7de91, scope.project.id=5e8582daaa764afcaf9c73a4aab00169, user.id=be52c2e382db45d0af34429705c6405e) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:24.215751 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc3f82-e56e-4b2c-b597-4380da7f35c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:24.217982 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c73147-06e0-4dca-aa75-5673ff906693 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:24.218171 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc3f82-e56e-4b2c-b597-4380da7f35c7 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:24.229063 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 88/177] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 12:59:24 2022] GET /identity/v3/role_assignments?user.id=be52c2e382db45d0af34429705c6405e&scope.project.id=5e8582daaa764afcaf9c73a4aab00169&role.id=a08ab7d3851a43ac8ed5339681d7de91 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:24.305318 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677ce61-b180-45e5-9197-03b762c40667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:24.305921 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677ce61-b180-45e5-9197-03b762c40667 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:24.306209 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677ce61-b180-45e5-9197-03b762c40667 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:24.306488 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677ce61-b180-45e5-9197-03b762c40667 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:24.411185 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677ce61-b180-45e5-9197-03b762c40667 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:24.412703 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677ce61-b180-45e5-9197-03b762c40667 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:24.449599 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143ca5b-bfb2-41de-806f-a3de01c9c57b None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:24.450202 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143ca5b-bfb2-41de-806f-a3de01c9c57b None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:24.450719 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143ca5b-bfb2-41de-806f-a3de01c9c57b None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:24.453371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 89/178] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 12:59:24.471314 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b831ceb-10cb-4073-806c-abc591c08fb3 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:24.471930 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b831ceb-10cb-4073-806c-abc591c08fb3 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:24.472398 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b831ceb-10cb-4073-806c-abc591c08fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:24.500592 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-6b831ceb-10cb-4073-806c-abc591c08fb3 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:24.502187 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6b831ceb-10cb-4073-806c-abc591c08fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:24.534411 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 90/179] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 12:59:24.539843 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677ce61-b180-45e5-9197-03b762c40667 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:24.600477 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 90/180] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 12:59:24.628262 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd533c32-758e-4258-831c-297c29f50321 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:24.628918 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd533c32-758e-4258-831c-297c29f50321 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:24.629415 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd533c32-758e-4258-831c-297c29f50321 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:24.631467 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 91/181] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 12:59:24.637133 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a9bad-a6c7-4181-9293-1b4a4f8e616b None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:24.637672 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a9bad-a6c7-4181-9293-1b4a4f8e616b None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:24.638165 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a9bad-a6c7-4181-9293-1b4a4f8e616b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:24.668766 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-306a9bad-a6c7-4181-9293-1b4a4f8e616b None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:24.676685 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-306a9bad-a6c7-4181-9293-1b4a4f8e616b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:24.692690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677ce61-b180-45e5-9197-03b762c40667 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:24.727216 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398ac2c-8f3f-4280-a8cf-90951bdd6d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:24.727216 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398ac2c-8f3f-4280-a8cf-90951bdd6d99 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:24.727216 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398ac2c-8f3f-4280-a8cf-90951bdd6d99 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:24.727546 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398ac2c-8f3f-4280-a8cf-90951bdd6d99 None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:24.731351 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398ac2c-8f3f-4280-a8cf-90951bdd6d99 None admin] RBAC: Authorizing `identity:get_project(project_id=5e8582daaa764afcaf9c73a4aab00169)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:24.731351 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398ac2c-8f3f-4280-a8cf-90951bdd6d99 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:24.732346 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 91/182] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:24 2022] GET /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:24.732552 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398ac2c-8f3f-4280-a8cf-90951bdd6d99 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:24.767276 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 92/183] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 12:59:24.768864 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a9bad-a6c7-4181-9293-1b4a4f8e616b None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:24.840274 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398ac2c-8f3f-4280-a8cf-90951bdd6d99 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:24.872165 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a9bad-a6c7-4181-9293-1b4a4f8e616b None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:24.880261 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348e81a-7adf-4674-b000-f7b0f4e0387e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:24.881101 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348e81a-7adf-4674-b000-f7b0f4e0387e None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:24.881388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348e81a-7adf-4674-b000-f7b0f4e0387e None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:24.881668 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348e81a-7adf-4674-b000-f7b0f4e0387e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:24.894315 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348e81a-7adf-4674-b000-f7b0f4e0387e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:24.901237 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-0348e81a-7adf-4674-b000-f7b0f4e0387e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 12:59:24.902469 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 92/184] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 12:59:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:24.903241 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348e81a-7adf-4674-b000-f7b0f4e0387e None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:24.914716 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4dfa4-9f67-4516-84ee-c2067f8d0f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:24.915745 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4dfa4-9f67-4516-84ee-c2067f8d0f3a None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:24.916226 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4dfa4-9f67-4516-84ee-c2067f8d0f3a None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:24.916720 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4dfa4-9f67-4516-84ee-c2067f8d0f3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:24.917749 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4dfa4-9f67-4516-84ee-c2067f8d0f3a None admin] RBAC: Adding query filter params (role.id=e34b765cca514a83bef6eb9cff7ef871, scope.project.id=5e8582daaa764afcaf9c73a4aab00169, user.id=be52c2e382db45d0af34429705c6405e) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:24.918272 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4dfa4-9f67-4516-84ee-c2067f8d0f3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:24.919994 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4dfa4-9f67-4516-84ee-c2067f8d0f3a None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:24.927388 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 93/185] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 12:59:24 2022] GET /identity/v3/role_assignments?user.id=be52c2e382db45d0af34429705c6405e&scope.project.id=5e8582daaa764afcaf9c73a4aab00169&role.id=e34b765cca514a83bef6eb9cff7ef871 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:24.928590 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4dfa4-9f67-4516-84ee-c2067f8d0f3a None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:25.027992 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348e81a-7adf-4674-b000-f7b0f4e0387e None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:25.032579 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4dfa4-9f67-4516-84ee-c2067f8d0f3a None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:25.064380 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d4e39-1b08-44c8-bab9-024c2564dfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:25.065238 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d4e39-1b08-44c8-bab9-024c2564dfc3 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:25.065523 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d4e39-1b08-44c8-bab9-024c2564dfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:25.065799 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d4e39-1b08-44c8-bab9-024c2564dfc3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:25.069233 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d53655-aea6-4a94-bdff-e8f832c1eede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:25.070114 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d53655-aea6-4a94-bdff-e8f832c1eede None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:25.070586 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d53655-aea6-4a94-bdff-e8f832c1eede None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:25.071079 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d53655-aea6-4a94-bdff-e8f832c1eede None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:25.072017 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d53655-aea6-4a94-bdff-e8f832c1eede None admin] RBAC: Adding query filter params (name=admin) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:25.072671 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d53655-aea6-4a94-bdff-e8f832c1eede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:25.074290 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d53655-aea6-4a94-bdff-e8f832c1eede None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:25.077809 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d4e39-1b08-44c8-bab9-024c2564dfc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:25.084794 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 94/186] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:25.085765 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-393d4e39-1b08-44c8-bab9-024c2564dfc3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 12:59:25.087087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 93/187] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 12:59:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:25.092711 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d53655-aea6-4a94-bdff-e8f832c1eede None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:25.094290 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d4e39-1b08-44c8-bab9-024c2564dfc3 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:25.208398 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d4e39-1b08-44c8-bab9-024c2564dfc3 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:25.222619 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d53655-aea6-4a94-bdff-e8f832c1eede None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:25.250892 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cea6b-c02a-47f8-86ce-e195b28a78bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:25.251576 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cea6b-c02a-47f8-86ce-e195b28a78bf None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:25.252063 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cea6b-c02a-47f8-86ce-e195b28a78bf None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:25.252350 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cea6b-c02a-47f8-86ce-e195b28a78bf None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:25.253138 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cea6b-c02a-47f8-86ce-e195b28a78bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:25.253446 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cea6b-c02a-47f8-86ce-e195b28a78bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:25.254850 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cea6b-c02a-47f8-86ce-e195b28a78bf None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:25.265177 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 94/188] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 12:59:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:25.266931 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad01aa-effb-48aa-bbd5-4dbc940e2ac2 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:25.267369 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad01aa-effb-48aa-bbd5-4dbc940e2ac2 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:25.267505 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4771a61-cb67-43f9-bb97-7a0b253b601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:25.267941 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad01aa-effb-48aa-bbd5-4dbc940e2ac2 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:25.268378 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4771a61-cb67-43f9-bb97-7a0b253b601d None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:25.268860 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4771a61-cb67-43f9-bb97-7a0b253b601d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:25.269273 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4771a61-cb67-43f9-bb97-7a0b253b601d None admin] PATH_INFO: `/v3/users/b18ab412605b493c81115b9c26925be8` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:25.269839 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 95/189] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:25.277980 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad01aa-effb-48aa-bbd5-4dbc940e2ac2 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:25.295895 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4771a61-cb67-43f9-bb97-7a0b253b601d None admin] RBAC: Authorizing `identity:get_user(user_id=b18ab412605b493c81115b9c26925be8)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:25.299964 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4771a61-cb67-43f9-bb97-7a0b253b601d None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:25.304472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 95/190] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:25 2022] GET /identity/v3/users/b18ab412605b493c81115b9c26925be8 => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:25.310251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafda47-d074-4420-a53b-e74570e3d20a None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:25.311309 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafda47-d074-4420-a53b-e74570e3d20a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:25.311770 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafda47-d074-4420-a53b-e74570e3d20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:25.330484 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-9aafda47-d074-4420-a53b-e74570e3d20a None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:25.331961 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-9aafda47-d074-4420-a53b-e74570e3d20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:25.388323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad01aa-effb-48aa-bbd5-4dbc940e2ac2 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:25.401455 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 96/191] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:25.403041 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafda47-d074-4420-a53b-e74570e3d20a None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:25.421799 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4e1a0-ed14-4955-95bd-a683338c7dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:25.422673 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4e1a0-ed14-4955-95bd-a683338c7dc0 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:25.422956 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4e1a0-ed14-4955-95bd-a683338c7dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:25.423228 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4e1a0-ed14-4955-95bd-a683338c7dc0 None admin] PATH_INFO: `/v3/users/b18ab412605b493c81115b9c26925be8` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:25.424569 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4e1a0-ed14-4955-95bd-a683338c7dc0 None admin] RBAC: Authorizing `identity:get_user(user_id=b18ab412605b493c81115b9c26925be8)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:25.426035 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4e1a0-ed14-4955-95bd-a683338c7dc0 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:25.427660 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 96/192] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:25 2022] GET /identity/v3/users/b18ab412605b493c81115b9c26925be8 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:25.432852 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edc71a-d47e-4f71-af27-9a5bc76bd6c7 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:25.433137 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edc71a-d47e-4f71-af27-9a5bc76bd6c7 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:25.433415 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edc71a-d47e-4f71-af27-9a5bc76bd6c7 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:25.435073 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 97/193] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:25.436396 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edc71a-d47e-4f71-af27-9a5bc76bd6c7 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:25.499348 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafda47-d074-4420-a53b-e74570e3d20a None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:25.531027 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a2263-f7d8-48e5-840a-6dc59f53e4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:25.531938 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a2263-f7d8-48e5-840a-6dc59f53e4a3 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:25.532224 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a2263-f7d8-48e5-840a-6dc59f53e4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:25.532500 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a2263-f7d8-48e5-840a-6dc59f53e4a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:25.532697 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edc71a-d47e-4f71-af27-9a5bc76bd6c7 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:25.564465 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f81ca-2be7-4b39-ad76-b70fd4123f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:25.565275 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f81ca-2be7-4b39-ad76-b70fd4123f6b None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:25.565553 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f81ca-2be7-4b39-ad76-b70fd4123f6b None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:25.565844 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f81ca-2be7-4b39-ad76-b70fd4123f6b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:25.575488 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f81ca-2be7-4b39-ad76-b70fd4123f6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:25.583525 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-013f81ca-2be7-4b39-ad76-b70fd4123f6b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 12:59:25.585012 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 98/194] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:25.585782 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f81ca-2be7-4b39-ad76-b70fd4123f6b None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:25.599471 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a2263-f7d8-48e5-840a-6dc59f53e4a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:25.600983 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a2263-f7d8-48e5-840a-6dc59f53e4a3 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:25.684469 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f81ca-2be7-4b39-ad76-b70fd4123f6b None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:25.692120 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 97/195] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:25.694130 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d54fc9-cf7e-4785-a7e8-452d8d2a9011 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:25.694422 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d54fc9-cf7e-4785-a7e8-452d8d2a9011 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:25.694694 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d54fc9-cf7e-4785-a7e8-452d8d2a9011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:25.711318 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-95d54fc9-cf7e-4785-a7e8-452d8d2a9011 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:25.712507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-95d54fc9-cf7e-4785-a7e8-452d8d2a9011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:25.717286 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aded1e-23f2-46e6-ad72-9fca41a417b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:25.717924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aded1e-23f2-46e6-ad72-9fca41a417b5 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:25.718205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aded1e-23f2-46e6-ad72-9fca41a417b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:25.718478 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aded1e-23f2-46e6-ad72-9fca41a417b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:25.774892 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 98/196] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:25.776990 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d54fc9-cf7e-4785-a7e8-452d8d2a9011 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:25.783039 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aded1e-23f2-46e6-ad72-9fca41a417b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:25.784687 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aded1e-23f2-46e6-ad72-9fca41a417b5 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:25.869281 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d54fc9-cf7e-4785-a7e8-452d8d2a9011 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:25.882693 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 99/197] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:25.883549 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aded1e-23f2-46e6-ad72-9fca41a417b5 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:25.901950 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f97eb7-0eaa-44f5-ba50-4c39550464a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:25.902607 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f97eb7-0eaa-44f5-ba50-4c39550464a8 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:25.902885 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f97eb7-0eaa-44f5-ba50-4c39550464a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:25.903157 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f97eb7-0eaa-44f5-ba50-4c39550464a8 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:25.903899 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f97eb7-0eaa-44f5-ba50-4c39550464a8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:25.904197 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f97eb7-0eaa-44f5-ba50-4c39550464a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:25.905827 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f97eb7-0eaa-44f5-ba50-4c39550464a8 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:25.913775 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 99/198] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:25.914537 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f97eb7-0eaa-44f5-ba50-4c39550464a8 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:25.977814 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aded1e-23f2-46e6-ad72-9fca41a417b5 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:26.006548 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f97eb7-0eaa-44f5-ba50-4c39550464a8 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:26.010287 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9830e1-cfb1-4d77-97e1-38d2ced3c7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:26.011128 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9830e1-cfb1-4d77-97e1-38d2ced3c7bf None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:26.011405 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9830e1-cfb1-4d77-97e1-38d2ced3c7bf None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:26.011678 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9830e1-cfb1-4d77-97e1-38d2ced3c7bf None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:26.012870 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9830e1-cfb1-4d77-97e1-38d2ced3c7bf None admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ce0a6eef414c84f1dabaf084bd68)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:26.014371 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9830e1-cfb1-4d77-97e1-38d2ced3c7bf None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:26.016041 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 100/199] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:25 2022] GET /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68 => generated 302 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:26.016818 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9830e1-cfb1-4d77-97e1-38d2ced3c7bf None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:26.038259 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ee609-3292-4eb7-a925-95e8d30ea5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:26.038995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee609-3292-4eb7-a925-95e8d30ea5a5 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:26.039259 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee609-3292-4eb7-a925-95e8d30ea5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:26.039529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee609-3292-4eb7-a925-95e8d30ea5a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:26.040703 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ee609-3292-4eb7-a925-95e8d30ea5a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:26.042142 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ee609-3292-4eb7-a925-95e8d30ea5a5 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:26.043732 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 100/200] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 12:59:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:26.043732 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ee609-3292-4eb7-a925-95e8d30ea5a5 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:26.109809 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9830e1-cfb1-4d77-97e1-38d2ced3c7bf None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:26.137871 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ee609-3292-4eb7-a925-95e8d30ea5a5 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:26.141399 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f34989-91fe-4034-9bcc-7cc57a5956ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:26.142247 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f34989-91fe-4034-9bcc-7cc57a5956ce None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:26.142523 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f34989-91fe-4034-9bcc-7cc57a5956ce None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:26.142793 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f34989-91fe-4034-9bcc-7cc57a5956ce None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:26.143939 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f34989-91fe-4034-9bcc-7cc57a5956ce None admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ce0a6eef414c84f1dabaf084bd68)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:26.145407 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f34989-91fe-4034-9bcc-7cc57a5956ce None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:26.147075 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 101/201] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:26 2022] GET /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68 => generated 302 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:26.151876 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f34989-91fe-4034-9bcc-7cc57a5956ce None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:26.171267 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd3653-9a5e-40f6-a169-6d389a5854b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:26.172134 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd3653-9a5e-40f6-a169-6d389a5854b8 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:26.172415 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd3653-9a5e-40f6-a169-6d389a5854b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:26.172720 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd3653-9a5e-40f6-a169-6d389a5854b8 None admin] PATH_INFO: `/v3/users/6bf77d11104f4d9c96052ec1a6de9831` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:26.173905 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd3653-9a5e-40f6-a169-6d389a5854b8 None admin] RBAC: Authorizing `identity:get_user(user_id=6bf77d11104f4d9c96052ec1a6de9831)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:26.175357 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd3653-9a5e-40f6-a169-6d389a5854b8 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:26.177184 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 101/202] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:26 2022] GET /identity/v3/users/6bf77d11104f4d9c96052ec1a6de9831 => generated 289 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:26.177736 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd3653-9a5e-40f6-a169-6d389a5854b8 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:26.244980 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f34989-91fe-4034-9bcc-7cc57a5956ce None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:26.270106 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd3653-9a5e-40f6-a169-6d389a5854b8 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:26.276109 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d60d6c-0b8c-49a8-9fb9-9af0555f36e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:26.276792 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d60d6c-0b8c-49a8-9fb9-9af0555f36e2 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:26.277079 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d60d6c-0b8c-49a8-9fb9-9af0555f36e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:26.277355 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d60d6c-0b8c-49a8-9fb9-9af0555f36e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:26.278180 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d60d6c-0b8c-49a8-9fb9-9af0555f36e2 None admin] RBAC: Adding query filter params (role.id=f9ec85924a914e078096b38cae4e6caa, scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68, user.id=b18ab412605b493c81115b9c26925be8) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:26.278489 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d60d6c-0b8c-49a8-9fb9-9af0555f36e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:26.280570 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d60d6c-0b8c-49a8-9fb9-9af0555f36e2 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:26.286045 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 102/203] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 12:59:26 2022] GET /identity/v3/role_assignments?user.id=b18ab412605b493c81115b9c26925be8&scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68&role.id=f9ec85924a914e078096b38cae4e6caa => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:26.286811 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d60d6c-0b8c-49a8-9fb9-9af0555f36e2 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:26.303517 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01503280-aee7-4d7c-ad2d-8f98bfae393a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:26.304120 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01503280-aee7-4d7c-ad2d-8f98bfae393a None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:26.304404 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01503280-aee7-4d7c-ad2d-8f98bfae393a None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:26.304705 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01503280-aee7-4d7c-ad2d-8f98bfae393a None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:26.305443 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01503280-aee7-4d7c-ad2d-8f98bfae393a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:26.306974 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01503280-aee7-4d7c-ad2d-8f98bfae393a None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:26.395819 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d60d6c-0b8c-49a8-9fb9-9af0555f36e2 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:26.430180 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4cefa-42c3-457b-9273-fd3466a730a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:26.430840 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4cefa-42c3-457b-9273-fd3466a730a4 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:26.431120 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4cefa-42c3-457b-9273-fd3466a730a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:26.431393 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4cefa-42c3-457b-9273-fd3466a730a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:26.432231 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4cefa-42c3-457b-9273-fd3466a730a4 None admin] RBAC: Adding query filter params (role.id=a08ab7d3851a43ac8ed5339681d7de91, scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68, user.id=b18ab412605b493c81115b9c26925be8) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:26.432538 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4cefa-42c3-457b-9273-fd3466a730a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:26.434043 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4cefa-42c3-457b-9273-fd3466a730a4 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:26.437900 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 102/204] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 12:59:26 2022] POST /identity/v3/users => generated 297 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:59:26.438837 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01503280-aee7-4d7c-ad2d-8f98bfae393a None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:26.441355 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 103/205] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 12:59:26 2022] GET /identity/v3/role_assignments?user.id=b18ab412605b493c81115b9c26925be8&scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68&role.id=a08ab7d3851a43ac8ed5339681d7de91 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:26.567270 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01503280-aee7-4d7c-ad2d-8f98bfae393a None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:26.606519 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d0c48-f58c-4a3b-9c1f-3e0beb73375f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:26.607205 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d0c48-f58c-4a3b-9c1f-3e0beb73375f None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:26.608102 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d0c48-f58c-4a3b-9c1f-3e0beb73375f None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:26.608391 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d0c48-f58c-4a3b-9c1f-3e0beb73375f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:26.682414 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d0c48-f58c-4a3b-9c1f-3e0beb73375f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:26.683961 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d0c48-f58c-4a3b-9c1f-3e0beb73375f None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:26.783149 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 103/206] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:26.788928 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4cefa-42c3-457b-9273-fd3466a730a4 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:26.894568 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4cefa-42c3-457b-9273-fd3466a730a4 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:26.944095 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3168c1-9aa3-4dff-974a-fc006fc1d154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:26.944998 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3168c1-9aa3-4dff-974a-fc006fc1d154 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:26.945279 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3168c1-9aa3-4dff-974a-fc006fc1d154 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:26.945553 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3168c1-9aa3-4dff-974a-fc006fc1d154 None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:26.946752 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3168c1-9aa3-4dff-974a-fc006fc1d154 None admin] RBAC: Authorizing `identity:get_project(project_id=5e8582daaa764afcaf9c73a4aab00169)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:26.948204 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3168c1-9aa3-4dff-974a-fc006fc1d154 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:26.954794 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 104/207] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:26 2022] GET /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:26.956173 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d0c48-f58c-4a3b-9c1f-3e0beb73375f None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:27.056623 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d0c48-f58c-4a3b-9c1f-3e0beb73375f None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:27.090930 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea3f1c-29de-4c39-bbdc-79d490dfe6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:27.091595 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea3f1c-29de-4c39-bbdc-79d490dfe6a5 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:27.092439 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea3f1c-29de-4c39-bbdc-79d490dfe6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:27.092741 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea3f1c-29de-4c39-bbdc-79d490dfe6a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:27.093576 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea3f1c-29de-4c39-bbdc-79d490dfe6a5 None admin] RBAC: Adding query filter params (role.id=02b083eae38b4e7ba220f1d1a33e43a4, scope.project.id=5e8582daaa764afcaf9c73a4aab00169, user.id=6bf77d11104f4d9c96052ec1a6de9831) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:27.093887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea3f1c-29de-4c39-bbdc-79d490dfe6a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:27.095337 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea3f1c-29de-4c39-bbdc-79d490dfe6a5 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:27.101477 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 104/208] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 12:59:26 2022] GET /identity/v3/role_assignments?user.id=6bf77d11104f4d9c96052ec1a6de9831&scope.project.id=5e8582daaa764afcaf9c73a4aab00169&role.id=02b083eae38b4e7ba220f1d1a33e43a4 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:28.805726 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c4fbc-e2e7-4c0f-8426-9ff782c334ae None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:28.806783 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c4fbc-e2e7-4c0f-8426-9ff782c334ae None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:28.807274 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c4fbc-e2e7-4c0f-8426-9ff782c334ae None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:28.809300 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 105/209] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:28.814953 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d090b-8e4d-47d7-91ad-72baed51d958 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:28.815773 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d090b-8e4d-47d7-91ad-72baed51d958 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:28.816269 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d090b-8e4d-47d7-91ad-72baed51d958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:28.834288 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-a57d090b-8e4d-47d7-91ad-72baed51d958 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:28.835783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-a57d090b-8e4d-47d7-91ad-72baed51d958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:28.850642 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112e0d5-782d-4400-876c-b59592386054 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:28.850931 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112e0d5-782d-4400-876c-b59592386054 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:28.852494 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112e0d5-782d-4400-876c-b59592386054 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:28.853203 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 106/210] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:28.861827 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3657265-558b-417b-a722-51361f690495 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:28.862405 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3657265-558b-417b-a722-51361f690495 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:28.862881 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3657265-558b-417b-a722-51361f690495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:28.880541 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-d3657265-558b-417b-a722-51361f690495 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:28.882048 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-d3657265-558b-417b-a722-51361f690495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:28.907162 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 105/211] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:28.930047 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d090b-8e4d-47d7-91ad-72baed51d958 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:28.957024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 107/212] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:28.980546 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3657265-558b-417b-a722-51361f690495 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:29.029963 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d090b-8e4d-47d7-91ad-72baed51d958 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:29.064999 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa89cd-4496-4795-9d36-38aa6c015e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:29.065591 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa89cd-4496-4795-9d36-38aa6c015e96 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:29.065867 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa89cd-4496-4795-9d36-38aa6c015e96 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:29.066133 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa89cd-4496-4795-9d36-38aa6c015e96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:29.077498 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa89cd-4496-4795-9d36-38aa6c015e96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:29.084356 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3657265-558b-417b-a722-51361f690495 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:29.084473 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-28fa89cd-4496-4795-9d36-38aa6c015e96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 12:59:29.085907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 106/213] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 12:59:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:29.091370 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa89cd-4496-4795-9d36-38aa6c015e96 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:29.119955 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a9a47-7bc8-41e4-88b1-d6118e6b88e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:29.120796 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a9a47-7bc8-41e4-88b1-d6118e6b88e8 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:29.121073 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a9a47-7bc8-41e4-88b1-d6118e6b88e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:29.121342 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a9a47-7bc8-41e4-88b1-d6118e6b88e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:29.132053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a9a47-7bc8-41e4-88b1-d6118e6b88e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:29.139437 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-ac4a9a47-7bc8-41e4-88b1-d6118e6b88e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 12:59:29.140636 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 108/214] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 12:59:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:29.141840 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28044851-b44e-4259-8170-de42c022bde3 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:29.142121 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28044851-b44e-4259-8170-de42c022bde3 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:29.142390 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28044851-b44e-4259-8170-de42c022bde3 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:29.144780 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 109/215] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:29.146034 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28044851-b44e-4259-8170-de42c022bde3 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:29.196425 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa89cd-4496-4795-9d36-38aa6c015e96 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:29.228233 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e9f6e-86bc-468d-aa7b-f10ee77841b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:29.228904 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e9f6e-86bc-468d-aa7b-f10ee77841b1 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:29.229184 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e9f6e-86bc-468d-aa7b-f10ee77841b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:29.229462 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e9f6e-86bc-468d-aa7b-f10ee77841b1 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:29.230205 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e9f6e-86bc-468d-aa7b-f10ee77841b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:29.230507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e9f6e-86bc-468d-aa7b-f10ee77841b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:29.231893 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e9f6e-86bc-468d-aa7b-f10ee77841b1 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:29.240622 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 107/216] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:29.242137 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfeebb-7673-4d3b-9f64-ffabd71a71a2 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:29.242620 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfeebb-7673-4d3b-9f64-ffabd71a71a2 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:29.243087 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfeebb-7673-4d3b-9f64-ffabd71a71a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:29.254561 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28044851-b44e-4259-8170-de42c022bde3 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:29.263291 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-85bfeebb-7673-4d3b-9f64-ffabd71a71a2 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:29.265242 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-85bfeebb-7673-4d3b-9f64-ffabd71a71a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:29.294570 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc346e-50ca-49ba-bee3-c9730e9c0e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:29.296313 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc346e-50ca-49ba-bee3-c9730e9c0e55 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:29.296604 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc346e-50ca-49ba-bee3-c9730e9c0e55 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:29.296916 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc346e-50ca-49ba-bee3-c9730e9c0e55 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:29.297666 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc346e-50ca-49ba-bee3-c9730e9c0e55 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:29.297977 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc346e-50ca-49ba-bee3-c9730e9c0e55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:29.299361 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc346e-50ca-49ba-bee3-c9730e9c0e55 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:29.307143 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 110/217] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 12:59:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:29.309029 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc346e-50ca-49ba-bee3-c9730e9c0e55 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:29.330562 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 108/218] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:29.331009 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f505f0-c2ec-417c-abda-65a70703369d None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:29.331199 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f505f0-c2ec-417c-abda-65a70703369d None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:29.334632 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f505f0-c2ec-417c-abda-65a70703369d None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:29.334632 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 109/219] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:29.334632 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f505f0-c2ec-417c-abda-65a70703369d None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:29.407038 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc346e-50ca-49ba-bee3-c9730e9c0e55 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:29.440864 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5cd1b-4abc-4fd7-a748-72b0fe8d2567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:29.441734 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5cd1b-4abc-4fd7-a748-72b0fe8d2567 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:29.442019 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5cd1b-4abc-4fd7-a748-72b0fe8d2567 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:29.442296 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5cd1b-4abc-4fd7-a748-72b0fe8d2567 None admin] PATH_INFO: `/v3/users/b18ab412605b493c81115b9c26925be8` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:29.442552 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f505f0-c2ec-417c-abda-65a70703369d None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:29.443489 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5cd1b-4abc-4fd7-a748-72b0fe8d2567 None admin] RBAC: Authorizing `identity:get_user(user_id=b18ab412605b493c81115b9c26925be8)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:29.444979 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5cd1b-4abc-4fd7-a748-72b0fe8d2567 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:29.446608 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 111/220] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:29 2022] GET /identity/v3/users/b18ab412605b493c81115b9c26925be8 => generated 283 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:29.447747 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a173bf-8223-4037-896c-3076dc335a55 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:29.448033 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a173bf-8223-4037-896c-3076dc335a55 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:29.448310 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a173bf-8223-4037-896c-3076dc335a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:29.464732 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-72a173bf-8223-4037-896c-3076dc335a55 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:29.465909 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-72a173bf-8223-4037-896c-3076dc335a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:29.476835 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa082d0-9c73-4fdd-9920-5fef509cfa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:29.477720 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa082d0-9c73-4fdd-9920-5fef509cfa77 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:29.477999 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa082d0-9c73-4fdd-9920-5fef509cfa77 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:29.478268 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa082d0-9c73-4fdd-9920-5fef509cfa77 None admin] PATH_INFO: `/v3/users/b18ab412605b493c81115b9c26925be8` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:29.479438 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa082d0-9c73-4fdd-9920-5fef509cfa77 None admin] RBAC: Authorizing `identity:get_user(user_id=b18ab412605b493c81115b9c26925be8)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:29.480984 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa082d0-9c73-4fdd-9920-5fef509cfa77 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:29.483105 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 110/221] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:29 2022] GET /identity/v3/users/b18ab412605b493c81115b9c26925be8 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:29.483940 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa082d0-9c73-4fdd-9920-5fef509cfa77 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:29.529912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 112/222] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:29.540879 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a173bf-8223-4037-896c-3076dc335a55 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:29.580646 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa082d0-9c73-4fdd-9920-5fef509cfa77 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:29.612485 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42212542-fd02-4d28-a892-d9a0e5225210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:29.613295 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42212542-fd02-4d28-a892-d9a0e5225210 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:29.613576 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42212542-fd02-4d28-a892-d9a0e5225210 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:29.613845 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42212542-fd02-4d28-a892-d9a0e5225210 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:29.624179 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42212542-fd02-4d28-a892-d9a0e5225210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:29.625465 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a173bf-8223-4037-896c-3076dc335a55 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:29.631065 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-42212542-fd02-4d28-a892-d9a0e5225210 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 12:59:29.636962 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 111/223] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:29.636962 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42212542-fd02-4d28-a892-d9a0e5225210 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:29.658467 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285f668-b7d1-4ec9-a685-d03d594f16d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:29.659323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285f668-b7d1-4ec9-a685-d03d594f16d8 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:29.659598 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285f668-b7d1-4ec9-a685-d03d594f16d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:29.659869 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285f668-b7d1-4ec9-a685-d03d594f16d8 None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:29.661042 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285f668-b7d1-4ec9-a685-d03d594f16d8 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ce0a6eef414c84f1dabaf084bd68)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:29.662505 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285f668-b7d1-4ec9-a685-d03d594f16d8 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:29.664238 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 113/224] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:29 2022] GET /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68 => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:29.665006 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285f668-b7d1-4ec9-a685-d03d594f16d8 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:29.780961 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42212542-fd02-4d28-a892-d9a0e5225210 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:29.811178 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285f668-b7d1-4ec9-a685-d03d594f16d8 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:29.812823 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d814d7-a303-45a0-90ad-314461baea8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:29.813682 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d814d7-a303-45a0-90ad-314461baea8d None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:29.813959 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d814d7-a303-45a0-90ad-314461baea8d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:29.814232 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d814d7-a303-45a0-90ad-314461baea8d None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:29.815397 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d814d7-a303-45a0-90ad-314461baea8d None admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ce0a6eef414c84f1dabaf084bd68)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:29.816874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d814d7-a303-45a0-90ad-314461baea8d None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:29.818540 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 112/225] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:29 2022] GET /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:29.819298 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d814d7-a303-45a0-90ad-314461baea8d None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:29.844101 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b9166-239b-4a83-9686-a285a5cd94fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:29.844846 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b9166-239b-4a83-9686-a285a5cd94fe None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:29.845127 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b9166-239b-4a83-9686-a285a5cd94fe None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:29.845394 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b9166-239b-4a83-9686-a285a5cd94fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:29.846526 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b9166-239b-4a83-9686-a285a5cd94fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:29.847966 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b9166-239b-4a83-9686-a285a5cd94fe None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:29.849608 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 114/226] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 12:59:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:29.850331 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b9166-239b-4a83-9686-a285a5cd94fe None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:29.913764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d814d7-a303-45a0-90ad-314461baea8d None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:29.942346 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b9166-239b-4a83-9686-a285a5cd94fe None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:29.945170 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07280115-bc8b-4ad7-9e2f-9bbe43c67698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:29.945830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07280115-bc8b-4ad7-9e2f-9bbe43c67698 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:29.946117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07280115-bc8b-4ad7-9e2f-9bbe43c67698 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:29.946395 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07280115-bc8b-4ad7-9e2f-9bbe43c67698 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:29.947138 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07280115-bc8b-4ad7-9e2f-9bbe43c67698 None admin] RBAC: Adding query filter params (name=member) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:29.947444 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07280115-bc8b-4ad7-9e2f-9bbe43c67698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:29.948882 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07280115-bc8b-4ad7-9e2f-9bbe43c67698 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:29.956816 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 113/227] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:29.957579 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07280115-bc8b-4ad7-9e2f-9bbe43c67698 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:29.973898 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd578e-8ec3-4710-9e2f-9127f5063e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:29.974773 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd578e-8ec3-4710-9e2f-9127f5063e08 None admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:29.975043 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd578e-8ec3-4710-9e2f-9127f5063e08 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:29.975307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd578e-8ec3-4710-9e2f-9127f5063e08 None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68/users/b18ab412605b493c81115b9c26925be8/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:29.977219 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd578e-8ec3-4710-9e2f-9127f5063e08 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7a5ce0a6eef414c84f1dabaf084bd68, user_id=b18ab412605b493c81115b9c26925be8, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:29.978657 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd578e-8ec3-4710-9e2f-9127f5063e08 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:30.051865 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 115/228] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 12:59:29 2022] PUT /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68/users/b18ab412605b493c81115b9c26925be8/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:59:30.052652 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd578e-8ec3-4710-9e2f-9127f5063e08 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:30.053154 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07280115-bc8b-4ad7-9e2f-9bbe43c67698 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:30.090015 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c05a18-84ed-4419-a153-c14063156a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:30.090927 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c05a18-84ed-4419-a153-c14063156a0a None admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:30.091204 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c05a18-84ed-4419-a153-c14063156a0a None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:30.092027 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c05a18-84ed-4419-a153-c14063156a0a None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68/users/b18ab412605b493c81115b9c26925be8/roles/a08ab7d3851a43ac8ed5339681d7de91` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:30.094793 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c05a18-84ed-4419-a153-c14063156a0a None admin] RBAC: Authorizing `identity:create_grant(project_id=a7a5ce0a6eef414c84f1dabaf084bd68, user_id=b18ab412605b493c81115b9c26925be8, role_id=a08ab7d3851a43ac8ed5339681d7de91)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:30.096231 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c05a18-84ed-4419-a153-c14063156a0a None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:30.158649 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd578e-8ec3-4710-9e2f-9127f5063e08 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:30.162433 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 114/229] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 12:59:29 2022] PUT /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68/users/b18ab412605b493c81115b9c26925be8/roles/a08ab7d3851a43ac8ed5339681d7de91 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:59:30.162830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c05a18-84ed-4419-a153-c14063156a0a None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:30.201834 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acac76-0353-4292-ae17-57bbc5865c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:30.202559 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acac76-0353-4292-ae17-57bbc5865c15 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:30.203198 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acac76-0353-4292-ae17-57bbc5865c15 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:30.203198 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acac76-0353-4292-ae17-57bbc5865c15 None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:30.203974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acac76-0353-4292-ae17-57bbc5865c15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:30.205609 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acac76-0353-4292-ae17-57bbc5865c15 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:30.287512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c05a18-84ed-4419-a153-c14063156a0a None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:30.322742 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 116/230] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 12:59:30 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:59:30.330777 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97e296-0d56-47b5-8086-b1c1b16b12ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:30.332182 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e296-0d56-47b5-8086-b1c1b16b12ae None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:30.332746 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e296-0d56-47b5-8086-b1c1b16b12ae None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:30.333265 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e296-0d56-47b5-8086-b1c1b16b12ae None admin] PATH_INFO: `/v3/users/e0199eb9174847baa239dd7f746a17ce` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:30.351315 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97e296-0d56-47b5-8086-b1c1b16b12ae None admin] RBAC: Authorizing `identity:get_user(user_id=e0199eb9174847baa239dd7f746a17ce)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:30.353450 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97e296-0d56-47b5-8086-b1c1b16b12ae None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:30.355700 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 115/231] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:30 2022] GET /identity/v3/users/e0199eb9174847baa239dd7f746a17ce => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:30.362212 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acac76-0353-4292-ae17-57bbc5865c15 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:30.477169 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acac76-0353-4292-ae17-57bbc5865c15 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:30.513099 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b14803-45be-4843-b05e-126fcfc83b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:30.514327 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b14803-45be-4843-b05e-126fcfc83b24 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:30.516152 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b14803-45be-4843-b05e-126fcfc83b24 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:30.516152 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b14803-45be-4843-b05e-126fcfc83b24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:30.584226 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b14803-45be-4843-b05e-126fcfc83b24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:30.585733 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b14803-45be-4843-b05e-126fcfc83b24 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:30.684614 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 117/232] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:30.692117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97e296-0d56-47b5-8086-b1c1b16b12ae None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:30.801376 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97e296-0d56-47b5-8086-b1c1b16b12ae None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:30.834689 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac8540-4df7-4d16-94aa-f0bdb0417a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:30.835551 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac8540-4df7-4d16-94aa-f0bdb0417a69 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:30.835829 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac8540-4df7-4d16-94aa-f0bdb0417a69 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:30.836104 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac8540-4df7-4d16-94aa-f0bdb0417a69 None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:30.837298 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac8540-4df7-4d16-94aa-f0bdb0417a69 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ce0a6eef414c84f1dabaf084bd68)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:30.838744 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac8540-4df7-4d16-94aa-f0bdb0417a69 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:30.840791 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 116/233] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:30 2022] GET /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:30.849723 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b14803-45be-4843-b05e-126fcfc83b24 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:30.992883 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b14803-45be-4843-b05e-126fcfc83b24 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:31.042426 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd732fb-11e0-4cc1-9f6c-529d47fce478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:31.043101 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd732fb-11e0-4cc1-9f6c-529d47fce478 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:31.043386 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd732fb-11e0-4cc1-9f6c-529d47fce478 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:31.043662 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd732fb-11e0-4cc1-9f6c-529d47fce478 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:31.044575 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd732fb-11e0-4cc1-9f6c-529d47fce478 None admin] RBAC: Adding query filter params (role.id=e34b765cca514a83bef6eb9cff7ef871, scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68, user.id=e0199eb9174847baa239dd7f746a17ce) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:31.045034 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd732fb-11e0-4cc1-9f6c-529d47fce478 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:31.050677 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd732fb-11e0-4cc1-9f6c-529d47fce478 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:31.059293 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 118/234] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 12:59:30 2022] GET /identity/v3/role_assignments?user.id=e0199eb9174847baa239dd7f746a17ce&scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68&role.id=e34b765cca514a83bef6eb9cff7ef871 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:32.592982 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3692c98-3c13-4283-ab97-c3990e6bbc73 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:32.593980 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3692c98-3c13-4283-ab97-c3990e6bbc73 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:32.594565 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3692c98-3c13-4283-ab97-c3990e6bbc73 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:32.596556 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 117/235] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:32.602146 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebb437-3681-468f-8bab-74f82460a8c1 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:32.602974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebb437-3681-468f-8bab-74f82460a8c1 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:32.603469 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebb437-3681-468f-8bab-74f82460a8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:32.622185 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-a6ebb437-3681-468f-8bab-74f82460a8c1 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:32.624480 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a6ebb437-3681-468f-8bab-74f82460a8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:32.694802 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 119/236] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:32.719664 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3692c98-3c13-4283-ab97-c3990e6bbc73 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:32.826984 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3692c98-3c13-4283-ab97-c3990e6bbc73 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:32.863633 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c0cb2-a351-413d-9a29-c3a5b605ab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:32.864784 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c0cb2-a351-413d-9a29-c3a5b605ab11 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:32.865292 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c0cb2-a351-413d-9a29-c3a5b605ab11 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:32.865783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c0cb2-a351-413d-9a29-c3a5b605ab11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:32.876801 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c0cb2-a351-413d-9a29-c3a5b605ab11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:32.884285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-d77c0cb2-a351-413d-9a29-c3a5b605ab11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 12:59:32.885961 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 118/237] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 12:59:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:32.892266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebb437-3681-468f-8bab-74f82460a8c1 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:32.976123 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39def052-367d-4b1e-bc57-fa4b57ddca8a None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:32.976788 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39def052-367d-4b1e-bc57-fa4b57ddca8a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:32.977268 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39def052-367d-4b1e-bc57-fa4b57ddca8a None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:32.979256 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 119/238] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 12:59:32.986017 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad892512-56d4-4beb-a451-669b53378135 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:32.986678 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad892512-56d4-4beb-a451-669b53378135 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:32.987154 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad892512-56d4-4beb-a451-669b53378135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:33.005583 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-ad892512-56d4-4beb-a451-669b53378135 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:33.007275 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-ad892512-56d4-4beb-a451-669b53378135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:33.082437 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 120/239] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 12:59:33.108624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad892512-56d4-4beb-a451-669b53378135 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:33.113572 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebb437-3681-468f-8bab-74f82460a8c1 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:33.194111 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d430d3-8135-4738-ac12-c21b23c55e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:33.195249 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d430d3-8135-4738-ac12-c21b23c55e6e None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:33.195717 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d430d3-8135-4738-ac12-c21b23c55e6e None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:33.196314 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d430d3-8135-4738-ac12-c21b23c55e6e None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:33.197211 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d430d3-8135-4738-ac12-c21b23c55e6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:33.197526 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d430d3-8135-4738-ac12-c21b23c55e6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:33.198910 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d430d3-8135-4738-ac12-c21b23c55e6e None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:33.215864 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 120/240] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:33.234230 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d430d3-8135-4738-ac12-c21b23c55e6e None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:33.245169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad892512-56d4-4beb-a451-669b53378135 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:33.296690 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01008d-ed47-4d86-ac95-343b31a02fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:33.298391 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01008d-ed47-4d86-ac95-343b31a02fda None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:33.298954 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01008d-ed47-4d86-ac95-343b31a02fda None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:33.299427 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01008d-ed47-4d86-ac95-343b31a02fda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:33.313717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01008d-ed47-4d86-ac95-343b31a02fda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:33.323534 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-db01008d-ed47-4d86-ac95-343b31a02fda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 12:59:33.325332 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 121/241] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 12:59:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 12:59:33.331067 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c64f6d-90de-4f11-b31d-3500534f8f4a None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:33.331067 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c64f6d-90de-4f11-b31d-3500534f8f4a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:33.331067 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c64f6d-90de-4f11-b31d-3500534f8f4a None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:33.332071 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 122/242] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:33.332672 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c64f6d-90de-4f11-b31d-3500534f8f4a None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:33.360441 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d430d3-8135-4738-ac12-c21b23c55e6e None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:33.394814 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a3561-6497-43b9-8e82-4b81dbed3f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:33.395582 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a3561-6497-43b9-8e82-4b81dbed3f23 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:33.395866 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a3561-6497-43b9-8e82-4b81dbed3f23 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:33.396140 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a3561-6497-43b9-8e82-4b81dbed3f23 None admin] PATH_INFO: `/v3/users/b18ab412605b493c81115b9c26925be8` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:33.397370 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a3561-6497-43b9-8e82-4b81dbed3f23 None admin] RBAC: Authorizing `identity:get_user(user_id=b18ab412605b493c81115b9c26925be8)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:33.399033 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a3561-6497-43b9-8e82-4b81dbed3f23 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:33.400757 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 121/243] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:33 2022] GET /identity/v3/users/b18ab412605b493c81115b9c26925be8 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:33.401983 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e591da4-2d0b-4d57-8ce0-018a2704b91c None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:33.402270 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e591da4-2d0b-4d57-8ce0-018a2704b91c None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:33.402763 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e591da4-2d0b-4d57-8ce0-018a2704b91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:33.419235 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-8e591da4-2d0b-4d57-8ce0-018a2704b91c None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:33.421084 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-8e591da4-2d0b-4d57-8ce0-018a2704b91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:33.446284 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c64f6d-90de-4f11-b31d-3500534f8f4a None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:33.481670 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040defd-7fc4-4833-82d5-88fc27b30f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:33.483265 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040defd-7fc4-4833-82d5-88fc27b30f79 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:33.483747 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040defd-7fc4-4833-82d5-88fc27b30f79 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:33.484271 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040defd-7fc4-4833-82d5-88fc27b30f79 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:33.485240 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040defd-7fc4-4833-82d5-88fc27b30f79 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:33.485821 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040defd-7fc4-4833-82d5-88fc27b30f79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:33.487742 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040defd-7fc4-4833-82d5-88fc27b30f79 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:33.488325 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 122/244] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:33.489211 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e591da4-2d0b-4d57-8ce0-018a2704b91c None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:33.497510 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 123/245] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 12:59:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:33.508232 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040defd-7fc4-4833-82d5-88fc27b30f79 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:33.607610 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e591da4-2d0b-4d57-8ce0-018a2704b91c None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:33.624841 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040defd-7fc4-4833-82d5-88fc27b30f79 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:33.643366 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb2bff-5276-4aba-a0d7-70a74de0296d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:33.644013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb2bff-5276-4aba-a0d7-70a74de0296d None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:33.644673 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb2bff-5276-4aba-a0d7-70a74de0296d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:33.644673 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb2bff-5276-4aba-a0d7-70a74de0296d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:33.658900 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b785e-1b6f-4538-8059-64433dcb8571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:33.659778 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b785e-1b6f-4538-8059-64433dcb8571 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:33.660060 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b785e-1b6f-4538-8059-64433dcb8571 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:33.660551 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b785e-1b6f-4538-8059-64433dcb8571 None admin] PATH_INFO: `/v3/users/b18ab412605b493c81115b9c26925be8` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:33.661830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b785e-1b6f-4538-8059-64433dcb8571 None admin] RBAC: Authorizing `identity:get_user(user_id=b18ab412605b493c81115b9c26925be8)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:33.663299 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b785e-1b6f-4538-8059-64433dcb8571 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:33.665120 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 124/246] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:33 2022] GET /identity/v3/users/b18ab412605b493c81115b9c26925be8 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:33.665726 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b785e-1b6f-4538-8059-64433dcb8571 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:33.711090 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb2bff-5276-4aba-a0d7-70a74de0296d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:33.712505 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb2bff-5276-4aba-a0d7-70a74de0296d None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:33.763758 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b785e-1b6f-4538-8059-64433dcb8571 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:33.799459 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c15f0-3576-4c97-9da0-7f31147c2125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:33.800273 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c15f0-3576-4c97-9da0-7f31147c2125 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:33.800556 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c15f0-3576-4c97-9da0-7f31147c2125 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:33.800865 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c15f0-3576-4c97-9da0-7f31147c2125 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:33.812414 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c15f0-3576-4c97-9da0-7f31147c2125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:33.815794 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 123/247] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:33.817387 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f2426-dbe0-4a1c-8c29-189feb87ef8b None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:33.817795 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f2426-dbe0-4a1c-8c29-189feb87ef8b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:33.818186 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f2426-dbe0-4a1c-8c29-189feb87ef8b None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:33.819396 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-b38c15f0-3576-4c97-9da0-7f31147c2125 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 12:59:33.820575 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 124/249] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:33.820744 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 125/249] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:33.824772 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c15f0-3576-4c97-9da0-7f31147c2125 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:33.826018 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f2426-dbe0-4a1c-8c29-189feb87ef8b None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:33.921642 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c15f0-3576-4c97-9da0-7f31147c2125 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:33.923086 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f2426-dbe0-4a1c-8c29-189feb87ef8b None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:33.953681 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d19e3-cafe-4a99-911f-d5943735f88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:33.954321 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d19e3-cafe-4a99-911f-d5943735f88d None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:33.954605 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d19e3-cafe-4a99-911f-d5943735f88d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:33.954884 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d19e3-cafe-4a99-911f-d5943735f88d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:33.956097 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360fcf8-1ba9-4218-87f4-bc34d301cc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:33.956979 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360fcf8-1ba9-4218-87f4-bc34d301cc04 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:33.957253 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360fcf8-1ba9-4218-87f4-bc34d301cc04 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:33.957530 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360fcf8-1ba9-4218-87f4-bc34d301cc04 None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:33.958688 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360fcf8-1ba9-4218-87f4-bc34d301cc04 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ce0a6eef414c84f1dabaf084bd68)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:33.960137 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360fcf8-1ba9-4218-87f4-bc34d301cc04 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:33.961919 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 125/250] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:33 2022] GET /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:33.963048 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe03cdf-7846-4eff-a9ad-24543e463095 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:33.963335 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe03cdf-7846-4eff-a9ad-24543e463095 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:33.963610 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe03cdf-7846-4eff-a9ad-24543e463095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:33.980232 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-7fe03cdf-7846-4eff-a9ad-24543e463095 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:33.981439 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-7fe03cdf-7846-4eff-a9ad-24543e463095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:34.024887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d19e3-cafe-4a99-911f-d5943735f88d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:34.026364 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d19e3-cafe-4a99-911f-d5943735f88d None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:34.050277 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 126/251] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:34.051220 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe03cdf-7846-4eff-a9ad-24543e463095 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:34.137301 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 126/252] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:34.138716 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d19e3-cafe-4a99-911f-d5943735f88d None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:34.152370 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe03cdf-7846-4eff-a9ad-24543e463095 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:34.185032 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7acfe-040b-4896-93ca-b8fd96c58233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:34.185711 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7acfe-040b-4896-93ca-b8fd96c58233 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:34.185989 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7acfe-040b-4896-93ca-b8fd96c58233 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:34.186255 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7acfe-040b-4896-93ca-b8fd96c58233 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:34.186994 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7acfe-040b-4896-93ca-b8fd96c58233 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:34.187299 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7acfe-040b-4896-93ca-b8fd96c58233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:34.188690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7acfe-040b-4896-93ca-b8fd96c58233 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:34.196391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 127/253] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:34.197209 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7acfe-040b-4896-93ca-b8fd96c58233 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:34.238215 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d19e3-cafe-4a99-911f-d5943735f88d None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:34.269721 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68b09d-0a70-4208-a317-349cb4c0d977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:34.270370 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b09d-0a70-4208-a317-349cb4c0d977 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:34.270653 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b09d-0a70-4208-a317-349cb4c0d977 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:34.270930 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b09d-0a70-4208-a317-349cb4c0d977 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:34.271751 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68b09d-0a70-4208-a317-349cb4c0d977 None admin] RBAC: Adding query filter params (role.id=f9ec85924a914e078096b38cae4e6caa, scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68, user.id=b18ab412605b493c81115b9c26925be8) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:34.272065 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68b09d-0a70-4208-a317-349cb4c0d977 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:34.273551 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68b09d-0a70-4208-a317-349cb4c0d977 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:34.279219 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 127/254] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 12:59:34 2022] GET /identity/v3/role_assignments?user.id=b18ab412605b493c81115b9c26925be8&scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68&role.id=f9ec85924a914e078096b38cae4e6caa => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:34.281817 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68b09d-0a70-4208-a317-349cb4c0d977 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:34.291627 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7acfe-040b-4896-93ca-b8fd96c58233 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:34.333247 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d74489-2310-4f4d-a7de-8960c5cf34bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:34.334113 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d74489-2310-4f4d-a7de-8960c5cf34bd None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:34.334372 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d74489-2310-4f4d-a7de-8960c5cf34bd None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:34.334649 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d74489-2310-4f4d-a7de-8960c5cf34bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:34.336324 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d74489-2310-4f4d-a7de-8960c5cf34bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:34.337591 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d74489-2310-4f4d-a7de-8960c5cf34bd None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:34.339528 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 128/255] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 12:59:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:34.340733 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19e7f2-457f-466c-a06f-090423fb0e64 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:34.341022 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19e7f2-457f-466c-a06f-090423fb0e64 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:34.341452 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19e7f2-457f-466c-a06f-090423fb0e64 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:34.347878 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 129/256] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:34.349052 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19e7f2-457f-466c-a06f-090423fb0e64 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:34.394314 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68b09d-0a70-4208-a317-349cb4c0d977 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:34.429858 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c0e2f-ddd4-41bd-aec3-1d35b47a3797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:34.430755 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c0e2f-ddd4-41bd-aec3-1d35b47a3797 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:34.431022 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c0e2f-ddd4-41bd-aec3-1d35b47a3797 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:34.431298 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c0e2f-ddd4-41bd-aec3-1d35b47a3797 None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:34.432560 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c0e2f-ddd4-41bd-aec3-1d35b47a3797 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ce0a6eef414c84f1dabaf084bd68)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:34.434078 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c0e2f-ddd4-41bd-aec3-1d35b47a3797 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:34.436355 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 128/257] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:34 2022] GET /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:34.441448 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c0e2f-ddd4-41bd-aec3-1d35b47a3797 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:34.458282 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19e7f2-457f-466c-a06f-090423fb0e64 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:34.493613 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9ff12-49bd-4240-9421-701576a0f0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:34.494105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9ff12-49bd-4240-9421-701576a0f0c3 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:34.494383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9ff12-49bd-4240-9421-701576a0f0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:34.494653 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9ff12-49bd-4240-9421-701576a0f0c3 None admin] PATH_INFO: `/v3/users/a4a518a6b6df40278ca501d994cd2d97` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:34.508990 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9ff12-49bd-4240-9421-701576a0f0c3 None admin] RBAC: Authorizing `identity:get_user(user_id=a4a518a6b6df40278ca501d994cd2d97)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:34.510474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9ff12-49bd-4240-9421-701576a0f0c3 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:34.512183 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 130/258] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:34 2022] GET /identity/v3/users/a4a518a6b6df40278ca501d994cd2d97 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:34.514098 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda42332-426f-4f6d-b445-255316b76ad1 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:34.514315 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda42332-426f-4f6d-b445-255316b76ad1 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:34.514590 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda42332-426f-4f6d-b445-255316b76ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:34.531679 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-cda42332-426f-4f6d-b445-255316b76ad1 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:34.532888 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-cda42332-426f-4f6d-b445-255316b76ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:34.551453 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c0e2f-ddd4-41bd-aec3-1d35b47a3797 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:34.585115 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fba42-c51f-4650-b1b6-f3c6a9bf570d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:34.585777 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fba42-c51f-4650-b1b6-f3c6a9bf570d None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:34.586061 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fba42-c51f-4650-b1b6-f3c6a9bf570d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:34.586335 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fba42-c51f-4650-b1b6-f3c6a9bf570d None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:34.587041 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058fba42-c51f-4650-b1b6-f3c6a9bf570d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:34.588495 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058fba42-c51f-4650-b1b6-f3c6a9bf570d None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:34.597582 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 131/259] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:34.598416 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda42332-426f-4f6d-b445-255316b76ad1 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:34.691680 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda42332-426f-4f6d-b445-255316b76ad1 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:34.692340 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 129/260] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 12:59:34 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:59:34.693186 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fba42-c51f-4650-b1b6-f3c6a9bf570d None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:34.728879 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc73cd-aa4f-4f8f-a7e5-0456323c658a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:34.729651 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc73cd-aa4f-4f8f-a7e5-0456323c658a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:34.729899 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc73cd-aa4f-4f8f-a7e5-0456323c658a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:34.730224 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc73cd-aa4f-4f8f-a7e5-0456323c658a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:34.731121 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc73cd-aa4f-4f8f-a7e5-0456323c658a None admin] RBAC: Adding query filter params (role.id=a08ab7d3851a43ac8ed5339681d7de91, scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68, user.id=b18ab412605b493c81115b9c26925be8) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:34.731492 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc73cd-aa4f-4f8f-a7e5-0456323c658a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:34.733526 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc73cd-aa4f-4f8f-a7e5-0456323c658a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:34.740196 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 132/261] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 12:59:34 2022] GET /identity/v3/role_assignments?user.id=b18ab412605b493c81115b9c26925be8&scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68&role.id=a08ab7d3851a43ac8ed5339681d7de91 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:34.741408 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc73cd-aa4f-4f8f-a7e5-0456323c658a None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:34.806472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fba42-c51f-4650-b1b6-f3c6a9bf570d None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:34.845371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f533f-e074-4d4e-98be-59a46aeecbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:34.845968 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f533f-e074-4d4e-98be-59a46aeecbbe None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:34.846250 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f533f-e074-4d4e-98be-59a46aeecbbe None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:34.846530 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f533f-e074-4d4e-98be-59a46aeecbbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:34.867587 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc73cd-aa4f-4f8f-a7e5-0456323c658a None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:34.910791 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d976d1d-3ee5-4e74-85aa-2d6a4dfaa85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:34.911619 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d976d1d-3ee5-4e74-85aa-2d6a4dfaa85f None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:34.911908 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d976d1d-3ee5-4e74-85aa-2d6a4dfaa85f None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:34.912171 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d976d1d-3ee5-4e74-85aa-2d6a4dfaa85f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:34.925528 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d976d1d-3ee5-4e74-85aa-2d6a4dfaa85f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:34.930108 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f533f-e074-4d4e-98be-59a46aeecbbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:34.931800 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f533f-e074-4d4e-98be-59a46aeecbbe None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:34.932060 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-7d976d1d-3ee5-4e74-85aa-2d6a4dfaa85f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 12:59:34.933570 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 133/262] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:34.939360 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d976d1d-3ee5-4e74-85aa-2d6a4dfaa85f None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:35.044446 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d976d1d-3ee5-4e74-85aa-2d6a4dfaa85f None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:35.058835 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 130/263] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:35.064794 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f533f-e074-4d4e-98be-59a46aeecbbe None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:35.080450 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd136929-725d-4345-bb34-b3018abd2f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:35.081160 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd136929-725d-4345-bb34-b3018abd2f82 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:35.081449 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd136929-725d-4345-bb34-b3018abd2f82 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:35.082581 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd136929-725d-4345-bb34-b3018abd2f82 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:35.082581 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd136929-725d-4345-bb34-b3018abd2f82 None admin] RBAC: Adding query filter params (name=member) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:35.082822 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd136929-725d-4345-bb34-b3018abd2f82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:35.084163 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd136929-725d-4345-bb34-b3018abd2f82 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:35.093653 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 134/264] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:35.099069 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd136929-725d-4345-bb34-b3018abd2f82 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:35.181223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f533f-e074-4d4e-98be-59a46aeecbbe None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:35.212590 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd136929-725d-4345-bb34-b3018abd2f82 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:35.225907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb1a36-10e1-4929-bf02-d87c1029a7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:35.226934 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb1a36-10e1-4929-bf02-d87c1029a7c6 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:35.227219 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb1a36-10e1-4929-bf02-d87c1029a7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:35.227867 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb1a36-10e1-4929-bf02-d87c1029a7c6 None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:35.229363 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb1a36-10e1-4929-bf02-d87c1029a7c6 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ce0a6eef414c84f1dabaf084bd68)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:35.231290 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb1a36-10e1-4929-bf02-d87c1029a7c6 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:35.234182 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 131/265] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:35 2022] GET /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:35.239366 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb1a36-10e1-4929-bf02-d87c1029a7c6 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:35.251450 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7eabf0-207c-4105-820a-bc9e87512326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:35.252607 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7eabf0-207c-4105-820a-bc9e87512326 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:35.253071 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7eabf0-207c-4105-820a-bc9e87512326 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:35.253479 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7eabf0-207c-4105-820a-bc9e87512326 None admin] PATH_INFO: `/v3/users/e0199eb9174847baa239dd7f746a17ce` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:35.254853 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7eabf0-207c-4105-820a-bc9e87512326 None admin] RBAC: Authorizing `identity:get_user(user_id=e0199eb9174847baa239dd7f746a17ce)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:35.256436 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7eabf0-207c-4105-820a-bc9e87512326 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:35.258745 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 135/266] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:35 2022] GET /identity/v3/users/e0199eb9174847baa239dd7f746a17ce => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:35.264081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7eabf0-207c-4105-820a-bc9e87512326 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:35.362717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb1a36-10e1-4929-bf02-d87c1029a7c6 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:35.370440 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7eabf0-207c-4105-820a-bc9e87512326 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:35.399986 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23c672-6bc4-4b9b-a2ec-2c3ae1df2610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:35.400923 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23c672-6bc4-4b9b-a2ec-2c3ae1df2610 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:35.401347 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23c672-6bc4-4b9b-a2ec-2c3ae1df2610 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:35.401799 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23c672-6bc4-4b9b-a2ec-2c3ae1df2610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:35.402801 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23c672-6bc4-4b9b-a2ec-2c3ae1df2610 None admin] RBAC: Adding query filter params (role.id=02b083eae38b4e7ba220f1d1a33e43a4, scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68, user.id=a4a518a6b6df40278ca501d994cd2d97) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:35.403306 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23c672-6bc4-4b9b-a2ec-2c3ae1df2610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:35.405661 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23c672-6bc4-4b9b-a2ec-2c3ae1df2610 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:35.406734 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f8138-8f1a-4483-a84d-e8b6a196f490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:35.407652 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f8138-8f1a-4483-a84d-e8b6a196f490 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:35.408010 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f8138-8f1a-4483-a84d-e8b6a196f490 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:35.408358 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f8138-8f1a-4483-a84d-e8b6a196f490 None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:35.409663 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f8138-8f1a-4483-a84d-e8b6a196f490 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ce0a6eef414c84f1dabaf084bd68)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:35.411194 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f8138-8f1a-4483-a84d-e8b6a196f490 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:35.417764 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 136/268] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:35 2022] GET /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:35.418010 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 132/268] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 12:59:35 2022] GET /identity/v3/role_assignments?user.id=a4a518a6b6df40278ca501d994cd2d97&scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68&role.id=02b083eae38b4e7ba220f1d1a33e43a4 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:35.419354 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f8138-8f1a-4483-a84d-e8b6a196f490 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:35.527832 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f8138-8f1a-4483-a84d-e8b6a196f490 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:35.565037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f4349-0959-48fb-9d94-b2b089bd7f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:35.566017 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4349-0959-48fb-9d94-b2b089bd7f58 None admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:35.566304 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4349-0959-48fb-9d94-b2b089bd7f58 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:35.566624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4349-0959-48fb-9d94-b2b089bd7f58 None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68/users/e0199eb9174847baa239dd7f746a17ce/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:35.568785 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f4349-0959-48fb-9d94-b2b089bd7f58 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7a5ce0a6eef414c84f1dabaf084bd68, user_id=e0199eb9174847baa239dd7f746a17ce, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:35.570268 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f4349-0959-48fb-9d94-b2b089bd7f58 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:35.699648 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 137/269] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 12:59:35 2022] PUT /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68/users/e0199eb9174847baa239dd7f746a17ce/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:59:37.223711 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52464c7f-6bc7-426c-a3c9-aa91fab0fc10 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:37.224220 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52464c7f-6bc7-426c-a3c9-aa91fab0fc10 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:37.224294 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52464c7f-6bc7-426c-a3c9-aa91fab0fc10 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:37.226194 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 133/270] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:37.231191 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f190f-ff5d-42de-bfff-f5f3d28d53c1 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:37.232277 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f190f-ff5d-42de-bfff-f5f3d28d53c1 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:37.232277 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f190f-ff5d-42de-bfff-f5f3d28d53c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:37.249302 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-621f190f-ff5d-42de-bfff-f5f3d28d53c1 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:37.250487 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-621f190f-ff5d-42de-bfff-f5f3d28d53c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:37.321811 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 138/271] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:37.331676 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeded2-2e21-4a56-897c-10971b31871b None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:37.331968 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeded2-2e21-4a56-897c-10971b31871b None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:37.332251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeded2-2e21-4a56-897c-10971b31871b None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:37.334306 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 134/272] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:37.339478 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9652ad-3e01-4614-bab5-4ee3b170f5a7 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:37.339771 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9652ad-3e01-4614-bab5-4ee3b170f5a7 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:37.340049 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9652ad-3e01-4614-bab5-4ee3b170f5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:37.346922 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adeded2-2e21-4a56-897c-10971b31871b None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:37.363355 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-9f9652ad-3e01-4614-bab5-4ee3b170f5a7 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:37.364670 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9f9652ad-3e01-4614-bab5-4ee3b170f5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:37.440951 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 139/273] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:37.459256 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9652ad-3e01-4614-bab5-4ee3b170f5a7 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:37.462263 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adeded2-2e21-4a56-897c-10971b31871b None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:37.496679 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1330581-2fd0-45a7-9dbd-3552bf5603b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:37.498032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1330581-2fd0-45a7-9dbd-3552bf5603b6 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:37.498339 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1330581-2fd0-45a7-9dbd-3552bf5603b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:37.498755 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1330581-2fd0-45a7-9dbd-3552bf5603b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:37.499920 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1330581-2fd0-45a7-9dbd-3552bf5603b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:37.501402 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1330581-2fd0-45a7-9dbd-3552bf5603b6 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:37.503226 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 135/274] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 12:59:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:37.508480 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1330581-2fd0-45a7-9dbd-3552bf5603b6 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:37.562712 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9652ad-3e01-4614-bab5-4ee3b170f5a7 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:37.598145 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce467af2-9b73-4939-9ae3-49d205f4f60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:37.598948 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce467af2-9b73-4939-9ae3-49d205f4f60a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:37.599234 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce467af2-9b73-4939-9ae3-49d205f4f60a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:37.599508 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce467af2-9b73-4939-9ae3-49d205f4f60a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:37.608431 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1330581-2fd0-45a7-9dbd-3552bf5603b6 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:37.610325 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce467af2-9b73-4939-9ae3-49d205f4f60a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:37.617308 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-ce467af2-9b73-4939-9ae3-49d205f4f60a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 12:59:37.618711 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 140/275] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 12:59:37.625323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce467af2-9b73-4939-9ae3-49d205f4f60a None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:37.642758 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85aedd4-9df8-4262-8b39-d53f93182c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:37.643520 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85aedd4-9df8-4262-8b39-d53f93182c86 None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:37.643872 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85aedd4-9df8-4262-8b39-d53f93182c86 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:37.644217 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85aedd4-9df8-4262-8b39-d53f93182c86 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:37.645052 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85aedd4-9df8-4262-8b39-d53f93182c86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:37.646568 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85aedd4-9df8-4262-8b39-d53f93182c86 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:37.734882 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 136/276] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 12:59:37 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:59:37.739363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce467af2-9b73-4939-9ae3-49d205f4f60a None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:37.780989 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f251258-cd42-480a-9432-924cf3aa7f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:37.781607 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f251258-cd42-480a-9432-924cf3aa7f14 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:37.781893 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f251258-cd42-480a-9432-924cf3aa7f14 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:37.782173 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f251258-cd42-480a-9432-924cf3aa7f14 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:37.783040 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f251258-cd42-480a-9432-924cf3aa7f14 None admin] RBAC: Adding query filter params (name=member) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:37.783354 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f251258-cd42-480a-9432-924cf3aa7f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:37.784830 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f251258-cd42-480a-9432-924cf3aa7f14 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:37.789366 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61ac35-58cd-4958-9903-ef932c0fd0f9 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:37.789786 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61ac35-58cd-4958-9903-ef932c0fd0f9 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:37.790160 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61ac35-58cd-4958-9903-ef932c0fd0f9 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:37.792447 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 137/277] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:37.795205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 141/278] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:37.798506 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c807de-a41f-404c-8d4e-273167ae74c5 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:37.798768 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c807de-a41f-404c-8d4e-273167ae74c5 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:37.799051 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c807de-a41f-404c-8d4e-273167ae74c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:37.800860 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f251258-cd42-480a-9432-924cf3aa7f14 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:37.822784 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-a1c807de-a41f-404c-8d4e-273167ae74c5 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:37.824189 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-a1c807de-a41f-404c-8d4e-273167ae74c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:37.900874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 138/279] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 12:59:37.917112 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f251258-cd42-480a-9432-924cf3aa7f14 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:37.926301 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c807de-a41f-404c-8d4e-273167ae74c5 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:37.962361 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399a25d-b7e1-4960-ac39-87406d288dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:37.963243 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399a25d-b7e1-4960-ac39-87406d288dfc None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:37.963519 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399a25d-b7e1-4960-ac39-87406d288dfc None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:37.963788 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399a25d-b7e1-4960-ac39-87406d288dfc None admin] PATH_INFO: `/v3/users/2c2e2e96f3f74965829e7daa6c8c2bb7` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:37.982222 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399a25d-b7e1-4960-ac39-87406d288dfc None admin] RBAC: Authorizing `identity:get_user(user_id=2c2e2e96f3f74965829e7daa6c8c2bb7)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:37.983118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399a25d-b7e1-4960-ac39-87406d288dfc None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:37.985114 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 142/280] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:37 2022] GET /identity/v3/users/2c2e2e96f3f74965829e7daa6c8c2bb7 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:37.990681 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399a25d-b7e1-4960-ac39-87406d288dfc None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:38.054729 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c807de-a41f-404c-8d4e-273167ae74c5 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:38.095765 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef463f7-243b-43ad-94f2-0de0212c2aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:38.096560 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef463f7-243b-43ad-94f2-0de0212c2aa8 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:38.096899 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef463f7-243b-43ad-94f2-0de0212c2aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:38.097146 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef463f7-243b-43ad-94f2-0de0212c2aa8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:38.109656 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef463f7-243b-43ad-94f2-0de0212c2aa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:38.111999 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399a25d-b7e1-4960-ac39-87406d288dfc None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:38.117549 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-9ef463f7-243b-43ad-94f2-0de0212c2aa8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 12:59:38.118351 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 139/281] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 12:59:38.120945 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06653de1-b233-4d9b-a119-3f880aac2ec3 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:38.121882 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06653de1-b233-4d9b-a119-3f880aac2ec3 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:38.122425 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06653de1-b233-4d9b-a119-3f880aac2ec3 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:38.125034 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 140/282] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:38.126141 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06653de1-b233-4d9b-a119-3f880aac2ec3 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:38.151625 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7da8a-4e32-45f3-87db-34287878942d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:38.152290 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7da8a-4e32-45f3-87db-34287878942d None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:38.152595 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7da8a-4e32-45f3-87db-34287878942d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:38.152906 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7da8a-4e32-45f3-87db-34287878942d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:38.154450 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7da8a-4e32-45f3-87db-34287878942d None admin] RBAC: Adding query filter params (role.id=e34b765cca514a83bef6eb9cff7ef871, user.id=2c2e2e96f3f74965829e7daa6c8c2bb7, scope.system=all) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:38.154771 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7da8a-4e32-45f3-87db-34287878942d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:38.156469 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7da8a-4e32-45f3-87db-34287878942d None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:38.161808 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 143/283] 10.222.0.52 () {56 vars in 1308 bytes} [Tue Mar 8 12:59:37 2022] GET /identity/v3/role_assignments?user.id=2c2e2e96f3f74965829e7daa6c8c2bb7&scope.system=all&role.id=e34b765cca514a83bef6eb9cff7ef871 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:38.163038 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c068f1c-7cf7-47e6-b0cf-a5d9644dead1 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:38.163351 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c068f1c-7cf7-47e6-b0cf-a5d9644dead1 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:38.163631 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c068f1c-7cf7-47e6-b0cf-a5d9644dead1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:38.198719 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-2c068f1c-7cf7-47e6-b0cf-a5d9644dead1 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:38.199917 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-2c068f1c-7cf7-47e6-b0cf-a5d9644dead1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:38.253067 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06653de1-b233-4d9b-a119-3f880aac2ec3 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:38.269919 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 144/284] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:38.290612 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15861dfe-c816-4658-a7f5-42627a4f9fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:38.291460 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15861dfe-c816-4658-a7f5-42627a4f9fa4 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:38.291844 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15861dfe-c816-4658-a7f5-42627a4f9fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:38.292254 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15861dfe-c816-4658-a7f5-42627a4f9fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:38.293384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15861dfe-c816-4658-a7f5-42627a4f9fa4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:38.293800 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15861dfe-c816-4658-a7f5-42627a4f9fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:38.295851 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15861dfe-c816-4658-a7f5-42627a4f9fa4 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:38.305634 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c068f1c-7cf7-47e6-b0cf-a5d9644dead1 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:38.310953 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 141/285] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:38.312683 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15861dfe-c816-4658-a7f5-42627a4f9fa4 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:38.433037 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15861dfe-c816-4658-a7f5-42627a4f9fa4 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:38.469735 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af99f8-7011-4c8c-8c1e-7ec95cbdf6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:38.471017 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af99f8-7011-4c8c-8c1e-7ec95cbdf6e6 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:38.471547 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af99f8-7011-4c8c-8c1e-7ec95cbdf6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:38.472113 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af99f8-7011-4c8c-8c1e-7ec95cbdf6e6 None admin] PATH_INFO: `/v3/users/a4a518a6b6df40278ca501d994cd2d97` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:38.473587 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af99f8-7011-4c8c-8c1e-7ec95cbdf6e6 None admin] RBAC: Authorizing `identity:get_user(user_id=a4a518a6b6df40278ca501d994cd2d97)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:38.475273 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af99f8-7011-4c8c-8c1e-7ec95cbdf6e6 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:38.482217 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 142/286] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:38 2022] GET /identity/v3/users/a4a518a6b6df40278ca501d994cd2d97 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:38.483873 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af99f8-7011-4c8c-8c1e-7ec95cbdf6e6 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:38.502243 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c068f1c-7cf7-47e6-b0cf-a5d9644dead1 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:38.537651 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd961fb-cbc3-4d7b-81af-616291af035f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:38.538459 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd961fb-cbc3-4d7b-81af-616291af035f None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:38.538742 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd961fb-cbc3-4d7b-81af-616291af035f None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:38.539015 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd961fb-cbc3-4d7b-81af-616291af035f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:38.550815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd961fb-cbc3-4d7b-81af-616291af035f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:38.558150 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-2fd961fb-cbc3-4d7b-81af-616291af035f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 12:59:38.560318 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 145/287] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 12:59:38.565433 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd961fb-cbc3-4d7b-81af-616291af035f None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:38.615562 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af99f8-7011-4c8c-8c1e-7ec95cbdf6e6 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:38.662122 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2659c-16a6-4afe-9853-dfba797db547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:38.662997 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2659c-16a6-4afe-9853-dfba797db547 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:38.663338 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2659c-16a6-4afe-9853-dfba797db547 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:38.663614 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2659c-16a6-4afe-9853-dfba797db547 None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:38.664900 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2659c-16a6-4afe-9853-dfba797db547 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ce0a6eef414c84f1dabaf084bd68)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:38.666354 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2659c-16a6-4afe-9853-dfba797db547 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:38.668247 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 143/288] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:38 2022] GET /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:38.674668 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2659c-16a6-4afe-9853-dfba797db547 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:38.753826 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd961fb-cbc3-4d7b-81af-616291af035f None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:38.809831 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e0809-11d1-49de-91e9-236ede33e728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:38.810506 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e0809-11d1-49de-91e9-236ede33e728 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:38.810787 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e0809-11d1-49de-91e9-236ede33e728 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:38.811058 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e0809-11d1-49de-91e9-236ede33e728 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:38.811798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e0809-11d1-49de-91e9-236ede33e728 None admin] RBAC: Adding query filter params (name=member) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:38.812099 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e0809-11d1-49de-91e9-236ede33e728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:38.813496 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e0809-11d1-49de-91e9-236ede33e728 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:38.830871 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 146/289] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:38.852730 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e0809-11d1-49de-91e9-236ede33e728 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:38.887673 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2659c-16a6-4afe-9853-dfba797db547 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:38.937361 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005622aa-47c2-4265-abc3-cd2248b59711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:38.938252 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005622aa-47c2-4265-abc3-cd2248b59711 None admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:38.938704 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005622aa-47c2-4265-abc3-cd2248b59711 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:38.938993 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005622aa-47c2-4265-abc3-cd2248b59711 None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68/users/a4a518a6b6df40278ca501d994cd2d97/roles/02b083eae38b4e7ba220f1d1a33e43a4` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:38.941018 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005622aa-47c2-4265-abc3-cd2248b59711 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7a5ce0a6eef414c84f1dabaf084bd68, user_id=a4a518a6b6df40278ca501d994cd2d97, role_id=02b083eae38b4e7ba220f1d1a33e43a4)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:38.942466 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005622aa-47c2-4265-abc3-cd2248b59711 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:38.968944 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e0809-11d1-49de-91e9-236ede33e728 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:39.002490 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d413ccd-6808-4273-befd-7f05fa469a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:39.003358 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d413ccd-6808-4273-befd-7f05fa469a54 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:39.003640 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d413ccd-6808-4273-befd-7f05fa469a54 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:39.003908 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d413ccd-6808-4273-befd-7f05fa469a54 None admin] PATH_INFO: `/v3/users/e0199eb9174847baa239dd7f746a17ce` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:39.005205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d413ccd-6808-4273-befd-7f05fa469a54 None admin] RBAC: Authorizing `identity:get_user(user_id=e0199eb9174847baa239dd7f746a17ce)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:39.006655 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d413ccd-6808-4273-befd-7f05fa469a54 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:39.008576 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 147/290] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:38 2022] GET /identity/v3/users/e0199eb9174847baa239dd7f746a17ce => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:39.013715 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d413ccd-6808-4273-befd-7f05fa469a54 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:39.031309 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 144/291] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 12:59:38 2022] PUT /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68/users/a4a518a6b6df40278ca501d994cd2d97/roles/02b083eae38b4e7ba220f1d1a33e43a4 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:59:39.123657 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d413ccd-6808-4273-befd-7f05fa469a54 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:39.159284 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5d1a1-9519-47e7-bae3-0bdc16cc7108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:39.160017 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5d1a1-9519-47e7-bae3-0bdc16cc7108 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:39.160299 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5d1a1-9519-47e7-bae3-0bdc16cc7108 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:39.160610 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5d1a1-9519-47e7-bae3-0bdc16cc7108 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:39.234369 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5d1a1-9519-47e7-bae3-0bdc16cc7108 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:39.235891 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5d1a1-9519-47e7-bae3-0bdc16cc7108 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:39.353127 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 148/292] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 12:59:39.361794 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005622aa-47c2-4265-abc3-cd2248b59711 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:39.471252 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005622aa-47c2-4265-abc3-cd2248b59711 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:39.508983 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ec83d-3092-4d14-91c2-13d86a4fc07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:39.509856 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ec83d-3092-4d14-91c2-13d86a4fc07e None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:39.510186 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ec83d-3092-4d14-91c2-13d86a4fc07e None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:39.510464 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ec83d-3092-4d14-91c2-13d86a4fc07e None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:39.513998 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ec83d-3092-4d14-91c2-13d86a4fc07e None admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ce0a6eef414c84f1dabaf084bd68)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:39.515470 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ec83d-3092-4d14-91c2-13d86a4fc07e None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:39.517411 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 145/293] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:39 2022] GET /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:39.522957 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5d1a1-9519-47e7-bae3-0bdc16cc7108 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:39.706018 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5d1a1-9519-47e7-bae3-0bdc16cc7108 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:39.750794 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192c4af-b05e-416b-90e6-3839ce7c5182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:39.751369 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192c4af-b05e-416b-90e6-3839ce7c5182 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:39.751651 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192c4af-b05e-416b-90e6-3839ce7c5182 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:39.751930 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192c4af-b05e-416b-90e6-3839ce7c5182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:39.752782 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192c4af-b05e-416b-90e6-3839ce7c5182 None admin] RBAC: Adding query filter params (role.id=e34b765cca514a83bef6eb9cff7ef871, scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68, user.id=e0199eb9174847baa239dd7f746a17ce) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:39.753093 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192c4af-b05e-416b-90e6-3839ce7c5182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:39.754537 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192c4af-b05e-416b-90e6-3839ce7c5182 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:39.760398 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 149/294] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 12:59:39 2022] GET /identity/v3/role_assignments?user.id=e0199eb9174847baa239dd7f746a17ce&scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68&role.id=e34b765cca514a83bef6eb9cff7ef871 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:40.478416 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c8043-ccb3-47ca-9f49-9cef26948f5a None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:40.479448 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c8043-ccb3-47ca-9f49-9cef26948f5a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:40.479947 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c8043-ccb3-47ca-9f49-9cef26948f5a None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:40.482531 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 146/295] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:40.488081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049d9b2-9d41-4cbe-a4ff-76b5a3e16fc5 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:40.489143 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049d9b2-9d41-4cbe-a4ff-76b5a3e16fc5 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:40.489655 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049d9b2-9d41-4cbe-a4ff-76b5a3e16fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:40.509574 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-b049d9b2-9d41-4cbe-a4ff-76b5a3e16fc5 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:40.511215 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b049d9b2-9d41-4cbe-a4ff-76b5a3e16fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:40.660981 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 150/296] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:40.679656 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c8043-ccb3-47ca-9f49-9cef26948f5a None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:40.781766 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c8043-ccb3-47ca-9f49-9cef26948f5a None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:40.820917 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a176d90-66d0-4752-a856-ba0890cb3559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:40.822036 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176d90-66d0-4752-a856-ba0890cb3559 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:40.822511 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176d90-66d0-4752-a856-ba0890cb3559 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:40.822963 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176d90-66d0-4752-a856-ba0890cb3559 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:40.824341 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a176d90-66d0-4752-a856-ba0890cb3559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:40.826028 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a176d90-66d0-4752-a856-ba0890cb3559 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:40.827826 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 147/297] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 12:59:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:40.833395 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049d9b2-9d41-4cbe-a4ff-76b5a3e16fc5 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:40.868835 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87ee18-9828-4e0c-8e10-51b201d952d6 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:40.870237 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87ee18-9828-4e0c-8e10-51b201d952d6 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:40.870696 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87ee18-9828-4e0c-8e10-51b201d952d6 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:40.873531 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 148/298] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 12:59:40.881746 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ebe25-5228-4e72-9eee-8cab06b9cd60 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:40.882536 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ebe25-5228-4e72-9eee-8cab06b9cd60 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:40.883288 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ebe25-5228-4e72-9eee-8cab06b9cd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:40.904327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-074ebe25-5228-4e72-9eee-8cab06b9cd60 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:40.906041 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-074ebe25-5228-4e72-9eee-8cab06b9cd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:40.954752 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049d9b2-9d41-4cbe-a4ff-76b5a3e16fc5 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:40.978912 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 149/299] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 12:59:40.991411 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b4ef6-425a-4bb0-9515-78a478369a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:40.992266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b4ef6-425a-4bb0-9515-78a478369a42 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:40.992705 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b4ef6-425a-4bb0-9515-78a478369a42 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:40.993242 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b4ef6-425a-4bb0-9515-78a478369a42 None admin] PATH_INFO: `/v3/groups` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:40.994074 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b4ef6-425a-4bb0-9515-78a478369a42 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:40.995679 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b4ef6-425a-4bb0-9515-78a478369a42 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:41.003133 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ebe25-5228-4e72-9eee-8cab06b9cd60 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:41.067181 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 151/300] 10.222.0.52 () {60 vars in 1134 bytes} [Tue Mar 8 12:59:40 2022] POST /identity/v3/groups => generated 229 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:59:41.068784 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8f81d-490c-442e-9b87-ba3649e8f003 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:41.069254 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8f81d-490c-442e-9b87-ba3649e8f003 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:41.069695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8f81d-490c-442e-9b87-ba3649e8f003 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:41.071708 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 152/301] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:41.078287 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76117964-d2ba-4df4-b90a-c25a8d5849e7 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:41.078804 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76117964-d2ba-4df4-b90a-c25a8d5849e7 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:41.079225 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76117964-d2ba-4df4-b90a-c25a8d5849e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:41.099135 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-76117964-d2ba-4df4-b90a-c25a8d5849e7 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:41.100688 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-76117964-d2ba-4df4-b90a-c25a8d5849e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:41.125457 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ebe25-5228-4e72-9eee-8cab06b9cd60 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:41.166891 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d75a4-4c18-44f2-a829-c5d84c9198b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:41.167995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d75a4-4c18-44f2-a829-c5d84c9198b4 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:41.168451 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d75a4-4c18-44f2-a829-c5d84c9198b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:41.169622 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d75a4-4c18-44f2-a829-c5d84c9198b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:41.178028 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 153/302] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:41.184856 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d75a4-4c18-44f2-a829-c5d84c9198b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:41.190144 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-9c9d75a4-4c18-44f2-a829-c5d84c9198b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 12:59:41.191428 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 150/303] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 12:59:41.198152 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76117964-d2ba-4df4-b90a-c25a8d5849e7 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:41.202776 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d75a4-4c18-44f2-a829-c5d84c9198b4 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:41.317192 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76117964-d2ba-4df4-b90a-c25a8d5849e7 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:41.341476 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d75a4-4c18-44f2-a829-c5d84c9198b4 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:41.362251 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbdab1-bc4b-4f34-8a95-37e8d8084eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:41.362935 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbdab1-bc4b-4f34-8a95-37e8d8084eb0 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:41.363217 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbdab1-bc4b-4f34-8a95-37e8d8084eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:41.363492 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbdab1-bc4b-4f34-8a95-37e8d8084eb0 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:41.364245 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbdab1-bc4b-4f34-8a95-37e8d8084eb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:41.364549 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbdab1-bc4b-4f34-8a95-37e8d8084eb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:41.365984 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbdab1-bc4b-4f34-8a95-37e8d8084eb0 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:41.375364 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 154/304] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:41.381077 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbdab1-bc4b-4f34-8a95-37e8d8084eb0 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:41.384532 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d599177-4cb5-409d-bbbf-f61654d0ec70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:41.385439 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d599177-4cb5-409d-bbbf-f61654d0ec70 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:41.385810 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d599177-4cb5-409d-bbbf-f61654d0ec70 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:41.386157 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d599177-4cb5-409d-bbbf-f61654d0ec70 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:41.404376 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d599177-4cb5-409d-bbbf-f61654d0ec70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:41.414007 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-2d599177-4cb5-409d-bbbf-f61654d0ec70 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 12:59:41.416393 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 151/305] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 12:59:41.422421 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d599177-4cb5-409d-bbbf-f61654d0ec70 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:41.497701 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbdab1-bc4b-4f34-8a95-37e8d8084eb0 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:41.522770 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d599177-4cb5-409d-bbbf-f61654d0ec70 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:41.531391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2559c4-f55a-47f8-873c-dfec57662ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:41.532268 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2559c4-f55a-47f8-873c-dfec57662ac1 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:41.532543 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2559c4-f55a-47f8-873c-dfec57662ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:41.532863 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2559c4-f55a-47f8-873c-dfec57662ac1 None admin] PATH_INFO: `/v3/users/2c2e2e96f3f74965829e7daa6c8c2bb7` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:41.534095 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2559c4-f55a-47f8-873c-dfec57662ac1 None admin] RBAC: Authorizing `identity:get_user(user_id=2c2e2e96f3f74965829e7daa6c8c2bb7)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:41.535582 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2559c4-f55a-47f8-873c-dfec57662ac1 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:41.537536 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 155/306] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:41 2022] GET /identity/v3/users/2c2e2e96f3f74965829e7daa6c8c2bb7 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:41.542586 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2559c4-f55a-47f8-873c-dfec57662ac1 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:41.560619 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee41eaa-0efc-486d-9b00-57d7ac781dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:41.561806 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee41eaa-0efc-486d-9b00-57d7ac781dd8 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:41.567850 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee41eaa-0efc-486d-9b00-57d7ac781dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:41.567850 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee41eaa-0efc-486d-9b00-57d7ac781dd8 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:41.567850 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee41eaa-0efc-486d-9b00-57d7ac781dd8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:41.567850 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee41eaa-0efc-486d-9b00-57d7ac781dd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:41.567850 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee41eaa-0efc-486d-9b00-57d7ac781dd8 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:41.578686 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 152/307] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:41.584044 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee41eaa-0efc-486d-9b00-57d7ac781dd8 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:41.651496 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2559c4-f55a-47f8-873c-dfec57662ac1 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:41.687846 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1a41a-b16c-498e-a101-4f059686b0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:41.689030 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1a41a-b16c-498e-a101-4f059686b0d2 None admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:41.689486 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1a41a-b16c-498e-a101-4f059686b0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:41.689905 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1a41a-b16c-498e-a101-4f059686b0d2 None admin] PATH_INFO: `/v3/system/users/2c2e2e96f3f74965829e7daa6c8c2bb7/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:41.691645 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1a41a-b16c-498e-a101-4f059686b0d2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2c2e2e96f3f74965829e7daa6c8c2bb7, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:41.693278 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1a41a-b16c-498e-a101-4f059686b0d2 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:41.705173 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee41eaa-0efc-486d-9b00-57d7ac781dd8 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:41.736976 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45759cb5-7e19-4855-8415-80b9a2077146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:41.737831 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45759cb5-7e19-4855-8415-80b9a2077146 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:41.738111 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45759cb5-7e19-4855-8415-80b9a2077146 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:41.738381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45759cb5-7e19-4855-8415-80b9a2077146 None admin] PATH_INFO: `/v3/users/0b811fca230146acab1b65414979d58b` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:41.751336 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45759cb5-7e19-4855-8415-80b9a2077146 None admin] RBAC: Authorizing `identity:get_user(user_id=0b811fca230146acab1b65414979d58b)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:41.752784 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45759cb5-7e19-4855-8415-80b9a2077146 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:41.754410 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 153/308] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:41 2022] GET /identity/v3/users/0b811fca230146acab1b65414979d58b => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:41.755570 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83040072-cc18-451a-b4f8-bc951f9532b7 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:41.755849 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83040072-cc18-451a-b4f8-bc951f9532b7 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:41.756116 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83040072-cc18-451a-b4f8-bc951f9532b7 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:41.757936 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 154/309] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:41.759958 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83040072-cc18-451a-b4f8-bc951f9532b7 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:41.782608 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 156/310] 10.222.0.52 () {58 vars in 1334 bytes} [Tue Mar 8 12:59:41 2022] PUT /identity/v3/system/users/2c2e2e96f3f74965829e7daa6c8c2bb7/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:59:41.790257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d4e17-3861-43ae-b5e9-564a6b90c153 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:41.790832 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d4e17-3861-43ae-b5e9-564a6b90c153 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:41.791291 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d4e17-3861-43ae-b5e9-564a6b90c153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:41.817432 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-a66d4e17-3861-43ae-b5e9-564a6b90c153 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:41.819147 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a66d4e17-3861-43ae-b5e9-564a6b90c153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:41.879146 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83040072-cc18-451a-b4f8-bc951f9532b7 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:41.915731 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 157/311] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:41.921560 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e006c09-deeb-40d2-a55a-99d670f15ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:41.922510 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e006c09-deeb-40d2-a55a-99d670f15ec0 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:41.922966 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e006c09-deeb-40d2-a55a-99d670f15ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:41.923372 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e006c09-deeb-40d2-a55a-99d670f15ec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:41.924440 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e006c09-deeb-40d2-a55a-99d670f15ec0 None admin] RBAC: Adding query filter params (role.id=02b083eae38b4e7ba220f1d1a33e43a4, user.id=0b811fca230146acab1b65414979d58b, scope.system=all) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:41.925040 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e006c09-deeb-40d2-a55a-99d670f15ec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:41.926743 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e006c09-deeb-40d2-a55a-99d670f15ec0 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:41.933244 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 155/312] 10.222.0.52 () {56 vars in 1308 bytes} [Tue Mar 8 12:59:41 2022] GET /identity/v3/role_assignments?user.id=0b811fca230146acab1b65414979d58b&scope.system=all&role.id=02b083eae38b4e7ba220f1d1a33e43a4 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:41.939137 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d4e17-3861-43ae-b5e9-564a6b90c153 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:42.060861 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d4e17-3861-43ae-b5e9-564a6b90c153 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:42.099276 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f54c7-e928-41cf-b8a7-4d9a39f9afa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:42.100798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f54c7-e928-41cf-b8a7-4d9a39f9afa1 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:42.100798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f54c7-e928-41cf-b8a7-4d9a39f9afa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:42.100798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f54c7-e928-41cf-b8a7-4d9a39f9afa1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:42.113364 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f54c7-e928-41cf-b8a7-4d9a39f9afa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:42.120495 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-e01f54c7-e928-41cf-b8a7-4d9a39f9afa1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 12:59:42.121849 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 158/313] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:42.127958 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e006c09-deeb-40d2-a55a-99d670f15ec0 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:42.235962 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e006c09-deeb-40d2-a55a-99d670f15ec0 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:42.393508 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a065c7-e466-4ef8-aa82-e5ae7e8cf6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:42.394152 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a065c7-e466-4ef8-aa82-e5ae7e8cf6e3 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:42.394470 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a065c7-e466-4ef8-aa82-e5ae7e8cf6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:42.394757 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a065c7-e466-4ef8-aa82-e5ae7e8cf6e3 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:42.395508 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a065c7-e466-4ef8-aa82-e5ae7e8cf6e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:42.395813 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a065c7-e466-4ef8-aa82-e5ae7e8cf6e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:42.397218 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a065c7-e466-4ef8-aa82-e5ae7e8cf6e3 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:42.407526 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 156/314] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:42.413899 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f54c7-e928-41cf-b8a7-4d9a39f9afa1 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:42.529689 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f54c7-e928-41cf-b8a7-4d9a39f9afa1 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:42.566299 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c4223-917f-4c9e-9697-dcb9dd765ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:42.567172 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c4223-917f-4c9e-9697-dcb9dd765ad2 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:42.567444 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c4223-917f-4c9e-9697-dcb9dd765ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:42.567731 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c4223-917f-4c9e-9697-dcb9dd765ad2 None admin] PATH_INFO: `/v3/users/a4a518a6b6df40278ca501d994cd2d97` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:42.569983 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c4223-917f-4c9e-9697-dcb9dd765ad2 None admin] RBAC: Authorizing `identity:get_user(user_id=a4a518a6b6df40278ca501d994cd2d97)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:42.570767 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c4223-917f-4c9e-9697-dcb9dd765ad2 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:42.573243 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 159/315] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:42 2022] GET /identity/v3/users/a4a518a6b6df40278ca501d994cd2d97 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:42.578384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a065c7-e466-4ef8-aa82-e5ae7e8cf6e3 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:42.682269 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a065c7-e466-4ef8-aa82-e5ae7e8cf6e3 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:42.731150 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1211e-b16e-45d4-aea6-e04cf73bd4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:42.732881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1211e-b16e-45d4-aea6-e04cf73bd4dd None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:42.733396 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1211e-b16e-45d4-aea6-e04cf73bd4dd None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:42.733873 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1211e-b16e-45d4-aea6-e04cf73bd4dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:42.832461 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1211e-b16e-45d4-aea6-e04cf73bd4dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:42.834373 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1211e-b16e-45d4-aea6-e04cf73bd4dd None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:42.971748 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 157/316] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:42.977084 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c4223-917f-4c9e-9697-dcb9dd765ad2 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:43.080421 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c4223-917f-4c9e-9697-dcb9dd765ad2 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:43.116866 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618d63e-510c-4db3-b1d1-0a3cccc8fee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:43.117728 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618d63e-510c-4db3-b1d1-0a3cccc8fee0 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:43.118005 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618d63e-510c-4db3-b1d1-0a3cccc8fee0 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:43.118276 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618d63e-510c-4db3-b1d1-0a3cccc8fee0 None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:43.119453 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618d63e-510c-4db3-b1d1-0a3cccc8fee0 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ce0a6eef414c84f1dabaf084bd68)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:43.120935 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618d63e-510c-4db3-b1d1-0a3cccc8fee0 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:43.122951 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 160/317] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:42 2022] GET /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:43.128789 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1211e-b16e-45d4-aea6-e04cf73bd4dd None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:43.231966 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1211e-b16e-45d4-aea6-e04cf73bd4dd None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:43.267047 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09c7b2-db24-4ef5-af6b-7632fe4f0bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:43.268062 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09c7b2-db24-4ef5-af6b-7632fe4f0bca None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:43.268577 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09c7b2-db24-4ef5-af6b-7632fe4f0bca None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:43.269084 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09c7b2-db24-4ef5-af6b-7632fe4f0bca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:43.270171 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09c7b2-db24-4ef5-af6b-7632fe4f0bca None admin] RBAC: Adding query filter params (role.id=02b083eae38b4e7ba220f1d1a33e43a4, scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68, user.id=a4a518a6b6df40278ca501d994cd2d97) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:43.270707 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09c7b2-db24-4ef5-af6b-7632fe4f0bca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:43.272455 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09c7b2-db24-4ef5-af6b-7632fe4f0bca None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:43.280038 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 158/318] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 12:59:43 2022] GET /identity/v3/role_assignments?user.id=a4a518a6b6df40278ca501d994cd2d97&scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68&role.id=02b083eae38b4e7ba220f1d1a33e43a4 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:43.676150 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a03cc1-c079-4c19-aac2-9a0f69e04dc9 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:43.676641 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a03cc1-c079-4c19-aac2-9a0f69e04dc9 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:43.676750 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a03cc1-c079-4c19-aac2-9a0f69e04dc9 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:43.678672 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 161/319] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:43.683625 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddf554-a97d-4a4b-9a75-fd8d11c939c4 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:43.684018 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddf554-a97d-4a4b-9a75-fd8d11c939c4 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:43.684871 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddf554-a97d-4a4b-9a75-fd8d11c939c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:43.701262 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-0cddf554-a97d-4a4b-9a75-fd8d11c939c4 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:43.702426 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-0cddf554-a97d-4a4b-9a75-fd8d11c939c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:43.766770 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 159/320] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:43.789245 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a03cc1-c079-4c19-aac2-9a0f69e04dc9 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:43.890971 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a03cc1-c079-4c19-aac2-9a0f69e04dc9 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:43.923368 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c24bd0-cbb8-4cb4-aedb-83a8d7cf4d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:43.924180 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c24bd0-cbb8-4cb4-aedb-83a8d7cf4d84 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:43.924459 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c24bd0-cbb8-4cb4-aedb-83a8d7cf4d84 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:43.924759 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c24bd0-cbb8-4cb4-aedb-83a8d7cf4d84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:43.926003 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c24bd0-cbb8-4cb4-aedb-83a8d7cf4d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:43.927553 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c24bd0-cbb8-4cb4-aedb-83a8d7cf4d84 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:43.929477 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 162/321] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 12:59:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:43.935587 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddf554-a97d-4a4b-9a75-fd8d11c939c4 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:44.032776 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddf554-a97d-4a4b-9a75-fd8d11c939c4 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:44.065963 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b0ee6-f947-48ad-bede-1f4a4dd31fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:44.066625 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b0ee6-f947-48ad-bede-1f4a4dd31fcf None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:44.066905 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b0ee6-f947-48ad-bede-1f4a4dd31fcf None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:44.067175 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b0ee6-f947-48ad-bede-1f4a4dd31fcf None admin] PATH_INFO: `/v3/groups` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:44.067861 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b0ee6-f947-48ad-bede-1f4a4dd31fcf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:44.069316 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b0ee6-f947-48ad-bede-1f4a4dd31fcf None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:44.235171 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 160/322] 10.222.0.52 () {60 vars in 1134 bytes} [Tue Mar 8 12:59:43 2022] POST /identity/v3/groups => generated 226 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:59:44.304887 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb6e88-414d-4620-8e0f-c222e3496da3 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:44.305173 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb6e88-414d-4620-8e0f-c222e3496da3 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:44.305638 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb6e88-414d-4620-8e0f-c222e3496da3 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:44.307451 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 163/323] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:44.314021 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85533969-ec1e-4945-9505-f6420383ef5f None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:44.314310 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85533969-ec1e-4945-9505-f6420383ef5f None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:44.314762 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85533969-ec1e-4945-9505-f6420383ef5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:44.332651 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-85533969-ec1e-4945-9505-f6420383ef5f None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:44.333904 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-85533969-ec1e-4945-9505-f6420383ef5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:44.406682 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 161/324] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:44.430003 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb6e88-414d-4620-8e0f-c222e3496da3 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:44.484021 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607d6e1-8c7b-4903-a5c3-3c46e6fcd2e9 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:44.484348 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607d6e1-8c7b-4903-a5c3-3c46e6fcd2e9 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:44.484577 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607d6e1-8c7b-4903-a5c3-3c46e6fcd2e9 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:44.486587 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 162/325] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 12:59:44.491469 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d769ce-acf0-45f0-9a35-87e164814b5d None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:44.491764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d769ce-acf0-45f0-9a35-87e164814b5d None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:44.492038 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d769ce-acf0-45f0-9a35-87e164814b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:44.509926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-24d769ce-acf0-45f0-9a35-87e164814b5d None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:44.511414 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-24d769ce-acf0-45f0-9a35-87e164814b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:44.540409 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb6e88-414d-4620-8e0f-c222e3496da3 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:44.578296 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffa2c6-d0fd-4837-8e3e-4110f2e6988d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:44.579562 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffa2c6-d0fd-4837-8e3e-4110f2e6988d None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:44.579996 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffa2c6-d0fd-4837-8e3e-4110f2e6988d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:44.580279 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffa2c6-d0fd-4837-8e3e-4110f2e6988d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:44.594093 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffa2c6-d0fd-4837-8e3e-4110f2e6988d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:44.596389 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 163/326] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 12:59:44.601114 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-06ffa2c6-d0fd-4837-8e3e-4110f2e6988d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 12:59:44.602539 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 164/327] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:44.609099 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d769ce-acf0-45f0-9a35-87e164814b5d None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:44.621390 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffa2c6-d0fd-4837-8e3e-4110f2e6988d None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:44.719967 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d769ce-acf0-45f0-9a35-87e164814b5d None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:44.735518 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffa2c6-d0fd-4837-8e3e-4110f2e6988d None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:44.759331 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6f3e4-2f64-47dc-9ad4-4eeac47d82bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:44.760407 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6f3e4-2f64-47dc-9ad4-4eeac47d82bd None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:44.760926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6f3e4-2f64-47dc-9ad4-4eeac47d82bd None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:44.761437 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6f3e4-2f64-47dc-9ad4-4eeac47d82bd None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:44.762928 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6f3e4-2f64-47dc-9ad4-4eeac47d82bd None admin] RBAC: Adding query filter params (name=member) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:44.763442 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6f3e4-2f64-47dc-9ad4-4eeac47d82bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:44.765073 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6f3e4-2f64-47dc-9ad4-4eeac47d82bd None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:44.769441 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444c374-5c55-4cc2-b3aa-1bfe5d8f8b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:44.770237 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444c374-5c55-4cc2-b3aa-1bfe5d8f8b47 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:44.770515 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444c374-5c55-4cc2-b3aa-1bfe5d8f8b47 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:44.770788 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444c374-5c55-4cc2-b3aa-1bfe5d8f8b47 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:44.775856 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 164/328] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:44.787056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6f3e4-2f64-47dc-9ad4-4eeac47d82bd None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:44.787231 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444c374-5c55-4cc2-b3aa-1bfe5d8f8b47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:44.795350 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-e444c374-5c55-4cc2-b3aa-1bfe5d8f8b47 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 12:59:44.800684 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 165/329] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 12:59:44.803000 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444c374-5c55-4cc2-b3aa-1bfe5d8f8b47 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:44.927071 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444c374-5c55-4cc2-b3aa-1bfe5d8f8b47 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:44.931450 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6f3e4-2f64-47dc-9ad4-4eeac47d82bd None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:44.968261 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b7037-70fa-47b8-a9f8-c33107dd1288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:44.969386 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b7037-70fa-47b8-a9f8-c33107dd1288 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:44.969899 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b7037-70fa-47b8-a9f8-c33107dd1288 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:44.970412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b7037-70fa-47b8-a9f8-c33107dd1288 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:44.971468 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b7037-70fa-47b8-a9f8-c33107dd1288 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:44.971986 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b7037-70fa-47b8-a9f8-c33107dd1288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:44.973386 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec01b4-2ff4-40a3-8ca1-e8651e059203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:44.973887 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b7037-70fa-47b8-a9f8-c33107dd1288 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:44.974252 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec01b4-2ff4-40a3-8ca1-e8651e059203 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:44.974570 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec01b4-2ff4-40a3-8ca1-e8651e059203 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:44.974839 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec01b4-2ff4-40a3-8ca1-e8651e059203 None admin] PATH_INFO: `/v3/users/2c2e2e96f3f74965829e7daa6c8c2bb7` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:44.977340 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec01b4-2ff4-40a3-8ca1-e8651e059203 None admin] RBAC: Authorizing `identity:get_user(user_id=2c2e2e96f3f74965829e7daa6c8c2bb7)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:44.979304 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec01b4-2ff4-40a3-8ca1-e8651e059203 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:44.981613 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 165/330] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:44 2022] GET /identity/v3/users/2c2e2e96f3f74965829e7daa6c8c2bb7 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:44.988088 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec01b4-2ff4-40a3-8ca1-e8651e059203 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:44.994530 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 166/331] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:44.996044 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b7037-70fa-47b8-a9f8-c33107dd1288 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:45.107869 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec01b4-2ff4-40a3-8ca1-e8651e059203 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:45.112797 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b7037-70fa-47b8-a9f8-c33107dd1288 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:45.155557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058a264-2a4a-4172-9732-1e7e4ac10062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:45.156122 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0816cc-8098-4e34-b5be-8f99abaa686e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:45.156808 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0816cc-8098-4e34-b5be-8f99abaa686e None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:45.157088 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0816cc-8098-4e34-b5be-8f99abaa686e None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:45.157359 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0816cc-8098-4e34-b5be-8f99abaa686e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:45.157788 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058a264-2a4a-4172-9732-1e7e4ac10062 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:45.158195 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0816cc-8098-4e34-b5be-8f99abaa686e None admin] RBAC: Adding query filter params (role.id=e34b765cca514a83bef6eb9cff7ef871, user.id=2c2e2e96f3f74965829e7daa6c8c2bb7, scope.system=all) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:45.158470 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058a264-2a4a-4172-9732-1e7e4ac10062 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:45.158578 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0816cc-8098-4e34-b5be-8f99abaa686e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:45.159042 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058a264-2a4a-4172-9732-1e7e4ac10062 None admin] PATH_INFO: `/v3/users/0b811fca230146acab1b65414979d58b` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:45.160091 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0816cc-8098-4e34-b5be-8f99abaa686e None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:45.160722 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058a264-2a4a-4172-9732-1e7e4ac10062 None admin] RBAC: Authorizing `identity:get_user(user_id=0b811fca230146acab1b65414979d58b)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:45.162378 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058a264-2a4a-4172-9732-1e7e4ac10062 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:45.166688 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 167/332] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:44 2022] GET /identity/v3/users/0b811fca230146acab1b65414979d58b => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:45.171699 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058a264-2a4a-4172-9732-1e7e4ac10062 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:45.174827 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 166/333] 10.222.0.52 () {56 vars in 1308 bytes} [Tue Mar 8 12:59:44 2022] GET /identity/v3/role_assignments?user.id=2c2e2e96f3f74965829e7daa6c8c2bb7&scope.system=all&role.id=e34b765cca514a83bef6eb9cff7ef871 => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:45.419560 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058a264-2a4a-4172-9732-1e7e4ac10062 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:45.455142 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20150b10-9ace-442e-9c78-8eba153deb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:45.456018 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20150b10-9ace-442e-9c78-8eba153deb3e None admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:45.456304 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20150b10-9ace-442e-9c78-8eba153deb3e None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:45.456580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20150b10-9ace-442e-9c78-8eba153deb3e None admin] PATH_INFO: `/v3/system/users/0b811fca230146acab1b65414979d58b/roles/02b083eae38b4e7ba220f1d1a33e43a4` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:45.458159 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20150b10-9ace-442e-9c78-8eba153deb3e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0b811fca230146acab1b65414979d58b, role_id=02b083eae38b4e7ba220f1d1a33e43a4)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:45.459546 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20150b10-9ace-442e-9c78-8eba153deb3e None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:45.550465 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 168/334] 10.222.0.52 () {58 vars in 1334 bytes} [Tue Mar 8 12:59:45 2022] PUT /identity/v3/system/users/0b811fca230146acab1b65414979d58b/roles/02b083eae38b4e7ba220f1d1a33e43a4 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:59:47.345515 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fefb9-58a6-49a4-ba82-b34d382b0e2d None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:47.345515 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fefb9-58a6-49a4-ba82-b34d382b0e2d None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:47.345515 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fefb9-58a6-49a4-ba82-b34d382b0e2d None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:47.346568 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 167/335] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:47.352176 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5310a-e6ee-4722-921a-95738ad1624a None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:47.353008 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5310a-e6ee-4722-921a-95738ad1624a None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:47.353498 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5310a-e6ee-4722-921a-95738ad1624a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:47.374077 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-39b5310a-e6ee-4722-921a-95738ad1624a None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:47.375675 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-39b5310a-e6ee-4722-921a-95738ad1624a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:47.448502 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 169/336] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:47.491987 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fefb9-58a6-49a4-ba82-b34d382b0e2d None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:47.625472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fefb9-58a6-49a4-ba82-b34d382b0e2d None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:47.659739 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ec32c-ac2e-46fe-a247-19df41318ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:47.660532 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ec32c-ac2e-46fe-a247-19df41318ab2 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:47.660900 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ec32c-ac2e-46fe-a247-19df41318ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:47.661177 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ec32c-ac2e-46fe-a247-19df41318ab2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:47.674595 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ec32c-ac2e-46fe-a247-19df41318ab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:47.681506 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-c96ec32c-ac2e-46fe-a247-19df41318ab2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 12:59:47.683012 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 168/337] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:47.690305 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5310a-e6ee-4722-921a-95738ad1624a None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:47.833430 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5310a-e6ee-4722-921a-95738ad1624a None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:47.878503 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec8060-1d5e-452a-aaf7-c85505c45ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:47.879501 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec8060-1d5e-452a-aaf7-c85505c45ad2 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:47.880003 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec8060-1d5e-452a-aaf7-c85505c45ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:47.880474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec8060-1d5e-452a-aaf7-c85505c45ad2 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:47.881447 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec8060-1d5e-452a-aaf7-c85505c45ad2 None admin] RBAC: Adding query filter params (name=member) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:47.881965 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec8060-1d5e-452a-aaf7-c85505c45ad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:47.883648 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec8060-1d5e-452a-aaf7-c85505c45ad2 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:47.896013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 170/338] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:47.901598 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ec32c-ac2e-46fe-a247-19df41318ab2 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:48.038833 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ec32c-ac2e-46fe-a247-19df41318ab2 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:48.077963 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c851a19-07b7-4625-92dd-5b7c648cc114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:48.078611 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c851a19-07b7-4625-92dd-5b7c648cc114 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:48.078888 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c851a19-07b7-4625-92dd-5b7c648cc114 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:48.079219 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c851a19-07b7-4625-92dd-5b7c648cc114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:48.138092 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fbf6b-9b2b-44be-aa8e-c823e3fd4136 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:48.138700 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fbf6b-9b2b-44be-aa8e-c823e3fd4136 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:48.139179 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fbf6b-9b2b-44be-aa8e-c823e3fd4136 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:48.141430 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 171/339] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:48.149719 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc7606-121b-456d-8fd5-cb2d704f8507 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:48.150713 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc7606-121b-456d-8fd5-cb2d704f8507 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:48.151272 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc7606-121b-456d-8fd5-cb2d704f8507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:48.174227 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c851a19-07b7-4625-92dd-5b7c648cc114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:48.175698 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c851a19-07b7-4625-92dd-5b7c648cc114 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:48.178022 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-3cfc7606-121b-456d-8fd5-cb2d704f8507 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:48.179417 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-3cfc7606-121b-456d-8fd5-cb2d704f8507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:48.284172 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 172/340] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:48.326366 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc7606-121b-456d-8fd5-cb2d704f8507 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:48.352726 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 169/341] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:48.354639 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c851a19-07b7-4625-92dd-5b7c648cc114 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:48.450677 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc7606-121b-456d-8fd5-cb2d704f8507 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:48.482306 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c851a19-07b7-4625-92dd-5b7c648cc114 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:48.487207 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366a845-ffb1-44e5-8bad-ac5376af753a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:48.488218 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366a845-ffb1-44e5-8bad-ac5376af753a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:48.488745 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366a845-ffb1-44e5-8bad-ac5376af753a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:48.489199 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366a845-ffb1-44e5-8bad-ac5376af753a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:48.500450 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366a845-ffb1-44e5-8bad-ac5376af753a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:48.508494 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-5366a845-ffb1-44e5-8bad-ac5376af753a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 12:59:48.513001 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 173/342] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 12:59:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:48.514726 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684cdc1-59a2-4dd2-ac0e-7afbed713ea0 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:48.515309 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684cdc1-59a2-4dd2-ac0e-7afbed713ea0 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:48.516715 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684cdc1-59a2-4dd2-ac0e-7afbed713ea0 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:48.518913 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 174/343] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:48.519866 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684cdc1-59a2-4dd2-ac0e-7afbed713ea0 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:48.530598 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47dd6c-0bbb-48ed-802d-addffe6b423e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:48.531536 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47dd6c-0bbb-48ed-802d-addffe6b423e None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:48.531881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47dd6c-0bbb-48ed-802d-addffe6b423e None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:48.532221 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47dd6c-0bbb-48ed-802d-addffe6b423e None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:48.533549 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47dd6c-0bbb-48ed-802d-addffe6b423e None admin] RBAC: Authorizing `identity:get_project(project_id=5e8582daaa764afcaf9c73a4aab00169)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:48.535129 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47dd6c-0bbb-48ed-802d-addffe6b423e None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:48.537719 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 170/344] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:48 2022] GET /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:48.538631 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e3279-c7d6-4dad-a228-ab98603707c1 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:48.539141 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e3279-c7d6-4dad-a228-ab98603707c1 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:48.539606 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e3279-c7d6-4dad-a228-ab98603707c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:48.557732 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-645e3279-c7d6-4dad-a228-ab98603707c1 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:48.559341 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-645e3279-c7d6-4dad-a228-ab98603707c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:48.628312 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 171/345] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:48.633765 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e3279-c7d6-4dad-a228-ab98603707c1 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:48.684266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684cdc1-59a2-4dd2-ac0e-7afbed713ea0 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:48.722226 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81ef1b-6d46-4ead-b3af-5b35f180c5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:48.723135 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81ef1b-6d46-4ead-b3af-5b35f180c5ac None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:48.723581 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81ef1b-6d46-4ead-b3af-5b35f180c5ac None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:48.724067 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81ef1b-6d46-4ead-b3af-5b35f180c5ac None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:48.725071 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81ef1b-6d46-4ead-b3af-5b35f180c5ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:48.725580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81ef1b-6d46-4ead-b3af-5b35f180c5ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:48.728299 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81ef1b-6d46-4ead-b3af-5b35f180c5ac None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:48.737717 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 175/346] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 12:59:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:48.739080 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81ef1b-6d46-4ead-b3af-5b35f180c5ac None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:48.750200 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e3279-c7d6-4dad-a228-ab98603707c1 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:48.786983 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee336c5-b47f-42be-afea-ef000c3e14dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:48.788184 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee336c5-b47f-42be-afea-ef000c3e14dd None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:48.788725 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee336c5-b47f-42be-afea-ef000c3e14dd None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:48.789211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee336c5-b47f-42be-afea-ef000c3e14dd None admin] PATH_INFO: `/v3/groups/400a83e783324df3a27d637435d3a6b2` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:48.797576 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee336c5-b47f-42be-afea-ef000c3e14dd None admin] RBAC: Authorizing `identity:get_group(group_id=400a83e783324df3a27d637435d3a6b2)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:48.800070 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee336c5-b47f-42be-afea-ef000c3e14dd None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:48.802351 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 172/347] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 12:59:48 2022] GET /identity/v3/groups/400a83e783324df3a27d637435d3a6b2 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:48.803371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee336c5-b47f-42be-afea-ef000c3e14dd None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:48.855181 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81ef1b-6d46-4ead-b3af-5b35f180c5ac None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:48.897845 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2922f50-8f33-43fa-be57-fa23a1c99cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:48.898887 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2922f50-8f33-43fa-be57-fa23a1c99cb3 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:48.899336 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2922f50-8f33-43fa-be57-fa23a1c99cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:48.899737 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2922f50-8f33-43fa-be57-fa23a1c99cb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:48.912445 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2922f50-8f33-43fa-be57-fa23a1c99cb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:48.919897 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-a2922f50-8f33-43fa-be57-fa23a1c99cb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 12:59:48.921809 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 176/348] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:48.922910 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2922f50-8f33-43fa-be57-fa23a1c99cb3 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:48.937494 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee336c5-b47f-42be-afea-ef000c3e14dd None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:48.996557 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e5945-0ad8-4bf5-8d12-e5dc2d4adc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:48.997256 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e5945-0ad8-4bf5-8d12-e5dc2d4adc69 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:48.997542 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e5945-0ad8-4bf5-8d12-e5dc2d4adc69 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:48.997815 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e5945-0ad8-4bf5-8d12-e5dc2d4adc69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:49.032039 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2922f50-8f33-43fa-be57-fa23a1c99cb3 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:49.073106 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066337d5-1e3d-474d-a806-9fd13b3ff896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:49.074135 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066337d5-1e3d-474d-a806-9fd13b3ff896 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:49.075169 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066337d5-1e3d-474d-a806-9fd13b3ff896 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:49.075756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066337d5-1e3d-474d-a806-9fd13b3ff896 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:49.076838 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066337d5-1e3d-474d-a806-9fd13b3ff896 None admin] RBAC: Adding query filter params (group.id=400a83e783324df3a27d637435d3a6b2, role.id=e34b765cca514a83bef6eb9cff7ef871, scope.project.id=5e8582daaa764afcaf9c73a4aab00169) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:49.077373 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066337d5-1e3d-474d-a806-9fd13b3ff896 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:49.079030 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066337d5-1e3d-474d-a806-9fd13b3ff896 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:49.086122 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 177/349] 10.222.0.52 () {56 vars in 1376 bytes} [Tue Mar 8 12:59:48 2022] GET /identity/v3/role_assignments?group.id=400a83e783324df3a27d637435d3a6b2&scope.project.id=5e8582daaa764afcaf9c73a4aab00169&role.id=e34b765cca514a83bef6eb9cff7ef871 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:49.087436 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066337d5-1e3d-474d-a806-9fd13b3ff896 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:49.222612 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066337d5-1e3d-474d-a806-9fd13b3ff896 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:49.245581 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e5945-0ad8-4bf5-8d12-e5dc2d4adc69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:49.247151 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e5945-0ad8-4bf5-8d12-e5dc2d4adc69 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:49.272277 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bad1f-308b-4fc0-a3e3-9b8048c05233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:49.272992 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bad1f-308b-4fc0-a3e3-9b8048c05233 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:49.273276 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bad1f-308b-4fc0-a3e3-9b8048c05233 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:49.273549 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bad1f-308b-4fc0-a3e3-9b8048c05233 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:49.274313 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bad1f-308b-4fc0-a3e3-9b8048c05233 None admin] RBAC: Adding query filter params (name=member) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:49.274621 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bad1f-308b-4fc0-a3e3-9b8048c05233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:49.276364 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bad1f-308b-4fc0-a3e3-9b8048c05233 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:49.296330 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 178/350] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:49.297864 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9c442-6452-461a-a7b3-5299dc7308b3 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:49.298161 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9c442-6452-461a-a7b3-5299dc7308b3 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:49.298435 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9c442-6452-461a-a7b3-5299dc7308b3 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:49.300230 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 179/351] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:49.301076 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9c442-6452-461a-a7b3-5299dc7308b3 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:49.451343 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9c442-6452-461a-a7b3-5299dc7308b3 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:49.460438 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 173/352] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:49.462407 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e3dfe-78bb-4d4d-85af-720f0615a146 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:49.462855 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e3dfe-78bb-4d4d-85af-720f0615a146 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:49.463257 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e3dfe-78bb-4d4d-85af-720f0615a146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:49.494608 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-7f9e3dfe-78bb-4d4d-85af-720f0615a146 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:49.496723 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7f9e3dfe-78bb-4d4d-85af-720f0615a146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:49.514058 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35d469-a779-4c8b-83b8-1bcd44b50a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:49.515044 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35d469-a779-4c8b-83b8-1bcd44b50a9d None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:49.515590 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35d469-a779-4c8b-83b8-1bcd44b50a9d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:49.516056 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35d469-a779-4c8b-83b8-1bcd44b50a9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:49.583716 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 174/353] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:49.589106 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353927f-e783-446f-8ea8-8ea7d5cd61fe None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:49.590760 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353927f-e783-446f-8ea8-8ea7d5cd61fe None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:49.591240 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353927f-e783-446f-8ea8-8ea7d5cd61fe None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:49.594894 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 175/354] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:49.600472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353927f-e783-446f-8ea8-8ea7d5cd61fe None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:49.624070 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35d469-a779-4c8b-83b8-1bcd44b50a9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:49.626303 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35d469-a779-4c8b-83b8-1bcd44b50a9d None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:49.722050 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353927f-e783-446f-8ea8-8ea7d5cd61fe None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:49.749323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 180/355] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:49.750968 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105d116-a0f1-42fe-b498-2758ca08bac0 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:49.751539 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105d116-a0f1-42fe-b498-2758ca08bac0 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:49.752319 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105d116-a0f1-42fe-b498-2758ca08bac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:49.760462 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bfe99-bfae-4188-9c24-6c5ea229f045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:49.761361 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bfe99-bfae-4188-9c24-6c5ea229f045 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:49.762403 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bfe99-bfae-4188-9c24-6c5ea229f045 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:49.762784 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bfe99-bfae-4188-9c24-6c5ea229f045 None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:49.767014 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bfe99-bfae-4188-9c24-6c5ea229f045 None admin] RBAC: Authorizing `identity:get_project(project_id=5e8582daaa764afcaf9c73a4aab00169)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:49.767014 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bfe99-bfae-4188-9c24-6c5ea229f045 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:49.767945 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 176/356] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:49 2022] GET /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:49.772527 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bfe99-bfae-4188-9c24-6c5ea229f045 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:49.773409 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-9105d116-a0f1-42fe-b498-2758ca08bac0 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:49.774587 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9105d116-a0f1-42fe-b498-2758ca08bac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:49.852432 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 181/357] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:49.854081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fa78d-11e1-42dc-b226-8081a69ff75c None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:49.854368 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fa78d-11e1-42dc-b226-8081a69ff75c None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:49.854643 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fa78d-11e1-42dc-b226-8081a69ff75c None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:49.860792 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 182/358] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:49.861578 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fa78d-11e1-42dc-b226-8081a69ff75c None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:49.894554 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bfe99-bfae-4188-9c24-6c5ea229f045 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:49.942706 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2e252-ce84-486d-9c5d-21b5d82277ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:49.943517 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2e252-ce84-486d-9c5d-21b5d82277ea None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:49.943800 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2e252-ce84-486d-9c5d-21b5d82277ea None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:49.944078 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2e252-ce84-486d-9c5d-21b5d82277ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:49.957966 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2e252-ce84-486d-9c5d-21b5d82277ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:49.966303 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-81f2e252-ce84-486d-9c5d-21b5d82277ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 12:59:49.968000 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 177/359] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 12:59:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:49.968000 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2e252-ce84-486d-9c5d-21b5d82277ea None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:49.992396 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fa78d-11e1-42dc-b226-8081a69ff75c None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:50.037157 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd8e53-f933-4cf4-a6c4-b58c9e183861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:50.037953 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd8e53-f933-4cf4-a6c4-b58c9e183861 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:50.038245 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd8e53-f933-4cf4-a6c4-b58c9e183861 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:50.038507 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd8e53-f933-4cf4-a6c4-b58c9e183861 None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:50.039695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd8e53-f933-4cf4-a6c4-b58c9e183861 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ce0a6eef414c84f1dabaf084bd68)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:50.041189 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd8e53-f933-4cf4-a6c4-b58c9e183861 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:50.043919 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 183/360] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:49 2022] GET /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:50.045031 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1d372-e913-4e41-a6d4-9353667cf32a None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:50.045314 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1d372-e913-4e41-a6d4-9353667cf32a None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:50.045592 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1d372-e913-4e41-a6d4-9353667cf32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:50.064335 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-75b1d372-e913-4e41-a6d4-9353667cf32a None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:50.065555 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-75b1d372-e913-4e41-a6d4-9353667cf32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:50.096100 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2e252-ce84-486d-9c5d-21b5d82277ea None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:50.139810 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c86090-3705-409c-8993-ffc3bb5f7ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:50.141271 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c86090-3705-409c-8993-ffc3bb5f7ea8 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:50.141271 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c86090-3705-409c-8993-ffc3bb5f7ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:50.141437 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c86090-3705-409c-8993-ffc3bb5f7ea8 None admin] PATH_INFO: `/v3/groups/400a83e783324df3a27d637435d3a6b2` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:50.143670 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c86090-3705-409c-8993-ffc3bb5f7ea8 None admin] RBAC: Authorizing `identity:get_group(group_id=400a83e783324df3a27d637435d3a6b2)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:50.145709 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c86090-3705-409c-8993-ffc3bb5f7ea8 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:50.147145 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 178/361] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 12:59:49 2022] GET /identity/v3/groups/400a83e783324df3a27d637435d3a6b2 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:50.147865 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c86090-3705-409c-8993-ffc3bb5f7ea8 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:50.164008 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 184/362] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:50.165558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1d372-e913-4e41-a6d4-9353667cf32a None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:50.275940 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c86090-3705-409c-8993-ffc3bb5f7ea8 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:50.295513 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1d372-e913-4e41-a6d4-9353667cf32a None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:50.326796 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9674fc7-4196-4d1e-9a70-68a1871d23d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:50.327602 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9674fc7-4196-4d1e-9a70-68a1871d23d8 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:50.327886 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9674fc7-4196-4d1e-9a70-68a1871d23d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:50.328157 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9674fc7-4196-4d1e-9a70-68a1871d23d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:50.342455 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f56dd6-d1da-433e-8874-cce990584ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:50.342799 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9674fc7-4196-4d1e-9a70-68a1871d23d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:50.345553 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f56dd6-d1da-433e-8874-cce990584ca5 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:50.345553 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f56dd6-d1da-433e-8874-cce990584ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:50.345553 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f56dd6-d1da-433e-8874-cce990584ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:50.345553 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f56dd6-d1da-433e-8874-cce990584ca5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:50.345553 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f56dd6-d1da-433e-8874-cce990584ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:50.348764 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f56dd6-d1da-433e-8874-cce990584ca5 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:50.350248 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-c9674fc7-4196-4d1e-9a70-68a1871d23d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 12:59:50.351460 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 179/363] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:50.352454 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9674fc7-4196-4d1e-9a70-68a1871d23d8 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:50.365441 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 185/364] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 12:59:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:50.365766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f56dd6-d1da-433e-8874-cce990584ca5 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:50.487131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f56dd6-d1da-433e-8874-cce990584ca5 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:50.491477 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9674fc7-4196-4d1e-9a70-68a1871d23d8 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:50.531868 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad7b3f-27db-4b9f-bdba-fbf51343f31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:50.532780 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad7b3f-27db-4b9f-bdba-fbf51343f31b None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:50.533058 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad7b3f-27db-4b9f-bdba-fbf51343f31b None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:50.533337 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad7b3f-27db-4b9f-bdba-fbf51343f31b None admin] PATH_INFO: `/v3/groups/400a83e783324df3a27d637435d3a6b2` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:50.533919 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231ded3-3e52-42ff-a7b8-01ab222310e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:50.534580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231ded3-3e52-42ff-a7b8-01ab222310e8 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:50.534807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad7b3f-27db-4b9f-bdba-fbf51343f31b None admin] RBAC: Authorizing `identity:get_group(group_id=400a83e783324df3a27d637435d3a6b2)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:50.534916 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231ded3-3e52-42ff-a7b8-01ab222310e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:50.535131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231ded3-3e52-42ff-a7b8-01ab222310e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:50.535963 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231ded3-3e52-42ff-a7b8-01ab222310e8 None admin] RBAC: Adding query filter params (group.id=400a83e783324df3a27d637435d3a6b2, role.id=a08ab7d3851a43ac8ed5339681d7de91, scope.project.id=5e8582daaa764afcaf9c73a4aab00169) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:50.536271 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad7b3f-27db-4b9f-bdba-fbf51343f31b None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:50.536363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231ded3-3e52-42ff-a7b8-01ab222310e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:50.539112 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231ded3-3e52-42ff-a7b8-01ab222310e8 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:50.539224 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 180/365] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 12:59:50 2022] GET /identity/v3/groups/400a83e783324df3a27d637435d3a6b2 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:50.539224 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad7b3f-27db-4b9f-bdba-fbf51343f31b None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:50.545607 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 186/366] 10.222.0.52 () {56 vars in 1376 bytes} [Tue Mar 8 12:59:50 2022] GET /identity/v3/role_assignments?group.id=400a83e783324df3a27d637435d3a6b2&scope.project.id=5e8582daaa764afcaf9c73a4aab00169&role.id=a08ab7d3851a43ac8ed5339681d7de91 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:50.546270 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231ded3-3e52-42ff-a7b8-01ab222310e8 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:50.652831 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad7b3f-27db-4b9f-bdba-fbf51343f31b None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:50.662529 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231ded3-3e52-42ff-a7b8-01ab222310e8 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:50.691659 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e1d5e-0061-49c5-9047-ffbee8ad2dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:50.692470 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e1d5e-0061-49c5-9047-ffbee8ad2dd1 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:50.692784 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e1d5e-0061-49c5-9047-ffbee8ad2dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:50.693061 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e1d5e-0061-49c5-9047-ffbee8ad2dd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:50.698802 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22de44-d033-476b-ae34-f27074cf980e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:50.699519 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22de44-d033-476b-ae34-f27074cf980e None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:50.699805 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22de44-d033-476b-ae34-f27074cf980e None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:50.700080 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22de44-d033-476b-ae34-f27074cf980e None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:50.700886 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22de44-d033-476b-ae34-f27074cf980e None admin] RBAC: Adding query filter params (name=reader) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:50.701201 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22de44-d033-476b-ae34-f27074cf980e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:50.702596 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22de44-d033-476b-ae34-f27074cf980e None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:50.704474 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e1d5e-0061-49c5-9047-ffbee8ad2dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:50.711642 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-6f5e1d5e-0061-49c5-9047-ffbee8ad2dd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 12:59:50.713268 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 181/367] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 12:59:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:50.713799 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 187/368] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:50.714070 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e1d5e-0061-49c5-9047-ffbee8ad2dd1 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:50.714594 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22de44-d033-476b-ae34-f27074cf980e None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:50.831888 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e1d5e-0061-49c5-9047-ffbee8ad2dd1 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:50.832214 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22de44-d033-476b-ae34-f27074cf980e None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:50.868327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a7f84-0c43-4ca4-a0d9-706922af9abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:50.869006 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a7f84-0c43-4ca4-a0d9-706922af9abd None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:50.869291 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a7f84-0c43-4ca4-a0d9-706922af9abd None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:50.869569 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a7f84-0c43-4ca4-a0d9-706922af9abd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:50.874720 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572c250-baf6-45ba-9fd9-2261947ede8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:50.874720 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572c250-baf6-45ba-9fd9-2261947ede8d None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:50.874720 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572c250-baf6-45ba-9fd9-2261947ede8d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:50.874720 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572c250-baf6-45ba-9fd9-2261947ede8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:50.875051 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572c250-baf6-45ba-9fd9-2261947ede8d None admin] RBAC: Adding query filter params (group.id=400a83e783324df3a27d637435d3a6b2, role.id=e34b765cca514a83bef6eb9cff7ef871, scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:50.875051 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572c250-baf6-45ba-9fd9-2261947ede8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:50.875600 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572c250-baf6-45ba-9fd9-2261947ede8d None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:50.889141 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 188/369] 10.222.0.52 () {56 vars in 1376 bytes} [Tue Mar 8 12:59:50 2022] GET /identity/v3/role_assignments?group.id=400a83e783324df3a27d637435d3a6b2&scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68&role.id=e34b765cca514a83bef6eb9cff7ef871 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:50.890595 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572c250-baf6-45ba-9fd9-2261947ede8d None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:50.954999 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a7f84-0c43-4ca4-a0d9-706922af9abd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:50.956481 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a7f84-0c43-4ca4-a0d9-706922af9abd None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:51.040227 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572c250-baf6-45ba-9fd9-2261947ede8d None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:51.064717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 182/370] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:51.064717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a7f84-0c43-4ca4-a0d9-706922af9abd None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:51.089031 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8a100-1409-4fce-8eb7-1d76b541ca77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:51.090694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8a100-1409-4fce-8eb7-1d76b541ca77 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:51.091172 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8a100-1409-4fce-8eb7-1d76b541ca77 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:51.091635 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8a100-1409-4fce-8eb7-1d76b541ca77 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:51.097966 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8a100-1409-4fce-8eb7-1d76b541ca77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:51.098786 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8a100-1409-4fce-8eb7-1d76b541ca77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:51.100495 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8a100-1409-4fce-8eb7-1d76b541ca77 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:51.116694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 189/371] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:51.118089 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8a100-1409-4fce-8eb7-1d76b541ca77 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:51.172787 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a7f84-0c43-4ca4-a0d9-706922af9abd None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:51.210215 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2864044-5a6a-4304-bd07-5dfa20063757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:51.211091 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2864044-5a6a-4304-bd07-5dfa20063757 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:51.217070 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2864044-5a6a-4304-bd07-5dfa20063757 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:51.217070 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2864044-5a6a-4304-bd07-5dfa20063757 None admin] PATH_INFO: `/v3/users/0b811fca230146acab1b65414979d58b` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:51.218725 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2864044-5a6a-4304-bd07-5dfa20063757 None admin] RBAC: Authorizing `identity:get_user(user_id=0b811fca230146acab1b65414979d58b)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:51.225015 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2864044-5a6a-4304-bd07-5dfa20063757 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:51.226838 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 183/372] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 12:59:51 2022] GET /identity/v3/users/0b811fca230146acab1b65414979d58b => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:51.227633 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2864044-5a6a-4304-bd07-5dfa20063757 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:51.284684 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8a100-1409-4fce-8eb7-1d76b541ca77 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:51.335025 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e28fa-70a4-4077-95e1-2a30af18d911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:51.335917 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e28fa-70a4-4077-95e1-2a30af18d911 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:51.336200 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e28fa-70a4-4077-95e1-2a30af18d911 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:51.336476 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e28fa-70a4-4077-95e1-2a30af18d911 None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:51.341641 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e28fa-70a4-4077-95e1-2a30af18d911 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ce0a6eef414c84f1dabaf084bd68)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:51.345878 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e28fa-70a4-4077-95e1-2a30af18d911 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:51.352349 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 190/373] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:51 2022] GET /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:51.353347 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e28fa-70a4-4077-95e1-2a30af18d911 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:51.364135 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2864044-5a6a-4304-bd07-5dfa20063757 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:51.412430 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad024117-0f97-461f-ab1f-8d49380aa661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:51.413106 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad024117-0f97-461f-ab1f-8d49380aa661 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:51.413383 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad024117-0f97-461f-ab1f-8d49380aa661 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:51.413656 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad024117-0f97-461f-ab1f-8d49380aa661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:51.489245 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad024117-0f97-461f-ab1f-8d49380aa661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:51.490711 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad024117-0f97-461f-ab1f-8d49380aa661 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:51.497692 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e28fa-70a4-4077-95e1-2a30af18d911 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:51.547254 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecae70-2564-473f-bac8-9d87ab003ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:51.548195 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecae70-2564-473f-bac8-9d87ab003ddf None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:51.548479 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecae70-2564-473f-bac8-9d87ab003ddf None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:51.548779 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecae70-2564-473f-bac8-9d87ab003ddf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:51.550082 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecae70-2564-473f-bac8-9d87ab003ddf None admin] RBAC: Adding query filter params (role.id=02b083eae38b4e7ba220f1d1a33e43a4, user.id=0b811fca230146acab1b65414979d58b, scope.system=all) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:51.550402 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecae70-2564-473f-bac8-9d87ab003ddf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:51.551868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecae70-2564-473f-bac8-9d87ab003ddf None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:51.568577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 191/374] 10.222.0.52 () {56 vars in 1308 bytes} [Tue Mar 8 12:59:51 2022] GET /identity/v3/role_assignments?user.id=0b811fca230146acab1b65414979d58b&scope.system=all&role.id=02b083eae38b4e7ba220f1d1a33e43a4 => generated 510 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:51.573551 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecae70-2564-473f-bac8-9d87ab003ddf None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:51.646362 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 184/375] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:51.651924 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad024117-0f97-461f-ab1f-8d49380aa661 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:51.737853 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecae70-2564-473f-bac8-9d87ab003ddf None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:51.776335 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d4b19-559f-4aca-beed-c499c4d6b8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:51.777992 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d4b19-559f-4aca-beed-c499c4d6b8b9 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:51.778275 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d4b19-559f-4aca-beed-c499c4d6b8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:51.778555 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d4b19-559f-4aca-beed-c499c4d6b8b9 None admin] PATH_INFO: `/v3/groups/400a83e783324df3a27d637435d3a6b2` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:51.780236 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d4b19-559f-4aca-beed-c499c4d6b8b9 None admin] RBAC: Authorizing `identity:get_group(group_id=400a83e783324df3a27d637435d3a6b2)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:51.781911 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d4b19-559f-4aca-beed-c499c4d6b8b9 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:51.788365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 192/376] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 12:59:51 2022] GET /identity/v3/groups/400a83e783324df3a27d637435d3a6b2 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:51.789797 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d4b19-559f-4aca-beed-c499c4d6b8b9 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:51.837885 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad024117-0f97-461f-ab1f-8d49380aa661 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:51.879074 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9ee2b-5dea-45f4-a523-e440c380af61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:51.880280 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9ee2b-5dea-45f4-a523-e440c380af61 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:51.881797 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9ee2b-5dea-45f4-a523-e440c380af61 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:51.882274 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9ee2b-5dea-45f4-a523-e440c380af61 None admin] PATH_INFO: `/v3/projects/9bf8304032614352a7ca4a6088a17c23` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:51.884874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9ee2b-5dea-45f4-a523-e440c380af61 None admin] RBAC: Authorizing `identity:get_project(project_id=9bf8304032614352a7ca4a6088a17c23)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:51.886775 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9ee2b-5dea-45f4-a523-e440c380af61 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:51.891165 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 185/377] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:51 2022] GET /identity/v3/projects/9bf8304032614352a7ca4a6088a17c23 => generated 344 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:51.896636 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9ee2b-5dea-45f4-a523-e440c380af61 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:51.974465 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d4b19-559f-4aca-beed-c499c4d6b8b9 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:52.013783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9ee2b-5dea-45f4-a523-e440c380af61 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:52.051594 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd196a7-6adc-44d2-a582-78653abecda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:52.052530 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e837bb2-4007-450d-8079-7ad6b2674181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:52.053671 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e837bb2-4007-450d-8079-7ad6b2674181 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:52.054142 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e837bb2-4007-450d-8079-7ad6b2674181 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:52.054603 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e837bb2-4007-450d-8079-7ad6b2674181 None admin] PATH_INFO: `/v3/groups/925a301cc96b4191ba3a9bee4904459b` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:52.056044 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd196a7-6adc-44d2-a582-78653abecda6 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:52.056329 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd196a7-6adc-44d2-a582-78653abecda6 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:52.056594 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd196a7-6adc-44d2-a582-78653abecda6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:52.057481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd196a7-6adc-44d2-a582-78653abecda6 None admin] RBAC: Adding query filter params (group.id=400a83e783324df3a27d637435d3a6b2, role.id=a08ab7d3851a43ac8ed5339681d7de91, scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:52.057786 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd196a7-6adc-44d2-a582-78653abecda6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:52.059483 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd196a7-6adc-44d2-a582-78653abecda6 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:52.061741 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e837bb2-4007-450d-8079-7ad6b2674181 None admin] RBAC: Authorizing `identity:get_group(group_id=925a301cc96b4191ba3a9bee4904459b)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:52.063432 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e837bb2-4007-450d-8079-7ad6b2674181 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:52.065446 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 193/378] 10.222.0.52 () {56 vars in 1376 bytes} [Tue Mar 8 12:59:51 2022] GET /identity/v3/role_assignments?group.id=400a83e783324df3a27d637435d3a6b2&scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68&role.id=a08ab7d3851a43ac8ed5339681d7de91 => generated 260 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:52.065865 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 186/379] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 12:59:51 2022] GET /identity/v3/groups/925a301cc96b4191ba3a9bee4904459b => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:52.071321 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd196a7-6adc-44d2-a582-78653abecda6 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:52.196169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e5f1a-655c-46d1-ad13-01b21c01ef78 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:52.196899 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e5f1a-655c-46d1-ad13-01b21c01ef78 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:52.197378 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e5f1a-655c-46d1-ad13-01b21c01ef78 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:52.200310 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 187/380] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:52.204270 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd196a7-6adc-44d2-a582-78653abecda6 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:52.205979 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49121cd-4ac9-46c2-88a2-59395952d7c8 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:52.206526 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49121cd-4ac9-46c2-88a2-59395952d7c8 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:52.206995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49121cd-4ac9-46c2-88a2-59395952d7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:52.235804 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-b49121cd-4ac9-46c2-88a2-59395952d7c8 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:52.237509 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b49121cd-4ac9-46c2-88a2-59395952d7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:52.246501 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e8011-c1e9-479a-8512-387a8c512833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:52.246501 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e8011-c1e9-479a-8512-387a8c512833 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:52.246501 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e8011-c1e9-479a-8512-387a8c512833 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:52.246501 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e8011-c1e9-479a-8512-387a8c512833 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:52.247083 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e8011-c1e9-479a-8512-387a8c512833 None admin] RBAC: Adding query filter params (group.id=925a301cc96b4191ba3a9bee4904459b, role.id=f9ec85924a914e078096b38cae4e6caa, scope.project.id=9bf8304032614352a7ca4a6088a17c23) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:52.247613 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e8011-c1e9-479a-8512-387a8c512833 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:52.249076 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e8011-c1e9-479a-8512-387a8c512833 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:52.260846 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 194/381] 10.222.0.52 () {56 vars in 1376 bytes} [Tue Mar 8 12:59:52 2022] GET /identity/v3/role_assignments?group.id=925a301cc96b4191ba3a9bee4904459b&scope.project.id=9bf8304032614352a7ca4a6088a17c23&role.id=f9ec85924a914e078096b38cae4e6caa => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:52.336553 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 188/382] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:52.369656 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e8011-c1e9-479a-8512-387a8c512833 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:52.507084 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e8011-c1e9-479a-8512-387a8c512833 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:52.550755 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa3ab7-ee07-40c0-96b4-523c8f0aae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:52.551968 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa3ab7-ee07-40c0-96b4-523c8f0aae3f None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:52.552443 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa3ab7-ee07-40c0-96b4-523c8f0aae3f None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:52.552933 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa3ab7-ee07-40c0-96b4-523c8f0aae3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:52.564218 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa3ab7-ee07-40c0-96b4-523c8f0aae3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:52.571616 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-cdaa3ab7-ee07-40c0-96b4-523c8f0aae3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 12:59:52.573422 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 195/383] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:52.579997 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49121cd-4ac9-46c2-88a2-59395952d7c8 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:52.697846 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49121cd-4ac9-46c2-88a2-59395952d7c8 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:52.738921 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a1c33-c0c8-413f-ba07-4614f543d450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:52.739959 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a1c33-c0c8-413f-ba07-4614f543d450 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:52.740441 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a1c33-c0c8-413f-ba07-4614f543d450 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:52.740937 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a1c33-c0c8-413f-ba07-4614f543d450 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:52.741881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a1c33-c0c8-413f-ba07-4614f543d450 None admin] RBAC: Adding query filter params (name=member) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:52.742452 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a1c33-c0c8-413f-ba07-4614f543d450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:52.744081 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a1c33-c0c8-413f-ba07-4614f543d450 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:52.756087 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 189/384] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:52.761552 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa3ab7-ee07-40c0-96b4-523c8f0aae3f None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:52.873648 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa3ab7-ee07-40c0-96b4-523c8f0aae3f None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:52.915990 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acc99a-c0d2-490b-8ce0-d73627845c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:52.916880 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acc99a-c0d2-490b-8ce0-d73627845c91 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:52.917168 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acc99a-c0d2-490b-8ce0-d73627845c91 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:52.917447 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acc99a-c0d2-490b-8ce0-d73627845c91 None admin] PATH_INFO: `/v3/groups/400a83e783324df3a27d637435d3a6b2` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:52.919202 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acc99a-c0d2-490b-8ce0-d73627845c91 None admin] RBAC: Authorizing `identity:get_group(group_id=400a83e783324df3a27d637435d3a6b2)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:52.920674 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acc99a-c0d2-490b-8ce0-d73627845c91 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:52.922681 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 196/385] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 12:59:52 2022] GET /identity/v3/groups/400a83e783324df3a27d637435d3a6b2 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:52.927800 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a1c33-c0c8-413f-ba07-4614f543d450 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:53.080381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a1c33-c0c8-413f-ba07-4614f543d450 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:53.125381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee20246-0aff-42fd-a063-bdc1786eb201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:53.126258 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee20246-0aff-42fd-a063-bdc1786eb201 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:53.126540 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee20246-0aff-42fd-a063-bdc1786eb201 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:53.126825 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee20246-0aff-42fd-a063-bdc1786eb201 None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:53.128075 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee20246-0aff-42fd-a063-bdc1786eb201 None admin] RBAC: Authorizing `identity:get_project(project_id=5e8582daaa764afcaf9c73a4aab00169)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:53.129568 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee20246-0aff-42fd-a063-bdc1786eb201 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:53.131429 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 190/386] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:52 2022] GET /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:53.137474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acc99a-c0d2-490b-8ce0-d73627845c91 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:53.246472 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acc99a-c0d2-490b-8ce0-d73627845c91 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:53.286288 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b679d2-a560-4a89-86d4-c8f84abb6912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:53.287193 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b679d2-a560-4a89-86d4-c8f84abb6912 None admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:53.287481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b679d2-a560-4a89-86d4-c8f84abb6912 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:53.287759 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b679d2-a560-4a89-86d4-c8f84abb6912 None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169/groups/400a83e783324df3a27d637435d3a6b2/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:53.289782 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b679d2-a560-4a89-86d4-c8f84abb6912 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e8582daaa764afcaf9c73a4aab00169, group_id=400a83e783324df3a27d637435d3a6b2, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:53.291242 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b679d2-a560-4a89-86d4-c8f84abb6912 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:53.411620 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 197/387] 10.222.0.52 () {58 vars in 1442 bytes} [Tue Mar 8 12:59:53 2022] PUT /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169/groups/400a83e783324df3a27d637435d3a6b2/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:59:53.702234 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c15a65-d6d8-41f9-9c8c-11441cdd0f6d None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:53.703078 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c15a65-d6d8-41f9-9c8c-11441cdd0f6d None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:53.703496 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c15a65-d6d8-41f9-9c8c-11441cdd0f6d None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:53.705723 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 191/388] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:53.712379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f9f1d-238c-408a-a23f-d7cbd892c754 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:53.713240 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f9f1d-238c-408a-a23f-d7cbd892c754 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:53.713688 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f9f1d-238c-408a-a23f-d7cbd892c754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:53.733052 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-c34f9f1d-238c-408a-a23f-d7cbd892c754 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:53.734543 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-c34f9f1d-238c-408a-a23f-d7cbd892c754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:53.803727 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 198/389] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:53.828023 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c15a65-d6d8-41f9-9c8c-11441cdd0f6d None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:53.956291 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c15a65-d6d8-41f9-9c8c-11441cdd0f6d None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:53.999657 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c7309-3be0-4368-b219-f432ddf8bb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:54.000814 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c7309-3be0-4368-b219-f432ddf8bb85 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:54.001269 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c7309-3be0-4368-b219-f432ddf8bb85 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:54.001713 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c7309-3be0-4368-b219-f432ddf8bb85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:54.018613 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c7309-3be0-4368-b219-f432ddf8bb85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:54.026356 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-e08c7309-3be0-4368-b219-f432ddf8bb85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 12:59:54.028117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 192/390] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 12:59:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:54.034228 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f9f1d-238c-408a-a23f-d7cbd892c754 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:54.143761 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f9f1d-238c-408a-a23f-d7cbd892c754 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:54.180107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80cf30-f34e-493d-9bb4-869172f18a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:54.181122 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80cf30-f34e-493d-9bb4-869172f18a03 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:54.181607 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80cf30-f34e-493d-9bb4-869172f18a03 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:54.182052 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80cf30-f34e-493d-9bb4-869172f18a03 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:54.182976 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80cf30-f34e-493d-9bb4-869172f18a03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:54.183477 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80cf30-f34e-493d-9bb4-869172f18a03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:54.185075 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80cf30-f34e-493d-9bb4-869172f18a03 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:54.194373 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 199/391] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 12:59:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:54.200220 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c7309-3be0-4368-b219-f432ddf8bb85 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:54.323546 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c7309-3be0-4368-b219-f432ddf8bb85 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:54.370894 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7032cc6-58f8-4150-ac89-c2901ea79afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:54.372157 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7032cc6-58f8-4150-ac89-c2901ea79afb None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:54.372614 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7032cc6-58f8-4150-ac89-c2901ea79afb None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:54.373089 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7032cc6-58f8-4150-ac89-c2901ea79afb None admin] PATH_INFO: `/v3/groups/400a83e783324df3a27d637435d3a6b2` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:54.374474 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7032cc6-58f8-4150-ac89-c2901ea79afb None admin] RBAC: Authorizing `identity:get_group(group_id=400a83e783324df3a27d637435d3a6b2)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:54.376088 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7032cc6-58f8-4150-ac89-c2901ea79afb None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:54.377994 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 193/392] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 12:59:54 2022] GET /identity/v3/groups/400a83e783324df3a27d637435d3a6b2 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:54.383534 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80cf30-f34e-493d-9bb4-869172f18a03 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:54.539523 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80cf30-f34e-493d-9bb4-869172f18a03 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:54.547617 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545b5f4-1b57-4b00-99a9-514647f1a748 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:54.547983 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545b5f4-1b57-4b00-99a9-514647f1a748 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:54.548324 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545b5f4-1b57-4b00-99a9-514647f1a748 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:54.550301 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 194/393] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:54.555315 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5157eb-0553-49ac-912e-9b5dec2f3fb5 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:54.555598 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5157eb-0553-49ac-912e-9b5dec2f3fb5 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:54.555874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5157eb-0553-49ac-912e-9b5dec2f3fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:54.586843 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-4c5157eb-0553-49ac-912e-9b5dec2f3fb5 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:54.588038 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-4c5157eb-0553-49ac-912e-9b5dec2f3fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:54.609443 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f28dd-28fe-4aa0-a41d-59d500b299f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:54.610605 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f28dd-28fe-4aa0-a41d-59d500b299f2 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:54.611065 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f28dd-28fe-4aa0-a41d-59d500b299f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:54.611538 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f28dd-28fe-4aa0-a41d-59d500b299f2 None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:54.613621 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f28dd-28fe-4aa0-a41d-59d500b299f2 None admin] RBAC: Authorizing `identity:get_project(project_id=5e8582daaa764afcaf9c73a4aab00169)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:54.615238 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f28dd-28fe-4aa0-a41d-59d500b299f2 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:54.624725 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 200/394] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:54 2022] GET /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:54.631192 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f28dd-28fe-4aa0-a41d-59d500b299f2 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:54.723260 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 195/395] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 12:59:54.748253 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5157eb-0553-49ac-912e-9b5dec2f3fb5 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:54.821698 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f28dd-28fe-4aa0-a41d-59d500b299f2 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:54.891632 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010b1e6-5030-45d3-9f6d-e9e7d189e3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:54.892858 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010b1e6-5030-45d3-9f6d-e9e7d189e3d3 None admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:54.893505 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010b1e6-5030-45d3-9f6d-e9e7d189e3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:54.893974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010b1e6-5030-45d3-9f6d-e9e7d189e3d3 None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169/groups/400a83e783324df3a27d637435d3a6b2/roles/a08ab7d3851a43ac8ed5339681d7de91` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:54.899041 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010b1e6-5030-45d3-9f6d-e9e7d189e3d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e8582daaa764afcaf9c73a4aab00169, group_id=400a83e783324df3a27d637435d3a6b2, role_id=a08ab7d3851a43ac8ed5339681d7de91)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:54.902348 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010b1e6-5030-45d3-9f6d-e9e7d189e3d3 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:54.923074 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5157eb-0553-49ac-912e-9b5dec2f3fb5 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:54.960381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703321d-abb9-4a00-beb8-0a5218de0aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:54.961272 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703321d-abb9-4a00-beb8-0a5218de0aaf None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:54.961560 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703321d-abb9-4a00-beb8-0a5218de0aaf None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:54.961847 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703321d-abb9-4a00-beb8-0a5218de0aaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:54.982147 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 201/396] 10.222.0.52 () {58 vars in 1442 bytes} [Tue Mar 8 12:59:54 2022] PUT /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169/groups/400a83e783324df3a27d637435d3a6b2/roles/a08ab7d3851a43ac8ed5339681d7de91 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:59:54.983786 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703321d-abb9-4a00-beb8-0a5218de0aaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:54.991739 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-b703321d-abb9-4a00-beb8-0a5218de0aaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 12:59:54.993554 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 196/397] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 12:59:55.000206 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010b1e6-5030-45d3-9f6d-e9e7d189e3d3 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:55.137880 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010b1e6-5030-45d3-9f6d-e9e7d189e3d3 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:55.180601 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e472c-7bae-4a43-aaaf-ea678c13885d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:55.181396 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e472c-7bae-4a43-aaaf-ea678c13885d None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:55.181680 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e472c-7bae-4a43-aaaf-ea678c13885d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:55.182011 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e472c-7bae-4a43-aaaf-ea678c13885d None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:55.182768 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e472c-7bae-4a43-aaaf-ea678c13885d None admin] RBAC: Adding query filter params (name=member) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:55.183109 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e472c-7bae-4a43-aaaf-ea678c13885d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:55.184802 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e472c-7bae-4a43-aaaf-ea678c13885d None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:55.193375 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 202/398] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:55.199229 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703321d-abb9-4a00-beb8-0a5218de0aaf None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:55.260435 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987880d7-de6f-4594-b837-97205896d422 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:55.260862 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987880d7-de6f-4594-b837-97205896d422 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:55.261199 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987880d7-de6f-4594-b837-97205896d422 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:55.263791 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 203/399] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:55.269293 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64968367-b1ce-468b-8c6f-bcac62d6f9f4 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:55.269653 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64968367-b1ce-468b-8c6f-bcac62d6f9f4 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:55.269993 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64968367-b1ce-468b-8c6f-bcac62d6f9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:55.292113 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-64968367-b1ce-468b-8c6f-bcac62d6f9f4 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:55.293946 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-64968367-b1ce-468b-8c6f-bcac62d6f9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:55.336566 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703321d-abb9-4a00-beb8-0a5218de0aaf None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:55.399493 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb80ad-6483-44f4-828c-83a7cf419dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:55.400590 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb80ad-6483-44f4-828c-83a7cf419dc4 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:55.401028 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb80ad-6483-44f4-828c-83a7cf419dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:55.401441 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb80ad-6483-44f4-828c-83a7cf419dc4 None admin] PATH_INFO: `/v3/groups/400a83e783324df3a27d637435d3a6b2` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:55.403479 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb80ad-6483-44f4-828c-83a7cf419dc4 None admin] RBAC: Authorizing `identity:get_group(group_id=400a83e783324df3a27d637435d3a6b2)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:55.405221 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 204/400] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 12:59:55.407085 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb80ad-6483-44f4-828c-83a7cf419dc4 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:55.409219 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 197/401] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 12:59:55 2022] GET /identity/v3/groups/400a83e783324df3a27d637435d3a6b2 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:55.418266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64968367-b1ce-468b-8c6f-bcac62d6f9f4 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:55.434499 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb80ad-6483-44f4-828c-83a7cf419dc4 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:55.551676 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb80ad-6483-44f4-828c-83a7cf419dc4 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:55.557738 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64968367-b1ce-468b-8c6f-bcac62d6f9f4 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:55.593627 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9507f70-37ae-4bf3-a605-fea544b991a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:55.595875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9507f70-37ae-4bf3-a605-fea544b991a3 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:55.596161 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9507f70-37ae-4bf3-a605-fea544b991a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:55.596440 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9507f70-37ae-4bf3-a605-fea544b991a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:55.612598 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9507f70-37ae-4bf3-a605-fea544b991a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:55.615773 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d2098-07fc-4f6c-abf9-8715a4216cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:55.616633 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d2098-07fc-4f6c-abf9-8715a4216cf3 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:55.616945 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d2098-07fc-4f6c-abf9-8715a4216cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:55.617221 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d2098-07fc-4f6c-abf9-8715a4216cf3 None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:55.618408 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d2098-07fc-4f6c-abf9-8715a4216cf3 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ce0a6eef414c84f1dabaf084bd68)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:55.619855 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d2098-07fc-4f6c-abf9-8715a4216cf3 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:55.621146 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-f9507f70-37ae-4bf3-a605-fea544b991a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 12:59:55.627239 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 198/403] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 12:59:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 12:59:55.627390 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 205/403] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:55 2022] GET /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:55.628192 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d2098-07fc-4f6c-abf9-8715a4216cf3 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:55.628937 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff6ed8-a962-4295-b789-bfd212a22bd6 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:55.629317 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff6ed8-a962-4295-b789-bfd212a22bd6 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:55.629733 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff6ed8-a962-4295-b789-bfd212a22bd6 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:55.632977 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 199/404] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:55.633831 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff6ed8-a962-4295-b789-bfd212a22bd6 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:55.736304 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d2098-07fc-4f6c-abf9-8715a4216cf3 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:55.757894 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff6ed8-a962-4295-b789-bfd212a22bd6 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:55.780020 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11babb3e-529e-4434-b2be-4630b7d4f138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:55.781228 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11babb3e-529e-4434-b2be-4630b7d4f138 None admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:55.781586 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11babb3e-529e-4434-b2be-4630b7d4f138 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:55.781869 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11babb3e-529e-4434-b2be-4630b7d4f138 None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68/groups/400a83e783324df3a27d637435d3a6b2/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:55.784471 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11babb3e-529e-4434-b2be-4630b7d4f138 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7a5ce0a6eef414c84f1dabaf084bd68, group_id=400a83e783324df3a27d637435d3a6b2, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:55.786228 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11babb3e-529e-4434-b2be-4630b7d4f138 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:55.794764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a785f49-221c-470f-92a8-95881ee6b9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:55.795507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a785f49-221c-470f-92a8-95881ee6b9f2 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:55.795898 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a785f49-221c-470f-92a8-95881ee6b9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:55.796199 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a785f49-221c-470f-92a8-95881ee6b9f2 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:55.798714 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a785f49-221c-470f-92a8-95881ee6b9f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:55.798714 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a785f49-221c-470f-92a8-95881ee6b9f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:55.798714 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a785f49-221c-470f-92a8-95881ee6b9f2 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:55.811944 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 200/405] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:55.811944 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd81637-74b4-4593-bb54-fd09585fafd5 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:55.811944 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd81637-74b4-4593-bb54-fd09585fafd5 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:55.811944 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd81637-74b4-4593-bb54-fd09585fafd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:55.827537 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-bfd81637-74b4-4593-bb54-fd09585fafd5 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:55.828743 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-bfd81637-74b4-4593-bb54-fd09585fafd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:55.869804 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 206/406] 10.222.0.52 () {58 vars in 1442 bytes} [Tue Mar 8 12:59:55 2022] PUT /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68/groups/400a83e783324df3a27d637435d3a6b2/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:59:55.871908 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11babb3e-529e-4434-b2be-4630b7d4f138 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:55.913988 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 201/407] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:55.965128 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd81637-74b4-4593-bb54-fd09585fafd5 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:56.022053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11babb3e-529e-4434-b2be-4630b7d4f138 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:56.112756 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd81637-74b4-4593-bb54-fd09585fafd5 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:56.122603 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567713a-90c1-478a-bd6f-1db42318764a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:56.123493 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567713a-90c1-478a-bd6f-1db42318764a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:56.123776 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567713a-90c1-478a-bd6f-1db42318764a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:56.124049 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567713a-90c1-478a-bd6f-1db42318764a None admin] PATH_INFO: `/v3/groups/925a301cc96b4191ba3a9bee4904459b` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:56.129480 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567713a-90c1-478a-bd6f-1db42318764a None admin] RBAC: Authorizing `identity:get_group(group_id=925a301cc96b4191ba3a9bee4904459b)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:56.131205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567713a-90c1-478a-bd6f-1db42318764a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:56.133108 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 207/408] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 12:59:55 2022] GET /identity/v3/groups/925a301cc96b4191ba3a9bee4904459b => generated 229 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:56.141908 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567713a-90c1-478a-bd6f-1db42318764a None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:56.155276 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee723a1-f55d-4acc-8def-0ae3eaf5410a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:56.156401 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee723a1-f55d-4acc-8def-0ae3eaf5410a None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:56.156948 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee723a1-f55d-4acc-8def-0ae3eaf5410a None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:56.157293 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee723a1-f55d-4acc-8def-0ae3eaf5410a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:56.168530 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee723a1-f55d-4acc-8def-0ae3eaf5410a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:56.176215 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-fee723a1-f55d-4acc-8def-0ae3eaf5410a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 12:59:56.177884 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 202/409] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 12:59:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 12:59:56.184431 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee723a1-f55d-4acc-8def-0ae3eaf5410a None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:56.268951 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567713a-90c1-478a-bd6f-1db42318764a None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:56.308395 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee723a1-f55d-4acc-8def-0ae3eaf5410a None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:56.312772 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9388c-5ef8-44ba-a773-dd88cfcf0ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:56.313820 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9388c-5ef8-44ba-a773-dd88cfcf0ecc None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:56.314253 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9388c-5ef8-44ba-a773-dd88cfcf0ecc None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:56.314663 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9388c-5ef8-44ba-a773-dd88cfcf0ecc None admin] PATH_INFO: `/v3/projects/9bf8304032614352a7ca4a6088a17c23` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:56.316812 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9388c-5ef8-44ba-a773-dd88cfcf0ecc None admin] RBAC: Authorizing `identity:get_project(project_id=9bf8304032614352a7ca4a6088a17c23)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:56.318795 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9388c-5ef8-44ba-a773-dd88cfcf0ecc None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:56.321294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 208/410] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:56 2022] GET /identity/v3/projects/9bf8304032614352a7ca4a6088a17c23 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:56.322727 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832935d-5925-40bf-983c-eaebbf2b9682 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:56.323136 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832935d-5925-40bf-983c-eaebbf2b9682 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:56.323534 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832935d-5925-40bf-983c-eaebbf2b9682 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:56.329676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 209/411] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:59:56.329676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832935d-5925-40bf-983c-eaebbf2b9682 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:56.355610 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66caf2-10b3-47b8-8e76-96ea243ffa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:56.356686 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66caf2-10b3-47b8-8e76-96ea243ffa23 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:56.356996 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66caf2-10b3-47b8-8e76-96ea243ffa23 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:56.357275 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66caf2-10b3-47b8-8e76-96ea243ffa23 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:56.358031 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66caf2-10b3-47b8-8e76-96ea243ffa23 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:56.358395 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66caf2-10b3-47b8-8e76-96ea243ffa23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:56.359846 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66caf2-10b3-47b8-8e76-96ea243ffa23 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:56.371083 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 203/412] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 12:59:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:56.372528 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c15863-9a87-4136-8845-1d9522c2ae7e None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:56.372863 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c15863-9a87-4136-8845-1d9522c2ae7e None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:56.373140 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c15863-9a87-4136-8845-1d9522c2ae7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:56.399381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-57c15863-9a87-4136-8845-1d9522c2ae7e None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:56.401091 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-57c15863-9a87-4136-8845-1d9522c2ae7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:56.457707 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832935d-5925-40bf-983c-eaebbf2b9682 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:56.484921 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 204/413] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:56.486492 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c15863-9a87-4136-8845-1d9522c2ae7e None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:56.511718 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbf533-326b-440c-8f54-f0b3498f0de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:56.513219 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbf533-326b-440c-8f54-f0b3498f0de6 None admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:56.513844 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbf533-326b-440c-8f54-f0b3498f0de6 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:56.514626 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbf533-326b-440c-8f54-f0b3498f0de6 None admin] PATH_INFO: `/v3/projects/9bf8304032614352a7ca4a6088a17c23/groups/925a301cc96b4191ba3a9bee4904459b/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:56.517005 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbf533-326b-440c-8f54-f0b3498f0de6 None admin] RBAC: Authorizing `identity:create_grant(project_id=9bf8304032614352a7ca4a6088a17c23, group_id=925a301cc96b4191ba3a9bee4904459b, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:56.519368 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbf533-326b-440c-8f54-f0b3498f0de6 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:56.605615 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 210/414] 10.222.0.52 () {58 vars in 1442 bytes} [Tue Mar 8 12:59:56 2022] PUT /identity/v3/projects/9bf8304032614352a7ca4a6088a17c23/groups/925a301cc96b4191ba3a9bee4904459b/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:59:56.606945 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbf533-326b-440c-8f54-f0b3498f0de6 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:56.609407 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c15863-9a87-4136-8845-1d9522c2ae7e None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:56.697630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd8a8f-4af2-46ce-a2f3-9c05737643f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:56.698584 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd8a8f-4af2-46ce-a2f3-9c05737643f5 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:56.698904 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd8a8f-4af2-46ce-a2f3-9c05737643f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:56.699408 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd8a8f-4af2-46ce-a2f3-9c05737643f5 None admin] PATH_INFO: `/v3/groups/400a83e783324df3a27d637435d3a6b2` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:56.701762 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd8a8f-4af2-46ce-a2f3-9c05737643f5 None admin] RBAC: Authorizing `identity:get_group(group_id=400a83e783324df3a27d637435d3a6b2)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:56.703258 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd8a8f-4af2-46ce-a2f3-9c05737643f5 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:56.708165 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 205/415] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 12:59:56 2022] GET /identity/v3/groups/400a83e783324df3a27d637435d3a6b2 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:56.714840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd8a8f-4af2-46ce-a2f3-9c05737643f5 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:56.835814 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd8a8f-4af2-46ce-a2f3-9c05737643f5 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:56.850107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbf533-326b-440c-8f54-f0b3498f0de6 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:56.882508 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6253eb3-d02e-479a-806f-c8ac02d40aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:56.883523 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6253eb3-d02e-479a-806f-c8ac02d40aa5 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:56.883811 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6253eb3-d02e-479a-806f-c8ac02d40aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:56.884089 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6253eb3-d02e-479a-806f-c8ac02d40aa5 None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:56.886115 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6253eb3-d02e-479a-806f-c8ac02d40aa5 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ce0a6eef414c84f1dabaf084bd68)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:56.888214 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6253eb3-d02e-479a-806f-c8ac02d40aa5 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:56.889927 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 206/416] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:56 2022] GET /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:56.895713 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6253eb3-d02e-479a-806f-c8ac02d40aa5 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:56.897532 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0019338-b8af-4ced-a2ae-da82bbffef47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:56.898343 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0019338-b8af-4ced-a2ae-da82bbffef47 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:56.898618 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0019338-b8af-4ced-a2ae-da82bbffef47 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:56.898884 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0019338-b8af-4ced-a2ae-da82bbffef47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:56.911557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0019338-b8af-4ced-a2ae-da82bbffef47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:56.919636 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-a0019338-b8af-4ced-a2ae-da82bbffef47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 12:59:56.922614 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 211/417] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 12:59:56.928982 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0019338-b8af-4ced-a2ae-da82bbffef47 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:57.028574 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0019338-b8af-4ced-a2ae-da82bbffef47 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:57.028787 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6253eb3-d02e-479a-806f-c8ac02d40aa5 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:57.062624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04febfa1-ef18-4149-9b91-782d6423461c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:57.063369 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04febfa1-ef18-4149-9b91-782d6423461c None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:57.063647 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04febfa1-ef18-4149-9b91-782d6423461c None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:57.063965 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04febfa1-ef18-4149-9b91-782d6423461c None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:57.064739 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04febfa1-ef18-4149-9b91-782d6423461c None admin] RBAC: Adding query filter params (name=member) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:57.065043 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04febfa1-ef18-4149-9b91-782d6423461c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:57.066417 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04febfa1-ef18-4149-9b91-782d6423461c None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:57.073934 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e052c7-1774-49e7-91da-44787d80d3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:57.075015 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 212/418] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:57.075450 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e052c7-1774-49e7-91da-44787d80d3d6 None admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:57.076016 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e052c7-1774-49e7-91da-44787d80d3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:57.076494 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e052c7-1774-49e7-91da-44787d80d3d6 None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68/groups/400a83e783324df3a27d637435d3a6b2/roles/a08ab7d3851a43ac8ed5339681d7de91` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:57.079008 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e052c7-1774-49e7-91da-44787d80d3d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7a5ce0a6eef414c84f1dabaf084bd68, group_id=400a83e783324df3a27d637435d3a6b2, role_id=a08ab7d3851a43ac8ed5339681d7de91)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:57.080401 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04febfa1-ef18-4149-9b91-782d6423461c None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:57.081075 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e052c7-1774-49e7-91da-44787d80d3d6 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:57.165373 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 207/419] 10.222.0.52 () {58 vars in 1442 bytes} [Tue Mar 8 12:59:56 2022] PUT /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68/groups/400a83e783324df3a27d637435d3a6b2/roles/a08ab7d3851a43ac8ed5339681d7de91 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:59:57.196595 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04febfa1-ef18-4149-9b91-782d6423461c None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:57.240390 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f085d1-cc61-4979-aeb1-b2ae7b15a203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:57.241077 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f085d1-cc61-4979-aeb1-b2ae7b15a203 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:57.241357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f085d1-cc61-4979-aeb1-b2ae7b15a203 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:57.241627 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f085d1-cc61-4979-aeb1-b2ae7b15a203 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:57.331408 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f085d1-cc61-4979-aeb1-b2ae7b15a203 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:57.332923 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f085d1-cc61-4979-aeb1-b2ae7b15a203 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:57.450236 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 213/420] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:57.455740 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e052c7-1774-49e7-91da-44787d80d3d6 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:57.584137 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e052c7-1774-49e7-91da-44787d80d3d6 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:57.629262 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368c80a-8f69-40a0-a112-000f7f2400a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:57.630122 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368c80a-8f69-40a0-a112-000f7f2400a9 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:57.630398 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368c80a-8f69-40a0-a112-000f7f2400a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:57.630667 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368c80a-8f69-40a0-a112-000f7f2400a9 None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:57.637752 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368c80a-8f69-40a0-a112-000f7f2400a9 None admin] RBAC: Authorizing `identity:get_project(project_id=5e8582daaa764afcaf9c73a4aab00169)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:57.639325 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368c80a-8f69-40a0-a112-000f7f2400a9 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:57.641360 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 208/421] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:57 2022] GET /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:57.646658 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f085d1-cc61-4979-aeb1-b2ae7b15a203 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:57.774303 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f085d1-cc61-4979-aeb1-b2ae7b15a203 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:57.815623 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1795367-988e-417c-997d-3c8805b53acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:57.816536 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1795367-988e-417c-997d-3c8805b53acb None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:57.816843 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1795367-988e-417c-997d-3c8805b53acb None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:57.817114 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1795367-988e-417c-997d-3c8805b53acb None admin] PATH_INFO: `/v3/groups/400a83e783324df3a27d637435d3a6b2` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:57.818278 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1795367-988e-417c-997d-3c8805b53acb None admin] RBAC: Authorizing `identity:get_group(group_id=400a83e783324df3a27d637435d3a6b2)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:57.819844 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1795367-988e-417c-997d-3c8805b53acb None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:57.820495 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3e967-927c-45ab-a38c-143a1e578997 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:57.820812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3e967-927c-45ab-a38c-143a1e578997 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:57.821101 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3e967-927c-45ab-a38c-143a1e578997 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:57.821706 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 214/422] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 12:59:57 2022] GET /identity/v3/groups/400a83e783324df3a27d637435d3a6b2 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:57.823104 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 209/423] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 12:59:57.827337 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1795367-988e-417c-997d-3c8805b53acb None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:57.831641 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa4d31-4aee-4c0c-8057-e988388fc165 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:57.831941 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa4d31-4aee-4c0c-8057-e988388fc165 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:57.832220 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa4d31-4aee-4c0c-8057-e988388fc165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:57.869746 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-3faa4d31-4aee-4c0c-8057-e988388fc165 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:57.872120 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-3faa4d31-4aee-4c0c-8057-e988388fc165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:57.962543 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 210/424] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 12:59:57.983298 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1795367-988e-417c-997d-3c8805b53acb None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:58.022619 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa4d31-4aee-4c0c-8057-e988388fc165 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:58.044105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c979d72-1323-4ec3-963b-e5de59c1cdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:58.045112 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c979d72-1323-4ec3-963b-e5de59c1cdca None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:58.045572 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c979d72-1323-4ec3-963b-e5de59c1cdca None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:58.046015 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c979d72-1323-4ec3-963b-e5de59c1cdca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:58.047074 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c979d72-1323-4ec3-963b-e5de59c1cdca None admin] RBAC: Adding query filter params (group.id=400a83e783324df3a27d637435d3a6b2, role.id=e34b765cca514a83bef6eb9cff7ef871, scope.project.id=5e8582daaa764afcaf9c73a4aab00169) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:58.047575 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c979d72-1323-4ec3-963b-e5de59c1cdca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:58.049265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c979d72-1323-4ec3-963b-e5de59c1cdca None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:58.062866 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 215/425] 10.222.0.52 () {56 vars in 1376 bytes} [Tue Mar 8 12:59:57 2022] GET /identity/v3/role_assignments?group.id=400a83e783324df3a27d637435d3a6b2&scope.project.id=5e8582daaa764afcaf9c73a4aab00169&role.id=e34b765cca514a83bef6eb9cff7ef871 => generated 611 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:58.132521 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa4d31-4aee-4c0c-8057-e988388fc165 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:58.176646 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a3d2a-1971-4b69-90c7-b99a943ee95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:58.177531 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a3d2a-1971-4b69-90c7-b99a943ee95b None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:58.177816 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a3d2a-1971-4b69-90c7-b99a943ee95b None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:58.178095 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a3d2a-1971-4b69-90c7-b99a943ee95b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:58.195004 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a3d2a-1971-4b69-90c7-b99a943ee95b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:58.203832 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-df0a3d2a-1971-4b69-90c7-b99a943ee95b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 12:59:58.205532 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 211/426] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 12:59:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 12:59:58.211317 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c979d72-1323-4ec3-963b-e5de59c1cdca None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:58.352669 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c979d72-1323-4ec3-963b-e5de59c1cdca None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:58.389844 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51c350-33b2-4d17-8854-50f2e6e8312c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:58.390524 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51c350-33b2-4d17-8854-50f2e6e8312c None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:58.390803 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51c350-33b2-4d17-8854-50f2e6e8312c None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:58.391078 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51c350-33b2-4d17-8854-50f2e6e8312c None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:58.391827 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51c350-33b2-4d17-8854-50f2e6e8312c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:58.392129 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51c350-33b2-4d17-8854-50f2e6e8312c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:58.393799 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51c350-33b2-4d17-8854-50f2e6e8312c None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:58.407744 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 216/427] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 12:59:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:58.409206 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a3d2a-1971-4b69-90c7-b99a943ee95b None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:58.524919 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a3d2a-1971-4b69-90c7-b99a943ee95b None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:58.564125 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bbe6a-8a87-443f-9aef-120974a91802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:58.564818 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bbe6a-8a87-443f-9aef-120974a91802 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:58.565103 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bbe6a-8a87-443f-9aef-120974a91802 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:58.565380 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bbe6a-8a87-443f-9aef-120974a91802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:58.617995 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731749b7-500a-4e8a-a742-063f656b8b81 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:58.618180 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731749b7-500a-4e8a-a742-063f656b8b81 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:58.618463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731749b7-500a-4e8a-a742-063f656b8b81 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:58.620241 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 217/428] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 12:59:58.625951 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3f466-56f1-4536-8bbe-6460286245d6 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:58.626235 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3f466-56f1-4536-8bbe-6460286245d6 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:58.626511 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3f466-56f1-4536-8bbe-6460286245d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:58.646345 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-eec3f466-56f1-4536-8bbe-6460286245d6 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:58.646848 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bbe6a-8a87-443f-9aef-120974a91802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:58.647494 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-eec3f466-56f1-4536-8bbe-6460286245d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:58.648750 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bbe6a-8a87-443f-9aef-120974a91802 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:58.737994 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 218/429] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 12:59:58.768421 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3f466-56f1-4536-8bbe-6460286245d6 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:58.775620 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 212/430] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:58.781836 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bbe6a-8a87-443f-9aef-120974a91802 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:58.875150 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3f466-56f1-4536-8bbe-6460286245d6 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:58.887559 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bbe6a-8a87-443f-9aef-120974a91802 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:58.910122 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a58e2-d32e-4ff1-9935-d7ba2a61a7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:58.910915 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a58e2-d32e-4ff1-9935-d7ba2a61a7c6 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:58.911199 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a58e2-d32e-4ff1-9935-d7ba2a61a7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:58.911452 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a58e2-d32e-4ff1-9935-d7ba2a61a7c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:58.923573 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a58e2-d32e-4ff1-9935-d7ba2a61a7c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:58.927747 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7efc37-c545-4613-a1e5-c33c03adcca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:58.928887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7efc37-c545-4613-a1e5-c33c03adcca6 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:58.929395 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7efc37-c545-4613-a1e5-c33c03adcca6 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:58.929881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7efc37-c545-4613-a1e5-c33c03adcca6 None admin] PATH_INFO: `/v3/projects/5e8582daaa764afcaf9c73a4aab00169` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:58.930904 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-182a58e2-d32e-4ff1-9935-d7ba2a61a7c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 12:59:58.931516 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7efc37-c545-4613-a1e5-c33c03adcca6 None admin] RBAC: Authorizing `identity:get_project(project_id=5e8582daaa764afcaf9c73a4aab00169)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:58.932399 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 219/431] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 12:59:58.933631 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7efc37-c545-4613-a1e5-c33c03adcca6 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:58.935561 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 213/432] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:58 2022] GET /identity/v3/projects/5e8582daaa764afcaf9c73a4aab00169 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:58.940007 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a58e2-d32e-4ff1-9935-d7ba2a61a7c6 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:58.941294 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7efc37-c545-4613-a1e5-c33c03adcca6 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:59.053105 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7efc37-c545-4613-a1e5-c33c03adcca6 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:59.070105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a58e2-d32e-4ff1-9935-d7ba2a61a7c6 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:59.089519 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c2436-7aeb-46cf-a681-89d32aacfe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:59.090540 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c2436-7aeb-46cf-a681-89d32aacfe09 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:59.090921 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c2436-7aeb-46cf-a681-89d32aacfe09 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:59.091294 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c2436-7aeb-46cf-a681-89d32aacfe09 None admin] PATH_INFO: `/v3/groups/400a83e783324df3a27d637435d3a6b2` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:59.092602 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c2436-7aeb-46cf-a681-89d32aacfe09 None admin] RBAC: Authorizing `identity:get_group(group_id=400a83e783324df3a27d637435d3a6b2)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:59.094489 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c2436-7aeb-46cf-a681-89d32aacfe09 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:59.100032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 214/433] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 12:59:58 2022] GET /identity/v3/groups/400a83e783324df3a27d637435d3a6b2 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:59.102769 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c2436-7aeb-46cf-a681-89d32aacfe09 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:59.116692 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bea683-4ab7-43fb-8295-023b4fb34ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:59.116692 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bea683-4ab7-43fb-8295-023b4fb34ed0 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:59.116692 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bea683-4ab7-43fb-8295-023b4fb34ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:59.116692 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bea683-4ab7-43fb-8295-023b4fb34ed0 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:59.117395 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bea683-4ab7-43fb-8295-023b4fb34ed0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:59.117871 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bea683-4ab7-43fb-8295-023b4fb34ed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:59.119428 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bea683-4ab7-43fb-8295-023b4fb34ed0 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:59.137796 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 220/434] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 12:59:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:59.145665 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bea683-4ab7-43fb-8295-023b4fb34ed0 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:59.214795 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c2436-7aeb-46cf-a681-89d32aacfe09 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:59.259889 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632ee6d-b1eb-4c24-a559-bc728f19041e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:59.260540 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632ee6d-b1eb-4c24-a559-bc728f19041e None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:59.260922 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632ee6d-b1eb-4c24-a559-bc728f19041e None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:59.261203 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632ee6d-b1eb-4c24-a559-bc728f19041e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:59.262036 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632ee6d-b1eb-4c24-a559-bc728f19041e None admin] RBAC: Adding query filter params (group.id=400a83e783324df3a27d637435d3a6b2, role.id=a08ab7d3851a43ac8ed5339681d7de91, scope.project.id=5e8582daaa764afcaf9c73a4aab00169) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:59.262349 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632ee6d-b1eb-4c24-a559-bc728f19041e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:59.263794 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632ee6d-b1eb-4c24-a559-bc728f19041e None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:59.267406 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bea683-4ab7-43fb-8295-023b4fb34ed0 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:59.270109 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 215/435] 10.222.0.52 () {56 vars in 1376 bytes} [Tue Mar 8 12:59:59 2022] GET /identity/v3/role_assignments?group.id=400a83e783324df3a27d637435d3a6b2&scope.project.id=5e8582daaa764afcaf9c73a4aab00169&role.id=a08ab7d3851a43ac8ed5339681d7de91 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:59.308612 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a5d38-f720-4c4c-8421-4e781a17c758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:59.309330 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a5d38-f720-4c4c-8421-4e781a17c758 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:59.309616 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a5d38-f720-4c4c-8421-4e781a17c758 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:59.309893 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a5d38-f720-4c4c-8421-4e781a17c758 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:59.385065 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a5d38-f720-4c4c-8421-4e781a17c758 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:59.386756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a5d38-f720-4c4c-8421-4e781a17c758 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:59.441841 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5932a14-0888-4509-bfc4-6761d1b5d938 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:59.442138 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5932a14-0888-4509-bfc4-6761d1b5d938 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:59.442384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5932a14-0888-4509-bfc4-6761d1b5d938 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:59.444330 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 216/436] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 12:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 12:59:59.450203 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c060a08-3512-410d-81ea-e18f7f62d485 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:59.450512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c060a08-3512-410d-81ea-e18f7f62d485 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:59.450749 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c060a08-3512-410d-81ea-e18f7f62d485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:59.468185 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-5c060a08-3512-410d-81ea-e18f7f62d485 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:59:59.469414 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-5c060a08-3512-410d-81ea-e18f7f62d485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:59:59.504902 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 221/437] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 12:59:59.510172 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a5d38-f720-4c4c-8421-4e781a17c758 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:59.560745 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 217/438] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 12:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 12:59:59.583001 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c060a08-3512-410d-81ea-e18f7f62d485 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:59.622729 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a5d38-f720-4c4c-8421-4e781a17c758 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:59.670392 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e937e-d377-4f2c-8bbe-c1ab5b296ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:59.671194 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e937e-d377-4f2c-8bbe-c1ab5b296ab7 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:59.671487 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e937e-d377-4f2c-8bbe-c1ab5b296ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:59.671767 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e937e-d377-4f2c-8bbe-c1ab5b296ab7 None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:59.674468 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e937e-d377-4f2c-8bbe-c1ab5b296ab7 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ce0a6eef414c84f1dabaf084bd68)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:59.676016 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e937e-d377-4f2c-8bbe-c1ab5b296ab7 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:59.677824 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 222/439] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 12:59:59 2022] GET /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:59.684517 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e937e-d377-4f2c-8bbe-c1ab5b296ab7 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:59.702574 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c060a08-3512-410d-81ea-e18f7f62d485 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:59.747782 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406c2cb-4582-49c1-9a4d-42b3c0eb073d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:59.748965 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406c2cb-4582-49c1-9a4d-42b3c0eb073d None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:59.749472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406c2cb-4582-49c1-9a4d-42b3c0eb073d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:59.749957 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406c2cb-4582-49c1-9a4d-42b3c0eb073d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:59.762384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406c2cb-4582-49c1-9a4d-42b3c0eb073d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 12:59:59.769756 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-c406c2cb-4582-49c1-9a4d-42b3c0eb073d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 12:59:59.771133 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 218/440] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 12:59:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 12:59:59.777142 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406c2cb-4582-49c1-9a4d-42b3c0eb073d None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:59.802883 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e937e-d377-4f2c-8bbe-c1ab5b296ab7 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:59.837546 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25df0a7-114e-4d7b-b084-5d3d8fc4280f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:59.838399 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25df0a7-114e-4d7b-b084-5d3d8fc4280f None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:59.838680 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25df0a7-114e-4d7b-b084-5d3d8fc4280f None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:59.839023 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25df0a7-114e-4d7b-b084-5d3d8fc4280f None admin] PATH_INFO: `/v3/groups/400a83e783324df3a27d637435d3a6b2` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:59.840525 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25df0a7-114e-4d7b-b084-5d3d8fc4280f None admin] RBAC: Authorizing `identity:get_group(group_id=400a83e783324df3a27d637435d3a6b2)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:59.841992 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25df0a7-114e-4d7b-b084-5d3d8fc4280f None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:59.843603 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 223/441] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 12:59:59 2022] GET /identity/v3/groups/400a83e783324df3a27d637435d3a6b2 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:59:59.849353 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25df0a7-114e-4d7b-b084-5d3d8fc4280f None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:59.879536 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406c2cb-4582-49c1-9a4d-42b3c0eb073d None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:59.914226 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d025a-912a-43b1-a5d2-b641c677b502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:59.914909 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d025a-912a-43b1-a5d2-b641c677b502 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:59.915244 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d025a-912a-43b1-a5d2-b641c677b502 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:59.915527 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d025a-912a-43b1-a5d2-b641c677b502 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:59.916276 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d025a-912a-43b1-a5d2-b641c677b502 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:59.916579 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d025a-912a-43b1-a5d2-b641c677b502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:59.918960 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d025a-912a-43b1-a5d2-b641c677b502 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:59.927245 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 219/442] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 12:59:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:59:59.932551 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d025a-912a-43b1-a5d2-b641c677b502 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:59:59.953869 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25df0a7-114e-4d7b-b084-5d3d8fc4280f None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:59:59.986365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4119676-d61b-47ea-882d-3172e036136c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:59:59.987047 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4119676-d61b-47ea-882d-3172e036136c None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:59:59.987327 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4119676-d61b-47ea-882d-3172e036136c None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:59:59.987601 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4119676-d61b-47ea-882d-3172e036136c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:59:59.988424 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4119676-d61b-47ea-882d-3172e036136c None admin] RBAC: Adding query filter params (group.id=400a83e783324df3a27d637435d3a6b2, role.id=e34b765cca514a83bef6eb9cff7ef871, scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:59:59.988843 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4119676-d61b-47ea-882d-3172e036136c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:59:59.990266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4119676-d61b-47ea-882d-3172e036136c None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:59:59.996707 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 224/443] 10.222.0.52 () {56 vars in 1376 bytes} [Tue Mar 8 12:59:59 2022] GET /identity/v3/role_assignments?group.id=400a83e783324df3a27d637435d3a6b2&scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68&role.id=e34b765cca514a83bef6eb9cff7ef871 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:00.033058 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d025a-912a-43b1-a5d2-b641c677b502 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:00.068073 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997f8d8-d96c-42c9-9358-d97177a0dc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:00.068753 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997f8d8-d96c-42c9-9358-d97177a0dc32 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:00.069039 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997f8d8-d96c-42c9-9358-d97177a0dc32 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:00.069314 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997f8d8-d96c-42c9-9358-d97177a0dc32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:00.139972 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997f8d8-d96c-42c9-9358-d97177a0dc32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:00.141487 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997f8d8-d96c-42c9-9358-d97177a0dc32 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:00.243448 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 220/444] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 12:59:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 13:00:00.249993 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4119676-d61b-47ea-882d-3172e036136c None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:00.254974 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be27d5-1b66-455a-8862-aa712ce09de1 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:00.255262 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be27d5-1b66-455a-8862-aa712ce09de1 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:00.255539 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be27d5-1b66-455a-8862-aa712ce09de1 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:00.257527 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 221/445] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:00:00.262691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33019dfd-ab86-4091-8099-2985298c3aa4 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:00.262976 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33019dfd-ab86-4091-8099-2985298c3aa4 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:00.263445 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33019dfd-ab86-4091-8099-2985298c3aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:00.280443 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-33019dfd-ab86-4091-8099-2985298c3aa4 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:00.281658 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-33019dfd-ab86-4091-8099-2985298c3aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:00.367392 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 222/446] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:00:00.367570 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4119676-d61b-47ea-882d-3172e036136c None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:00.390682 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33019dfd-ab86-4091-8099-2985298c3aa4 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:00.403800 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559ebc2-1d19-41cc-bfe8-3659f25fa7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:00.404974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559ebc2-1d19-41cc-bfe8-3659f25fa7f6 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:00.405543 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559ebc2-1d19-41cc-bfe8-3659f25fa7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:00.405543 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559ebc2-1d19-41cc-bfe8-3659f25fa7f6 None admin] PATH_INFO: `/v3/projects/9bf8304032614352a7ca4a6088a17c23` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:00.406712 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559ebc2-1d19-41cc-bfe8-3659f25fa7f6 None admin] RBAC: Authorizing `identity:get_project(project_id=9bf8304032614352a7ca4a6088a17c23)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:00.408214 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559ebc2-1d19-41cc-bfe8-3659f25fa7f6 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:00.410200 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 225/447] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 13:00:00 2022] GET /identity/v3/projects/9bf8304032614352a7ca4a6088a17c23 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:00.415383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559ebc2-1d19-41cc-bfe8-3659f25fa7f6 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:00.488525 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33019dfd-ab86-4091-8099-2985298c3aa4 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:00.508326 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559ebc2-1d19-41cc-bfe8-3659f25fa7f6 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:00.520473 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f72e4-a903-4929-8b90-1ad34ad013f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:00.521293 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f72e4-a903-4929-8b90-1ad34ad013f9 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:00.521572 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f72e4-a903-4929-8b90-1ad34ad013f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:00.521855 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f72e4-a903-4929-8b90-1ad34ad013f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:00.531970 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f72e4-a903-4929-8b90-1ad34ad013f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:00.539387 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-299f72e4-a903-4929-8b90-1ad34ad013f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 13:00:00.540565 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 223/448] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 13:00:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:00.541369 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be61826-b215-4a58-a790-aec0f1e0438d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:00.542839 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be61826-b215-4a58-a790-aec0f1e0438d None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:00.543114 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be61826-b215-4a58-a790-aec0f1e0438d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:00.543381 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be61826-b215-4a58-a790-aec0f1e0438d None admin] PATH_INFO: `/v3/groups/925a301cc96b4191ba3a9bee4904459b` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:00.544636 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be61826-b215-4a58-a790-aec0f1e0438d None admin] RBAC: Authorizing `identity:get_group(group_id=925a301cc96b4191ba3a9bee4904459b)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:00.546308 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be61826-b215-4a58-a790-aec0f1e0438d None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:00.547144 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f72e4-a903-4929-8b90-1ad34ad013f9 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:00.547771 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 226/449] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 13:00:00 2022] GET /identity/v3/groups/925a301cc96b4191ba3a9bee4904459b => generated 229 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:00.553238 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be61826-b215-4a58-a790-aec0f1e0438d None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:00.642230 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f72e4-a903-4929-8b90-1ad34ad013f9 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:00.657544 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be61826-b215-4a58-a790-aec0f1e0438d None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:00.674233 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d3b15-e7f3-4f94-ac6d-bbfc91e8b858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:00.674885 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d3b15-e7f3-4f94-ac6d-bbfc91e8b858 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:00.675162 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d3b15-e7f3-4f94-ac6d-bbfc91e8b858 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:00.675432 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d3b15-e7f3-4f94-ac6d-bbfc91e8b858 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:00.676171 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d3b15-e7f3-4f94-ac6d-bbfc91e8b858 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:00.676474 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d3b15-e7f3-4f94-ac6d-bbfc91e8b858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:00.677875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d3b15-e7f3-4f94-ac6d-bbfc91e8b858 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:00.685888 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 224/450] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:00.689408 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b212ff2-5e52-410a-b819-1a9672274c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:00.690052 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b212ff2-5e52-410a-b819-1a9672274c3a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:00.690328 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b212ff2-5e52-410a-b819-1a9672274c3a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:00.690601 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b212ff2-5e52-410a-b819-1a9672274c3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:00.691265 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d3b15-e7f3-4f94-ac6d-bbfc91e8b858 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:00.691415 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b212ff2-5e52-410a-b819-1a9672274c3a None admin] RBAC: Adding query filter params (group.id=925a301cc96b4191ba3a9bee4904459b, role.id=f9ec85924a914e078096b38cae4e6caa, scope.project.id=9bf8304032614352a7ca4a6088a17c23) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:00.691721 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b212ff2-5e52-410a-b819-1a9672274c3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:00.693167 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b212ff2-5e52-410a-b819-1a9672274c3a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:00.698912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 227/451] 10.222.0.52 () {56 vars in 1376 bytes} [Tue Mar 8 13:00:00 2022] GET /identity/v3/role_assignments?group.id=925a301cc96b4191ba3a9bee4904459b&scope.project.id=9bf8304032614352a7ca4a6088a17c23&role.id=f9ec85924a914e078096b38cae4e6caa => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:00.796962 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d3b15-e7f3-4f94-ac6d-bbfc91e8b858 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:00.830345 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d668ac-206b-420a-948d-0ffc4bc76b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:00.831000 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d668ac-206b-420a-948d-0ffc4bc76b08 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:00.831279 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d668ac-206b-420a-948d-0ffc4bc76b08 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:00.831550 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d668ac-206b-420a-948d-0ffc4bc76b08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:00.898645 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d668ac-206b-420a-948d-0ffc4bc76b08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:00.900135 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d668ac-206b-420a-948d-0ffc4bc76b08 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:00.994029 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 225/452] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:00:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 13:00:01.000180 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b212ff2-5e52-410a-b819-1a9672274c3a None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:01.092640 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b212ff2-5e52-410a-b819-1a9672274c3a None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:01.125135 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f525a-b65c-4b22-8563-dd384bb48678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:01.125970 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f525a-b65c-4b22-8563-dd384bb48678 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:01.126248 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f525a-b65c-4b22-8563-dd384bb48678 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:01.126517 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f525a-b65c-4b22-8563-dd384bb48678 None admin] PATH_INFO: `/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:01.127669 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f525a-b65c-4b22-8563-dd384bb48678 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ce0a6eef414c84f1dabaf084bd68)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:01.129135 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f525a-b65c-4b22-8563-dd384bb48678 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:01.130794 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 228/453] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 13:00:00 2022] GET /identity/v3/projects/a7a5ce0a6eef414c84f1dabaf084bd68 => generated 302 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:01.136227 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d668ac-206b-420a-948d-0ffc4bc76b08 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:01.226942 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d668ac-206b-420a-948d-0ffc4bc76b08 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:01.258892 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a1753-b38b-46d4-b101-8e3181efe193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:01.259726 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a1753-b38b-46d4-b101-8e3181efe193 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:01.260003 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a1753-b38b-46d4-b101-8e3181efe193 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:01.260275 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a1753-b38b-46d4-b101-8e3181efe193 None admin] PATH_INFO: `/v3/groups/400a83e783324df3a27d637435d3a6b2` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:01.261478 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a1753-b38b-46d4-b101-8e3181efe193 None admin] RBAC: Authorizing `identity:get_group(group_id=400a83e783324df3a27d637435d3a6b2)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:01.262904 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a1753-b38b-46d4-b101-8e3181efe193 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:01.264451 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 226/454] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 13:00:01 2022] GET /identity/v3/groups/400a83e783324df3a27d637435d3a6b2 => generated 226 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:01.270002 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f525a-b65c-4b22-8563-dd384bb48678 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:01.363341 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f525a-b65c-4b22-8563-dd384bb48678 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:01.395388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7d555-19df-4c9c-bc08-a292410edafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:01.396027 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7d555-19df-4c9c-bc08-a292410edafb None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:01.396311 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7d555-19df-4c9c-bc08-a292410edafb None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:01.396584 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7d555-19df-4c9c-bc08-a292410edafb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:01.397443 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7d555-19df-4c9c-bc08-a292410edafb None admin] RBAC: Adding query filter params (group.id=400a83e783324df3a27d637435d3a6b2, role.id=a08ab7d3851a43ac8ed5339681d7de91, scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:01.397752 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7d555-19df-4c9c-bc08-a292410edafb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:01.399175 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7d555-19df-4c9c-bc08-a292410edafb None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:01.405433 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 229/455] 10.222.0.52 () {56 vars in 1376 bytes} [Tue Mar 8 13:00:01 2022] GET /identity/v3/role_assignments?group.id=400a83e783324df3a27d637435d3a6b2&scope.project.id=a7a5ce0a6eef414c84f1dabaf084bd68&role.id=a08ab7d3851a43ac8ed5339681d7de91 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:04.312371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ece26-dc93-4412-ba6c-f620421b3427 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:04.312910 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ece26-dc93-4412-ba6c-f620421b3427 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:04.312987 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ece26-dc93-4412-ba6c-f620421b3427 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:04.315103 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 227/456] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:04.321203 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a42b32-6cb0-49fa-9cbb-8f2450b3e6ba None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:04.322103 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a42b32-6cb0-49fa-9cbb-8f2450b3e6ba None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:04.322572 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a42b32-6cb0-49fa-9cbb-8f2450b3e6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:04.340244 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-a9a42b32-6cb0-49fa-9cbb-8f2450b3e6ba None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:04.341765 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a9a42b32-6cb0-49fa-9cbb-8f2450b3e6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:04.413508 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 230/457] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:00:04.435206 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ece26-dc93-4412-ba6c-f620421b3427 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:04.537798 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ece26-dc93-4412-ba6c-f620421b3427 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:04.546727 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f9f16-57e2-4c23-b8c9-ddf98dc03560 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:04.547309 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f9f16-57e2-4c23-b8c9-ddf98dc03560 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:04.547800 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f9f16-57e2-4c23-b8c9-ddf98dc03560 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:04.550088 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 231/458] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:04.556685 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a33b4-f477-4229-b4b6-4f41974e4cdb None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:04.556685 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a33b4-f477-4229-b4b6-4f41974e4cdb None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:04.556685 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a33b4-f477-4229-b4b6-4f41974e4cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:04.574084 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395af82-b6e8-4841-ad37-348b0e8decab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:04.574796 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395af82-b6e8-4841-ad37-348b0e8decab None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:04.575074 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395af82-b6e8-4841-ad37-348b0e8decab None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:04.575344 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395af82-b6e8-4841-ad37-348b0e8decab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:04.586424 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395af82-b6e8-4841-ad37-348b0e8decab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:04.587893 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395af82-b6e8-4841-ad37-348b0e8decab None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:04.588311 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-242a33b4-f477-4229-b4b6-4f41974e4cdb None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:04.590298 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-242a33b4-f477-4229-b4b6-4f41974e4cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:04.607495 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-4395af82-b6e8-4841-ad37-348b0e8decab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:04.613210 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 228/459] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:04.616107 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395af82-b6e8-4841-ad37-348b0e8decab None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:04.694488 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 232/460] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:00:04.696181 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e72b8-1deb-49e8-89cf-cd8a6e53d2cc None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:04.697076 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e72b8-1deb-49e8-89cf-cd8a6e53d2cc None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:04.697495 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e72b8-1deb-49e8-89cf-cd8a6e53d2cc None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:04.700431 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 233/461] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:04.715051 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1287088-6dc4-454b-a201-1563c866371f None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:04.715588 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1287088-6dc4-454b-a201-1563c866371f None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:04.716001 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1287088-6dc4-454b-a201-1563c866371f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:04.727939 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395af82-b6e8-4841-ad37-348b0e8decab None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:04.738308 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-d1287088-6dc4-454b-a201-1563c866371f None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:04.740182 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-d1287088-6dc4-454b-a201-1563c866371f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:04.773268 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82389e9f-c58c-41c6-9a9a-e3801772838a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:04.774735 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389e9f-c58c-41c6-9a9a-e3801772838a None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:04.775176 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389e9f-c58c-41c6-9a9a-e3801772838a None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:04.775598 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389e9f-c58c-41c6-9a9a-e3801772838a None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:04.777646 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82389e9f-c58c-41c6-9a9a-e3801772838a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:04.778374 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82389e9f-c58c-41c6-9a9a-e3801772838a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:04.780164 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82389e9f-c58c-41c6-9a9a-e3801772838a None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:04.794807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 229/462] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:04.796447 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82389e9f-c58c-41c6-9a9a-e3801772838a None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:04.815871 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 234/463] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:04.821719 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1287088-6dc4-454b-a201-1563c866371f None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:04.917603 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82389e9f-c58c-41c6-9a9a-e3801772838a None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:04.958625 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefecea9-7972-4489-8299-77e15ae96f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:04.959422 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefecea9-7972-4489-8299-77e15ae96f8e None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:04.959707 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefecea9-7972-4489-8299-77e15ae96f8e None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:04.959875 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1287088-6dc4-454b-a201-1563c866371f None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:04.959984 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefecea9-7972-4489-8299-77e15ae96f8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:04.970907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefecea9-7972-4489-8299-77e15ae96f8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:04.972386 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefecea9-7972-4489-8299-77e15ae96f8e None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:04.989257 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-fefecea9-7972-4489-8299-77e15ae96f8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:04.990728 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 230/464] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:04.995869 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb2b78-c064-44aa-ad2e-ec5a1c7ff249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:04.997024 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefecea9-7972-4489-8299-77e15ae96f8e None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:04.997169 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb2b78-c064-44aa-ad2e-ec5a1c7ff249 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:04.997601 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb2b78-c064-44aa-ad2e-ec5a1c7ff249 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:04.998014 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb2b78-c064-44aa-ad2e-ec5a1c7ff249 None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:04.998856 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb2b78-c064-44aa-ad2e-ec5a1c7ff249 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:05.000437 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb2b78-c064-44aa-ad2e-ec5a1c7ff249 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:05.073758 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 235/465] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 13:00:04 2022] POST /identity/v3/users => generated 246 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:00:05.075149 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb2b78-c064-44aa-ad2e-ec5a1c7ff249 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:05.100976 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefecea9-7972-4489-8299-77e15ae96f8e None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:05.204968 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724bc3a-f3c3-4c8c-b18a-4c7a307cb30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:05.206040 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724bc3a-f3c3-4c8c-b18a-4c7a307cb30d None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:05.206468 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724bc3a-f3c3-4c8c-b18a-4c7a307cb30d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:05.206915 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724bc3a-f3c3-4c8c-b18a-4c7a307cb30d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:05.210228 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb2b78-c064-44aa-ad2e-ec5a1c7ff249 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:05.220481 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724bc3a-f3c3-4c8c-b18a-4c7a307cb30d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:05.222410 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724bc3a-f3c3-4c8c-b18a-4c7a307cb30d None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:05.240879 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-e724bc3a-f3c3-4c8c-b18a-4c7a307cb30d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:05.242832 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 231/466] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:05.244437 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca92e5-2aff-440f-9fc7-93e7ebf7b935 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:05.245726 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca92e5-2aff-440f-9fc7-93e7ebf7b935 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:05.246345 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca92e5-2aff-440f-9fc7-93e7ebf7b935 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:05.248647 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 232/467] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:05.249698 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca92e5-2aff-440f-9fc7-93e7ebf7b935 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:05.257383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7f3aa-f6ee-42bd-9216-b019f028870f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:05.258080 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7f3aa-f6ee-42bd-9216-b019f028870f None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:05.258362 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7f3aa-f6ee-42bd-9216-b019f028870f None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:05.258640 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7f3aa-f6ee-42bd-9216-b019f028870f None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:05.259383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7f3aa-f6ee-42bd-9216-b019f028870f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:05.259690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7f3aa-f6ee-42bd-9216-b019f028870f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:05.261845 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7f3aa-f6ee-42bd-9216-b019f028870f None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:05.280412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 236/468] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:05.280412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28487d33-c95a-468d-8e48-ea52b7d8d40f None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:05.280412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28487d33-c95a-468d-8e48-ea52b7d8d40f None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:05.280412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28487d33-c95a-468d-8e48-ea52b7d8d40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:05.299672 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-28487d33-c95a-468d-8e48-ea52b7d8d40f None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:05.300874 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-28487d33-c95a-468d-8e48-ea52b7d8d40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:05.378536 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 237/469] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:05.379301 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28487d33-c95a-468d-8e48-ea52b7d8d40f None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:05.387737 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca92e5-2aff-440f-9fc7-93e7ebf7b935 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:05.434115 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e1901-0965-4349-a39a-91354f56f811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:05.435028 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e1901-0965-4349-a39a-91354f56f811 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:05.435487 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e1901-0965-4349-a39a-91354f56f811 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:05.435908 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e1901-0965-4349-a39a-91354f56f811 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:05.436823 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e1901-0965-4349-a39a-91354f56f811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:05.437278 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e1901-0965-4349-a39a-91354f56f811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:05.438821 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e1901-0965-4349-a39a-91354f56f811 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:05.455951 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 233/470] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:05.457239 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e1901-0965-4349-a39a-91354f56f811 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:05.491366 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28487d33-c95a-468d-8e48-ea52b7d8d40f None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:05.525946 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80963b31-983a-42db-9fa2-9e256b2c87a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:05.526877 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80963b31-983a-42db-9fa2-9e256b2c87a2 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:05.527319 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80963b31-983a-42db-9fa2-9e256b2c87a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:05.527742 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80963b31-983a-42db-9fa2-9e256b2c87a2 None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:05.528578 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80963b31-983a-42db-9fa2-9e256b2c87a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:05.530579 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80963b31-983a-42db-9fa2-9e256b2c87a2 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:05.562306 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e1901-0965-4349-a39a-91354f56f811 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:05.597081 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b4cd9-7fd2-4d22-be39-c6841f6efa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:05.597870 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b4cd9-7fd2-4d22-be39-c6841f6efa9b None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:05.598150 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b4cd9-7fd2-4d22-be39-c6841f6efa9b None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:05.598418 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b4cd9-7fd2-4d22-be39-c6841f6efa9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:05.609038 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b4cd9-7fd2-4d22-be39-c6841f6efa9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:05.610494 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b4cd9-7fd2-4d22-be39-c6841f6efa9b None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:05.628196 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-682b4cd9-7fd2-4d22-be39-c6841f6efa9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:05.634387 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 234/471] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:05.634387 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b4cd9-7fd2-4d22-be39-c6841f6efa9b None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:05.656808 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 238/472] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 13:00:05 2022] POST /identity/v3/users => generated 248 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:00:05.658197 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80963b31-983a-42db-9fa2-9e256b2c87a2 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:05.764328 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b4cd9-7fd2-4d22-be39-c6841f6efa9b None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:05.804894 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17c765-dfc1-4d3a-a6a0-e63ceb46d444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:05.805846 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17c765-dfc1-4d3a-a6a0-e63ceb46d444 None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:05.806290 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17c765-dfc1-4d3a-a6a0-e63ceb46d444 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:05.806871 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17c765-dfc1-4d3a-a6a0-e63ceb46d444 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:05.808597 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17c765-dfc1-4d3a-a6a0-e63ceb46d444 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:05.810488 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17c765-dfc1-4d3a-a6a0-e63ceb46d444 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:05.870027 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80963b31-983a-42db-9fa2-9e256b2c87a2 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:05.917073 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ff4ac-c58b-481a-86f3-6e56d0483a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:05.918019 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ff4ac-c58b-481a-86f3-6e56d0483a70 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:05.918306 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ff4ac-c58b-481a-86f3-6e56d0483a70 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:05.918580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ff4ac-c58b-481a-86f3-6e56d0483a70 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:05.919368 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ff4ac-c58b-481a-86f3-6e56d0483a70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:05.919751 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ff4ac-c58b-481a-86f3-6e56d0483a70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:05.921318 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ff4ac-c58b-481a-86f3-6e56d0483a70 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:05.921765 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 235/473] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 13:00:05 2022] POST /identity/v3/users => generated 248 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:00:05.940155 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 239/474] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:05.946016 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17c765-dfc1-4d3a-a6a0-e63ceb46d444 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:06.064103 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fac40e-2d67-49c4-ac1d-35dcad1561a0 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:06.064766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fac40e-2d67-49c4-ac1d-35dcad1561a0 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:06.065268 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fac40e-2d67-49c4-ac1d-35dcad1561a0 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:06.070864 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 240/475] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:00:06.074968 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853eba4-dc53-4dae-95ba-9f0cef00f62e None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:06.075509 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853eba4-dc53-4dae-95ba-9f0cef00f62e None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:06.075988 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853eba4-dc53-4dae-95ba-9f0cef00f62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:06.091064 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17c765-dfc1-4d3a-a6a0-e63ceb46d444 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:06.098225 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-7853eba4-dc53-4dae-95ba-9f0cef00f62e None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:06.100461 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-7853eba4-dc53-4dae-95ba-9f0cef00f62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:06.138118 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b07b8-00e8-4008-ad3c-651ca8403ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:06.138804 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b07b8-00e8-4008-ad3c-651ca8403ea7 None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:06.139091 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b07b8-00e8-4008-ad3c-651ca8403ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:06.139366 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b07b8-00e8-4008-ad3c-651ca8403ea7 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:06.140497 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b07b8-00e8-4008-ad3c-651ca8403ea7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:06.142272 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b07b8-00e8-4008-ad3c-651ca8403ea7 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:06.188868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 241/476] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:00:06.212322 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853eba4-dc53-4dae-95ba-9f0cef00f62e None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:06.269523 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 236/477] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 13:00:05 2022] POST /identity/v3/users => generated 249 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:00:06.337500 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853eba4-dc53-4dae-95ba-9f0cef00f62e None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:06.386051 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8900e2-888a-4674-b8ad-ea6772f1c816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:06.387046 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8900e2-888a-4674-b8ad-ea6772f1c816 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:06.387341 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8900e2-888a-4674-b8ad-ea6772f1c816 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:06.387689 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8900e2-888a-4674-b8ad-ea6772f1c816 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:06.388465 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8900e2-888a-4674-b8ad-ea6772f1c816 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:06.390024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8900e2-888a-4674-b8ad-ea6772f1c816 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:06.439530 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.sql.core [None req-1e8900e2-888a-4674-b8ad-ea6772f1c816 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Mar 08 13:00:06.439530 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Mar 08 13:00:06.439530 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [parameters: {'id': '02a5b7fa6fe84b5680a1187bf41c670b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Mar 08 13:00:06.439530 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79793) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 08 13:00:06.455650 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-1e8900e2-888a-4674-b8ad-ea6772f1c816 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Mar 08 13:00:06.461951 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 242/478] 10.222.0.52 () {60 vars in 1131 bytes} [Tue Mar 8 13:00:06 2022] POST /identity/v3/roles => generated 144 bytes in 246 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:06.463896 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b07b8-00e8-4008-ad3c-651ca8403ea7 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:06.586479 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b07b8-00e8-4008-ad3c-651ca8403ea7 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:06.626246 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea5fbc-c133-4c05-85b3-0bd0af2bfa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:06.626982 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea5fbc-c133-4c05-85b3-0bd0af2bfa26 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:06.627268 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea5fbc-c133-4c05-85b3-0bd0af2bfa26 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:06.627538 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea5fbc-c133-4c05-85b3-0bd0af2bfa26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:06.645646 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea5fbc-c133-4c05-85b3-0bd0af2bfa26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:06.653092 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-22ea5fbc-c133-4c05-85b3-0bd0af2bfa26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 13:00:06.654983 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 237/479] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 13:00:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:06.660428 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8900e2-888a-4674-b8ad-ea6772f1c816 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:06.774717 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8900e2-888a-4674-b8ad-ea6772f1c816 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:06.809791 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc23719-1247-474f-8fcf-a5453bdf3d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:06.810458 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc23719-1247-474f-8fcf-a5453bdf3d13 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:06.810734 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc23719-1247-474f-8fcf-a5453bdf3d13 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:06.811006 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc23719-1247-474f-8fcf-a5453bdf3d13 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:06.811748 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc23719-1247-474f-8fcf-a5453bdf3d13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:06.812049 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc23719-1247-474f-8fcf-a5453bdf3d13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:06.813476 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc23719-1247-474f-8fcf-a5453bdf3d13 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:06.821711 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 243/480] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:07.773121 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ebf31-afea-4479-8bc3-794f2ede0b96 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:07.773632 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ebf31-afea-4479-8bc3-794f2ede0b96 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:07.773707 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ebf31-afea-4479-8bc3-794f2ede0b96 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:07.775816 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 238/481] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:07.781032 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34c100-bb82-45d2-9c26-0c21ce59ba2d None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:07.781859 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34c100-bb82-45d2-9c26-0c21ce59ba2d None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:07.782336 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34c100-bb82-45d2-9c26-0c21ce59ba2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:07.804100 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-5d34c100-bb82-45d2-9c26-0c21ce59ba2d None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:07.805619 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-5d34c100-bb82-45d2-9c26-0c21ce59ba2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:07.897991 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 244/482] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:00:07.933712 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ebf31-afea-4479-8bc3-794f2ede0b96 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:08.058382 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ebf31-afea-4479-8bc3-794f2ede0b96 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:08.109179 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69013820-aba3-415c-8c36-244a98ba9917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:08.110343 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69013820-aba3-415c-8c36-244a98ba9917 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:08.110830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69013820-aba3-415c-8c36-244a98ba9917 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:08.111350 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69013820-aba3-415c-8c36-244a98ba9917 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:08.123169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69013820-aba3-415c-8c36-244a98ba9917 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:08.130793 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-69013820-aba3-415c-8c36-244a98ba9917 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:00:08.132821 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 239/483] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:08.139214 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34c100-bb82-45d2-9c26-0c21ce59ba2d None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:08.263365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34c100-bb82-45d2-9c26-0c21ce59ba2d None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:08.304123 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee730d97-b4ff-44dd-8615-b2782ce8bb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:08.304824 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee730d97-b4ff-44dd-8615-b2782ce8bb6e None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:08.305110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee730d97-b4ff-44dd-8615-b2782ce8bb6e None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:08.305384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee730d97-b4ff-44dd-8615-b2782ce8bb6e None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:08.306129 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee730d97-b4ff-44dd-8615-b2782ce8bb6e None admin] RBAC: Adding query filter params (name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:08.306430 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee730d97-b4ff-44dd-8615-b2782ce8bb6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:08.308373 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee730d97-b4ff-44dd-8615-b2782ce8bb6e None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:08.316912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 245/484] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:00:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:08.322217 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69013820-aba3-415c-8c36-244a98ba9917 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:08.491543 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69013820-aba3-415c-8c36-244a98ba9917 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:08.532371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d961573-18e0-4f82-ad7e-1ca4beb0337b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:08.533193 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d961573-18e0-4f82-ad7e-1ca4beb0337b None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:08.533472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d961573-18e0-4f82-ad7e-1ca4beb0337b None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:08.533744 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d961573-18e0-4f82-ad7e-1ca4beb0337b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:08.545459 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d961573-18e0-4f82-ad7e-1ca4beb0337b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:08.546929 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d961573-18e0-4f82-ad7e-1ca4beb0337b None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:08.579529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-4d961573-18e0-4f82-ad7e-1ca4beb0337b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:08.579529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 240/485] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:08.580280 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee730d97-b4ff-44dd-8615-b2782ce8bb6e None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:08.737021 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40993e2c-91e5-42d9-9161-b98e15305edd None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:08.737386 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40993e2c-91e5-42d9-9161-b98e15305edd None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:08.737579 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40993e2c-91e5-42d9-9161-b98e15305edd None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:08.739390 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 241/486] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:00:08.758669 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324220fa-9071-48b1-9df2-393f7208ddec None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:08.758970 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324220fa-9071-48b1-9df2-393f7208ddec None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:08.759231 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324220fa-9071-48b1-9df2-393f7208ddec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:08.769266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee730d97-b4ff-44dd-8615-b2782ce8bb6e None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:08.789635 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-324220fa-9071-48b1-9df2-393f7208ddec None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:08.790829 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-324220fa-9071-48b1-9df2-393f7208ddec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:08.813902 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173602b4-28ef-4b60-97ab-9bb5fb0a9ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:08.814564 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173602b4-28ef-4b60-97ab-9bb5fb0a9ad7 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:08.814845 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173602b4-28ef-4b60-97ab-9bb5fb0a9ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:08.815119 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173602b4-28ef-4b60-97ab-9bb5fb0a9ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:08.815835 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173602b4-28ef-4b60-97ab-9bb5fb0a9ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:08.816138 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173602b4-28ef-4b60-97ab-9bb5fb0a9ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:08.817531 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173602b4-28ef-4b60-97ab-9bb5fb0a9ad7 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:08.837950 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 246/487] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:08.843351 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173602b4-28ef-4b60-97ab-9bb5fb0a9ad7 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:08.886246 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 242/488] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:08.929189 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324220fa-9071-48b1-9df2-393f7208ddec None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:08.980080 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173602b4-28ef-4b60-97ab-9bb5fb0a9ad7 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:09.025391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738aead-b9e3-482a-b3ea-78a989b8adba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:09.026775 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738aead-b9e3-482a-b3ea-78a989b8adba None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:09.027133 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738aead-b9e3-482a-b3ea-78a989b8adba None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:09.027433 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738aead-b9e3-482a-b3ea-78a989b8adba None admin] PATH_INFO: `/v3/users/nova` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:09.035392 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738aead-b9e3-482a-b3ea-78a989b8adba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:09.036858 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738aead-b9e3-482a-b3ea-78a989b8adba None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:09.066685 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-3738aead-b9e3-482a-b3ea-78a989b8adba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 13:00:09.068172 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 247/489] 10.222.0.52 () {56 vars in 1093 bytes} [Tue Mar 8 13:00:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:09.069439 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad6071-9642-4835-8030-94ff46675bc6 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:09.069718 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad6071-9642-4835-8030-94ff46675bc6 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:09.069990 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad6071-9642-4835-8030-94ff46675bc6 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:09.071923 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 248/490] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:09.074934 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324220fa-9071-48b1-9df2-393f7208ddec None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:09.077234 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ae998-0f68-4e0e-b699-44636f1a9b45 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:09.077522 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ae998-0f68-4e0e-b699-44636f1a9b45 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:09.077790 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ae998-0f68-4e0e-b699-44636f1a9b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:09.095787 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-bd0ae998-0f68-4e0e-b699-44636f1a9b45 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:09.097269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-bd0ae998-0f68-4e0e-b699-44636f1a9b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:09.110789 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547c669-1b2c-4f7a-9505-d57a90964ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:09.112065 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c669-1b2c-4f7a-9505-d57a90964ecb None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:09.112353 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c669-1b2c-4f7a-9505-d57a90964ecb None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:09.112628 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c669-1b2c-4f7a-9505-d57a90964ecb None admin] PATH_INFO: `/v3/roles/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:09.125727 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547c669-1b2c-4f7a-9505-d57a90964ecb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:09.132730 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-d547c669-1b2c-4f7a-9505-d57a90964ecb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:00:09.133935 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 243/491] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:09.134695 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547c669-1b2c-4f7a-9505-d57a90964ecb None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:09.165566 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 249/492] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:09.174115 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3fa52-6c4a-4f1b-bb96-3569c1573279 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:09.174450 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3fa52-6c4a-4f1b-bb96-3569c1573279 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:09.174730 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3fa52-6c4a-4f1b-bb96-3569c1573279 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:09.176576 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 250/493] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:09 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:09.177149 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3fa52-6c4a-4f1b-bb96-3569c1573279 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:09.240888 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547c669-1b2c-4f7a-9505-d57a90964ecb None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:09.275842 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f88d72-ac1c-407a-8e69-eb4ab7be41f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:09.276710 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f88d72-ac1c-407a-8e69-eb4ab7be41f7 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:09.277097 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f88d72-ac1c-407a-8e69-eb4ab7be41f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:09.277479 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f88d72-ac1c-407a-8e69-eb4ab7be41f7 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:09.278348 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f88d72-ac1c-407a-8e69-eb4ab7be41f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:09.278931 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f88d72-ac1c-407a-8e69-eb4ab7be41f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:09.280987 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3fa52-6c4a-4f1b-bb96-3569c1573279 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:09.281094 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f88d72-ac1c-407a-8e69-eb4ab7be41f7 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:09.315245 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34013753-956a-4921-8cac-e1af0ac65473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:09.316202 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34013753-956a-4921-8cac-e1af0ac65473 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:09.316488 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34013753-956a-4921-8cac-e1af0ac65473 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:09.319466 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34013753-956a-4921-8cac-e1af0ac65473 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:09.319466 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34013753-956a-4921-8cac-e1af0ac65473 None admin] RBAC: Adding query filter params (name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:09.319466 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34013753-956a-4921-8cac-e1af0ac65473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:09.319466 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34013753-956a-4921-8cac-e1af0ac65473 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:09.327620 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 251/494] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:00:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:09.328567 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 244/495] 10.222.0.52 () {56 vars in 1133 bytes} [Tue Mar 8 13:00:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:09.328964 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904c37f-c87f-46fb-adcc-4e113069983e None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:09.329247 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904c37f-c87f-46fb-adcc-4e113069983e None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:09.329521 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904c37f-c87f-46fb-adcc-4e113069983e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:09.330376 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f88d72-ac1c-407a-8e69-eb4ab7be41f7 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:09.346023 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-b904c37f-c87f-46fb-adcc-4e113069983e None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:09.347130 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b904c37f-c87f-46fb-adcc-4e113069983e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:09.418413 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 252/496] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:09.419729 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904c37f-c87f-46fb-adcc-4e113069983e None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:09.444678 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f88d72-ac1c-407a-8e69-eb4ab7be41f7 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:09.487511 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234476e-f2c0-4afa-be8a-d2f8849ab589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:09.488492 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234476e-f2c0-4afa-be8a-d2f8849ab589 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:09.488807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234476e-f2c0-4afa-be8a-d2f8849ab589 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:09.489125 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234476e-f2c0-4afa-be8a-d2f8849ab589 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:09.500357 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234476e-f2c0-4afa-be8a-d2f8849ab589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:09.507326 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-3234476e-f2c0-4afa-be8a-d2f8849ab589 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:00:09.512922 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 245/497] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:09.512922 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234476e-f2c0-4afa-be8a-d2f8849ab589 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:09.523454 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904c37f-c87f-46fb-adcc-4e113069983e None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:09.558545 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46457053-06f7-4dd0-afb9-7d8140df739b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:09.559337 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46457053-06f7-4dd0-afb9-7d8140df739b None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:09.559614 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46457053-06f7-4dd0-afb9-7d8140df739b None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:09.559882 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46457053-06f7-4dd0-afb9-7d8140df739b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:09.570074 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46457053-06f7-4dd0-afb9-7d8140df739b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:09.571559 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46457053-06f7-4dd0-afb9-7d8140df739b None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:09.589861 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-46457053-06f7-4dd0-afb9-7d8140df739b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:09.591126 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 253/498] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:09.591926 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46457053-06f7-4dd0-afb9-7d8140df739b None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:09.624607 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234476e-f2c0-4afa-be8a-d2f8849ab589 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:09.665245 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d459698-97e5-4b1f-901a-b3efc9661ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:09.665923 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d459698-97e5-4b1f-901a-b3efc9661ac7 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:09.666185 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d459698-97e5-4b1f-901a-b3efc9661ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:09.667570 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d459698-97e5-4b1f-901a-b3efc9661ac7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:09.711967 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46457053-06f7-4dd0-afb9-7d8140df739b None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:09.735614 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d459698-97e5-4b1f-901a-b3efc9661ac7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:09.737111 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d459698-97e5-4b1f-901a-b3efc9661ac7 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:09.747446 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea57e28-9403-445a-8749-761c3a41fbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:09.748550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea57e28-9403-445a-8749-761c3a41fbe2 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:09.748865 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea57e28-9403-445a-8749-761c3a41fbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:09.749142 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea57e28-9403-445a-8749-761c3a41fbe2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:09.759136 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea57e28-9403-445a-8749-761c3a41fbe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:09.766102 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-2ea57e28-9403-445a-8749-761c3a41fbe2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:00:09.772141 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 254/499] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:09.772141 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea57e28-9403-445a-8749-761c3a41fbe2 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:09.836952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 246/500] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:00:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:00:09.838938 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d459698-97e5-4b1f-901a-b3efc9661ac7 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:09.867430 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea57e28-9403-445a-8749-761c3a41fbe2 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:09.902131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4918a1-8429-4def-8e56-15fb952f0e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:09.902728 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4918a1-8429-4def-8e56-15fb952f0e91 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:09.903018 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4918a1-8429-4def-8e56-15fb952f0e91 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:09.903291 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4918a1-8429-4def-8e56-15fb952f0e91 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:09.904301 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4918a1-8429-4def-8e56-15fb952f0e91 None admin] RBAC: Adding query filter params (name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:09.904608 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4918a1-8429-4def-8e56-15fb952f0e91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:09.906202 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4918a1-8429-4def-8e56-15fb952f0e91 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:09.919197 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 255/501] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:00:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:09.919824 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4918a1-8429-4def-8e56-15fb952f0e91 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:09.935970 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d459698-97e5-4b1f-901a-b3efc9661ac7 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:09.968819 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5bef6-8f88-45ef-a3b7-cd74bb645dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:09.969478 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5bef6-8f88-45ef-a3b7-cd74bb645dd1 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:09.969762 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5bef6-8f88-45ef-a3b7-cd74bb645dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:09.970038 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5bef6-8f88-45ef-a3b7-cd74bb645dd1 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:09.970755 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5bef6-8f88-45ef-a3b7-cd74bb645dd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:09.971065 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5bef6-8f88-45ef-a3b7-cd74bb645dd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:09.972465 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5bef6-8f88-45ef-a3b7-cd74bb645dd1 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:09.983627 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 247/502] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:09.984403 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5bef6-8f88-45ef-a3b7-cd74bb645dd1 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:10.016598 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4918a1-8429-4def-8e56-15fb952f0e91 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:10.048679 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0f95d-f1d9-4f87-885f-662a259a1947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:10.049361 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0f95d-f1d9-4f87-885f-662a259a1947 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:10.049644 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0f95d-f1d9-4f87-885f-662a259a1947 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:10.049921 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0f95d-f1d9-4f87-885f-662a259a1947 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:10.050663 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0f95d-f1d9-4f87-885f-662a259a1947 None admin] RBAC: Adding query filter params (name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:10.050967 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0f95d-f1d9-4f87-885f-662a259a1947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:10.052345 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0f95d-f1d9-4f87-885f-662a259a1947 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:10.059934 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 256/503] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:00:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:10.060734 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0f95d-f1d9-4f87-885f-662a259a1947 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:10.080021 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5bef6-8f88-45ef-a3b7-cd74bb645dd1 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:10.111398 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19fc72-80f9-4d6f-905f-6e9b57753770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:10.112178 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19fc72-80f9-4d6f-905f-6e9b57753770 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:10.112459 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19fc72-80f9-4d6f-905f-6e9b57753770 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:10.112752 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19fc72-80f9-4d6f-905f-6e9b57753770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:10.123162 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19fc72-80f9-4d6f-905f-6e9b57753770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:10.124623 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19fc72-80f9-4d6f-905f-6e9b57753770 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:10.140920 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-cb19fc72-80f9-4d6f-905f-6e9b57753770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:10.142075 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 248/504] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:10.143249 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198aab8-599b-4477-9772-8b8b0e6c1ebf None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:10.143534 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198aab8-599b-4477-9772-8b8b0e6c1ebf None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:10.143808 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198aab8-599b-4477-9772-8b8b0e6c1ebf None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:10.145636 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 249/505] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:10.147230 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198aab8-599b-4477-9772-8b8b0e6c1ebf None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:10.158083 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0f95d-f1d9-4f87-885f-662a259a1947 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:10.190422 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2642747-6159-44f4-bb4e-005dd153b2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:10.191207 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2642747-6159-44f4-bb4e-005dd153b2c4 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:10.191481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2642747-6159-44f4-bb4e-005dd153b2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:10.191752 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2642747-6159-44f4-bb4e-005dd153b2c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:10.201817 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2642747-6159-44f4-bb4e-005dd153b2c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:10.203259 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2642747-6159-44f4-bb4e-005dd153b2c4 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:10.218963 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-a2642747-6159-44f4-bb4e-005dd153b2c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:10.220117 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 257/506] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:10.220893 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2642747-6159-44f4-bb4e-005dd153b2c4 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:10.248032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198aab8-599b-4477-9772-8b8b0e6c1ebf None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:10.279395 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cee23-44e8-41ce-a31b-3d135c689eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:10.280177 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cee23-44e8-41ce-a31b-3d135c689eec None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:10.280458 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cee23-44e8-41ce-a31b-3d135c689eec None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:10.280763 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cee23-44e8-41ce-a31b-3d135c689eec None admin] PATH_INFO: `/v3/users/glance` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:10.287909 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9cee23-44e8-41ce-a31b-3d135c689eec None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:10.289399 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9cee23-44e8-41ce-a31b-3d135c689eec None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:10.302903 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-ad9cee23-44e8-41ce-a31b-3d135c689eec None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 08 13:00:10.304124 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 250/507] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:00:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:10.304902 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cee23-44e8-41ce-a31b-3d135c689eec None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:10.317903 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2642747-6159-44f4-bb4e-005dd153b2c4 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:10.350469 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc2cea-857b-400d-8aef-101a407e05c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:10.351265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc2cea-857b-400d-8aef-101a407e05c2 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:10.351545 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc2cea-857b-400d-8aef-101a407e05c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:10.351815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc2cea-857b-400d-8aef-101a407e05c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:10.362492 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc2cea-857b-400d-8aef-101a407e05c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:10.363927 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc2cea-857b-400d-8aef-101a407e05c2 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:10.380150 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-ecdc2cea-857b-400d-8aef-101a407e05c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:10.381331 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 258/508] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:10.382539 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4c86f-1bbb-4fe4-894e-e314a970dfaf None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:10.382830 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4c86f-1bbb-4fe4-894e-e314a970dfaf None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:10.383100 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4c86f-1bbb-4fe4-894e-e314a970dfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:10.398935 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-67d4c86f-1bbb-4fe4-894e-e314a970dfaf None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:10.400103 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-67d4c86f-1bbb-4fe4-894e-e314a970dfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:10.402472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cee23-44e8-41ce-a31b-3d135c689eec None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:10.434436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f819c-52c8-48a0-aaa2-6744e6820158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:10.435094 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f819c-52c8-48a0-aaa2-6744e6820158 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:10.435376 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f819c-52c8-48a0-aaa2-6744e6820158 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:10.435648 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f819c-52c8-48a0-aaa2-6744e6820158 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:10.436364 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f819c-52c8-48a0-aaa2-6744e6820158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:10.436684 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f819c-52c8-48a0-aaa2-6744e6820158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:10.438084 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f819c-52c8-48a0-aaa2-6744e6820158 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:10.449436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 251/509] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:10.450056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f819c-52c8-48a0-aaa2-6744e6820158 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:10.462555 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 259/510] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:10.463969 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4c86f-1bbb-4fe4-894e-e314a970dfaf None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:10.552413 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f819c-52c8-48a0-aaa2-6744e6820158 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:10.558599 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4c86f-1bbb-4fe4-894e-e314a970dfaf None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:10.584758 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bc771-dcb5-4e4f-b322-7fa145221a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:10.585416 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bc771-dcb5-4e4f-b322-7fa145221a65 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:10.585701 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bc771-dcb5-4e4f-b322-7fa145221a65 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:10.585978 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bc771-dcb5-4e4f-b322-7fa145221a65 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:10.586696 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bc771-dcb5-4e4f-b322-7fa145221a65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:10.587001 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bc771-dcb5-4e4f-b322-7fa145221a65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:10.589095 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bc771-dcb5-4e4f-b322-7fa145221a65 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:10.591135 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b8d6b-4cb7-4968-bff7-0525d8360516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:10.591811 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b8d6b-4cb7-4968-bff7-0525d8360516 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:10.592087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b8d6b-4cb7-4968-bff7-0525d8360516 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:10.592359 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b8d6b-4cb7-4968-bff7-0525d8360516 None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:10.593247 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b8d6b-4cb7-4968-bff7-0525d8360516 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:10.593550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b8d6b-4cb7-4968-bff7-0525d8360516 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:10.594970 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b8d6b-4cb7-4968-bff7-0525d8360516 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:10.599969 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 252/511] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:10.600783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bc771-dcb5-4e4f-b322-7fa145221a65 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:10.632755 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 260/512] 10.222.0.52 () {56 vars in 1137 bytes} [Tue Mar 8 13:00:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:10.633583 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b8d6b-4cb7-4968-bff7-0525d8360516 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:10.703171 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bc771-dcb5-4e4f-b322-7fa145221a65 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:10.728424 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b8d6b-4cb7-4968-bff7-0525d8360516 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:10.734985 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1aa8a-4b43-4fb2-8b7e-a9f3675eec3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:10.735633 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1aa8a-4b43-4fb2-8b7e-a9f3675eec3f None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:10.735914 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1aa8a-4b43-4fb2-8b7e-a9f3675eec3f None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:10.736188 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1aa8a-4b43-4fb2-8b7e-a9f3675eec3f None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:10.736935 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1aa8a-4b43-4fb2-8b7e-a9f3675eec3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:10.737238 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1aa8a-4b43-4fb2-8b7e-a9f3675eec3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:10.738624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1aa8a-4b43-4fb2-8b7e-a9f3675eec3f None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:10.750671 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 253/513] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:10.751364 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1aa8a-4b43-4fb2-8b7e-a9f3675eec3f None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:10.762031 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d324906-9f25-4b94-8de7-01ece5ea5f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:10.762826 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d324906-9f25-4b94-8de7-01ece5ea5f3a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:10.763107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d324906-9f25-4b94-8de7-01ece5ea5f3a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:10.763380 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d324906-9f25-4b94-8de7-01ece5ea5f3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:10.769894 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d324906-9f25-4b94-8de7-01ece5ea5f3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:10.771349 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d324906-9f25-4b94-8de7-01ece5ea5f3a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:10.784874 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-3d324906-9f25-4b94-8de7-01ece5ea5f3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:10.786029 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 261/514] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:10.786779 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d324906-9f25-4b94-8de7-01ece5ea5f3a None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:10.844577 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1aa8a-4b43-4fb2-8b7e-a9f3675eec3f None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:10.875940 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64456cfc-800c-49ca-b751-440a56c7aac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:10.876769 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64456cfc-800c-49ca-b751-440a56c7aac4 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:10.877051 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64456cfc-800c-49ca-b751-440a56c7aac4 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:10.877323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64456cfc-800c-49ca-b751-440a56c7aac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:10.880515 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d324906-9f25-4b94-8de7-01ece5ea5f3a None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:10.887441 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64456cfc-800c-49ca-b751-440a56c7aac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:10.888951 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64456cfc-800c-49ca-b751-440a56c7aac4 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:10.905973 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-64456cfc-800c-49ca-b751-440a56c7aac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:10.907122 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 254/515] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:10.908070 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64456cfc-800c-49ca-b751-440a56c7aac4 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:10.913558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2a5b2-daa4-48c7-b9ed-745357e8f240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:10.914341 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2a5b2-daa4-48c7-b9ed-745357e8f240 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:10.914621 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2a5b2-daa4-48c7-b9ed-745357e8f240 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:10.914889 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2a5b2-daa4-48c7-b9ed-745357e8f240 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:10.922678 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2a5b2-daa4-48c7-b9ed-745357e8f240 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:10.924116 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2a5b2-daa4-48c7-b9ed-745357e8f240 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:10.937185 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-d4f2a5b2-daa4-48c7-b9ed-745357e8f240 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 08 13:00:10.938482 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 262/516] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:00:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:10.939229 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2a5b2-daa4-48c7-b9ed-745357e8f240 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:11.017276 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64456cfc-800c-49ca-b751-440a56c7aac4 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:11.037855 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2a5b2-daa4-48c7-b9ed-745357e8f240 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:11.051097 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec562b-f930-4d80-b583-42d72b8ad0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:11.051738 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec562b-f930-4d80-b583-42d72b8ad0f3 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:11.052015 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec562b-f930-4d80-b583-42d72b8ad0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:11.052301 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec562b-f930-4d80-b583-42d72b8ad0f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:11.071331 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a066fde-18c8-4f41-9072-c9b2288ea0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:11.072108 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a066fde-18c8-4f41-9072-c9b2288ea0f3 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:11.072431 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a066fde-18c8-4f41-9072-c9b2288ea0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:11.072740 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a066fde-18c8-4f41-9072-c9b2288ea0f3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:11.079873 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a066fde-18c8-4f41-9072-c9b2288ea0f3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:11.081355 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a066fde-18c8-4f41-9072-c9b2288ea0f3 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:11.094141 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-8a066fde-18c8-4f41-9072-c9b2288ea0f3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 08 13:00:11.095294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 263/517] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:11.096039 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a066fde-18c8-4f41-9072-c9b2288ea0f3 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:11.115769 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec562b-f930-4d80-b583-42d72b8ad0f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:11.117256 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec562b-f930-4d80-b583-42d72b8ad0f3 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:11.188163 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a066fde-18c8-4f41-9072-c9b2288ea0f3 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:11.208532 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 255/518] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:00:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:00:11.209385 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec562b-f930-4d80-b583-42d72b8ad0f3 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:11.223490 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a4476-1a12-490f-9747-2f8ea68e9f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:11.224138 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4476-1a12-490f-9747-2f8ea68e9f2b None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:11.224414 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4476-1a12-490f-9747-2f8ea68e9f2b None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:11.224714 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4476-1a12-490f-9747-2f8ea68e9f2b None admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:11.225500 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a4476-1a12-490f-9747-2f8ea68e9f2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:11.225801 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a4476-1a12-490f-9747-2f8ea68e9f2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:11.227230 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a4476-1a12-490f-9747-2f8ea68e9f2b None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:11.246000 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 264/519] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:11.246798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a4476-1a12-490f-9747-2f8ea68e9f2b None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:11.309003 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec562b-f930-4d80-b583-42d72b8ad0f3 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:11.345855 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798898fa-da5b-43a8-853c-cedfda603cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:11.346516 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798898fa-da5b-43a8-853c-cedfda603cd4 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:11.346617 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a4476-1a12-490f-9747-2f8ea68e9f2b None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:11.346796 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798898fa-da5b-43a8-853c-cedfda603cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:11.347072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798898fa-da5b-43a8-853c-cedfda603cd4 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:11.347797 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798898fa-da5b-43a8-853c-cedfda603cd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:11.348098 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798898fa-da5b-43a8-853c-cedfda603cd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:11.349602 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798898fa-da5b-43a8-853c-cedfda603cd4 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:11.361420 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 256/520] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:11.362304 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798898fa-da5b-43a8-853c-cedfda603cd4 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:11.379695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5229ac-80cb-492a-be55-df773fc09af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:11.380359 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5229ac-80cb-492a-be55-df773fc09af4 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:11.380637 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5229ac-80cb-492a-be55-df773fc09af4 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:11.380934 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5229ac-80cb-492a-be55-df773fc09af4 None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:11.381756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5229ac-80cb-492a-be55-df773fc09af4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:11.382059 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5229ac-80cb-492a-be55-df773fc09af4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:11.383491 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5229ac-80cb-492a-be55-df773fc09af4 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:11.399755 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 265/521] 10.222.0.52 () {56 vars in 1137 bytes} [Tue Mar 8 13:00:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:11.401089 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5229ac-80cb-492a-be55-df773fc09af4 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:11.460076 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798898fa-da5b-43a8-853c-cedfda603cd4 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:11.493165 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5229ac-80cb-492a-be55-df773fc09af4 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:11.498462 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3222396-021c-4fb0-8940-cab3603ff3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:11.499123 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3222396-021c-4fb0-8940-cab3603ff3c7 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:11.499399 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3222396-021c-4fb0-8940-cab3603ff3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:11.499667 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3222396-021c-4fb0-8940-cab3603ff3c7 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:11.500504 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3222396-021c-4fb0-8940-cab3603ff3c7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:11.500835 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3222396-021c-4fb0-8940-cab3603ff3c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:11.502295 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3222396-021c-4fb0-8940-cab3603ff3c7 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:11.519602 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 257/522] 10.222.0.52 () {56 vars in 1139 bytes} [Tue Mar 8 13:00:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:11.520408 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3222396-021c-4fb0-8940-cab3603ff3c7 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:11.528773 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad3d52-7721-42a7-9f69-832b0957c009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:11.528773 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad3d52-7721-42a7-9f69-832b0957c009 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:11.528773 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad3d52-7721-42a7-9f69-832b0957c009 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:11.529036 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad3d52-7721-42a7-9f69-832b0957c009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:11.538636 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad3d52-7721-42a7-9f69-832b0957c009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:11.540122 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad3d52-7721-42a7-9f69-832b0957c009 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:11.556730 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-61ad3d52-7721-42a7-9f69-832b0957c009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:11.558177 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 266/523] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:11.563052 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad3d52-7721-42a7-9f69-832b0957c009 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:11.614574 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3222396-021c-4fb0-8940-cab3603ff3c7 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:11.646814 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda45735-fa81-4571-baa6-79b26d3ab296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:11.647452 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda45735-fa81-4571-baa6-79b26d3ab296 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:11.647730 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda45735-fa81-4571-baa6-79b26d3ab296 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:11.648001 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda45735-fa81-4571-baa6-79b26d3ab296 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:11.648850 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda45735-fa81-4571-baa6-79b26d3ab296 None admin] RBAC: Adding query filter params (role.id=fe0e7f0760f74b09b441426d672df700, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=72d4ac44d04943a5b24c7a1d6a31b7f2) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:11.649157 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda45735-fa81-4571-baa6-79b26d3ab296 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:11.650739 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda45735-fa81-4571-baa6-79b26d3ab296 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:11.654790 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad3d52-7721-42a7-9f69-832b0957c009 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:11.661418 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 258/524] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:00:11 2022] GET /identity/v3/role_assignments?user.id=72d4ac44d04943a5b24c7a1d6a31b7f2&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=fe0e7f0760f74b09b441426d672df700 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:11.661418 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda45735-fa81-4571-baa6-79b26d3ab296 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:11.703783 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca927f-ddef-4759-8515-b5d87cfb8fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:11.704470 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca927f-ddef-4759-8515-b5d87cfb8fb1 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:11.704782 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca927f-ddef-4759-8515-b5d87cfb8fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:11.705055 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca927f-ddef-4759-8515-b5d87cfb8fb1 None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:11.705770 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca927f-ddef-4759-8515-b5d87cfb8fb1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:11.707248 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca927f-ddef-4759-8515-b5d87cfb8fb1 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:11.764537 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda45735-fa81-4571-baa6-79b26d3ab296 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:11.796703 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 267/525] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 13:00:11 2022] POST /identity/v3/users => generated 247 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:00:11.796703 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca927f-ddef-4759-8515-b5d87cfb8fb1 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:11.803005 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f163d4-5f59-46e9-b8ab-bdde5a4d2d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:11.803737 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f163d4-5f59-46e9-b8ab-bdde5a4d2d87 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:11.804027 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f163d4-5f59-46e9-b8ab-bdde5a4d2d87 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:11.804307 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f163d4-5f59-46e9-b8ab-bdde5a4d2d87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:11.887832 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f163d4-5f59-46e9-b8ab-bdde5a4d2d87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:11.889274 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f163d4-5f59-46e9-b8ab-bdde5a4d2d87 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:11.910726 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca927f-ddef-4759-8515-b5d87cfb8fb1 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:11.946407 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ba929-fdb7-437b-8cad-320730a36ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:11.947340 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ba929-fdb7-437b-8cad-320730a36ab2 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:11.947812 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ba929-fdb7-437b-8cad-320730a36ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:11.948160 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ba929-fdb7-437b-8cad-320730a36ab2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:12.005274 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 259/526] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:00:12.006167 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f163d4-5f59-46e9-b8ab-bdde5a4d2d87 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:12.030201 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ba929-fdb7-437b-8cad-320730a36ab2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:12.031715 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ba929-fdb7-437b-8cad-320730a36ab2 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:12.130384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f163d4-5f59-46e9-b8ab-bdde5a4d2d87 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:12.155595 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 268/527] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:00:12.156741 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ba929-fdb7-437b-8cad-320730a36ab2 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:12.184418 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4d9e8-b15b-4c9f-94dd-49b09b60b868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:12.185363 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4d9e8-b15b-4c9f-94dd-49b09b60b868 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:12.185658 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4d9e8-b15b-4c9f-94dd-49b09b60b868 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:12.186235 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4d9e8-b15b-4c9f-94dd-49b09b60b868 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:12.187229 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4d9e8-b15b-4c9f-94dd-49b09b60b868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:12.187539 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4d9e8-b15b-4c9f-94dd-49b09b60b868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:12.189429 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4d9e8-b15b-4c9f-94dd-49b09b60b868 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:12.203974 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 260/528] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:12.205362 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4d9e8-b15b-4c9f-94dd-49b09b60b868 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:12.262996 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ba929-fdb7-437b-8cad-320730a36ab2 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:12.307867 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e5144-6cde-453a-a099-d29932607e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:12.308679 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e5144-6cde-453a-a099-d29932607e15 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:12.308979 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e5144-6cde-453a-a099-d29932607e15 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:12.309412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e5144-6cde-453a-a099-d29932607e15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:12.318453 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4d9e8-b15b-4c9f-94dd-49b09b60b868 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:12.325813 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e5144-6cde-453a-a099-d29932607e15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:12.327692 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e5144-6cde-453a-a099-d29932607e15 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:12.352074 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-568e5144-6cde-453a-a099-d29932607e15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:12.358661 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c45a0-804d-4a9c-98cc-6a0aed1f98bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:12.358661 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c45a0-804d-4a9c-98cc-6a0aed1f98bf None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:12.358661 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c45a0-804d-4a9c-98cc-6a0aed1f98bf None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:12.358960 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c45a0-804d-4a9c-98cc-6a0aed1f98bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:12.359203 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 269/529] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:12.360217 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e5144-6cde-453a-a099-d29932607e15 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:12.369805 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c45a0-804d-4a9c-98cc-6a0aed1f98bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:12.371285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c45a0-804d-4a9c-98cc-6a0aed1f98bf None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:12.388533 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-ed9c45a0-804d-4a9c-98cc-6a0aed1f98bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:12.394239 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 261/530] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:12.394239 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c45a0-804d-4a9c-98cc-6a0aed1f98bf None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:12.470026 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e5144-6cde-453a-a099-d29932607e15 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:12.504523 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f9197-be4d-4b56-a687-c40ffcddbc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:12.505366 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f9197-be4d-4b56-a687-c40ffcddbc45 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:12.505647 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f9197-be4d-4b56-a687-c40ffcddbc45 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:12.505917 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f9197-be4d-4b56-a687-c40ffcddbc45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:12.514291 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f9197-be4d-4b56-a687-c40ffcddbc45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:12.515756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f9197-be4d-4b56-a687-c40ffcddbc45 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:12.523077 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c45a0-804d-4a9c-98cc-6a0aed1f98bf None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:12.530727 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-0c0f9197-be4d-4b56-a687-c40ffcddbc45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:12.532426 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 270/531] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:12.533400 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f9197-be4d-4b56-a687-c40ffcddbc45 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:12.563179 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b7c72-b8f4-4838-90b7-6d641d252e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:12.564639 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b7c72-b8f4-4838-90b7-6d641d252e66 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:12.565492 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b7c72-b8f4-4838-90b7-6d641d252e66 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:12.565933 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b7c72-b8f4-4838-90b7-6d641d252e66 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:12.566823 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b7c72-b8f4-4838-90b7-6d641d252e66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:12.567454 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b7c72-b8f4-4838-90b7-6d641d252e66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:12.569955 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b7c72-b8f4-4838-90b7-6d641d252e66 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:12.590897 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 262/532] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:12.592047 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b7c72-b8f4-4838-90b7-6d641d252e66 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:12.638458 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f9197-be4d-4b56-a687-c40ffcddbc45 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:12.673408 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7db9d5-1d77-4174-9827-1414d5df17ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:12.674452 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7db9d5-1d77-4174-9827-1414d5df17ad None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:12.674935 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7db9d5-1d77-4174-9827-1414d5df17ad None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:12.675427 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7db9d5-1d77-4174-9827-1414d5df17ad None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:12.676357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7db9d5-1d77-4174-9827-1414d5df17ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:12.676883 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7db9d5-1d77-4174-9827-1414d5df17ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:12.678463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7db9d5-1d77-4174-9827-1414d5df17ad None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:12.696399 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 271/533] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:12.697678 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7db9d5-1d77-4174-9827-1414d5df17ad None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:12.709764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b7c72-b8f4-4838-90b7-6d641d252e66 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:12.745982 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f22360-acbf-4ebc-bddb-ef1d29eda1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:12.747004 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f22360-acbf-4ebc-bddb-ef1d29eda1ee None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:12.747486 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f22360-acbf-4ebc-bddb-ef1d29eda1ee None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:12.747957 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f22360-acbf-4ebc-bddb-ef1d29eda1ee None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:12.749035 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f22360-acbf-4ebc-bddb-ef1d29eda1ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:12.749584 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f22360-acbf-4ebc-bddb-ef1d29eda1ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:12.751234 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f22360-acbf-4ebc-bddb-ef1d29eda1ee None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:12.770121 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 263/534] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:12.771338 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f22360-acbf-4ebc-bddb-ef1d29eda1ee None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:12.806381 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7db9d5-1d77-4174-9827-1414d5df17ad None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:12.841756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eff88a-0104-4485-bcaa-18cfa74b504d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:12.842934 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eff88a-0104-4485-bcaa-18cfa74b504d None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:12.843416 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eff88a-0104-4485-bcaa-18cfa74b504d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:12.843884 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eff88a-0104-4485-bcaa-18cfa74b504d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:12.851144 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eff88a-0104-4485-bcaa-18cfa74b504d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:12.853049 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eff88a-0104-4485-bcaa-18cfa74b504d None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:12.868446 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-c3eff88a-0104-4485-bcaa-18cfa74b504d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:12.875747 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 272/535] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:12.877022 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eff88a-0104-4485-bcaa-18cfa74b504d None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:12.877484 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f22360-acbf-4ebc-bddb-ef1d29eda1ee None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:12.913468 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee75c9f-670e-4e01-b88b-9add81850566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:12.914276 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee75c9f-670e-4e01-b88b-9add81850566 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:12.914534 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee75c9f-670e-4e01-b88b-9add81850566 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:12.914811 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee75c9f-670e-4e01-b88b-9add81850566 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:12.922088 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee75c9f-670e-4e01-b88b-9add81850566 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:12.923564 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee75c9f-670e-4e01-b88b-9add81850566 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:12.937461 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-5ee75c9f-670e-4e01-b88b-9add81850566 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:12.940732 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 264/536] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:12.940732 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee75c9f-670e-4e01-b88b-9add81850566 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:12.990192 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eff88a-0104-4485-bcaa-18cfa74b504d None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:13.026791 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd82a6-b671-410c-8d23-6923e4560235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:13.027511 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd82a6-b671-410c-8d23-6923e4560235 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:13.027895 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd82a6-b671-410c-8d23-6923e4560235 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:13.028526 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd82a6-b671-410c-8d23-6923e4560235 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:13.029488 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd82a6-b671-410c-8d23-6923e4560235 None admin] RBAC: Adding query filter params (role.id=fe0e7f0760f74b09b441426d672df700, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=81124c3324d7427a9f29270b88e88f70) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:13.029899 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd82a6-b671-410c-8d23-6923e4560235 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:13.031512 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd82a6-b671-410c-8d23-6923e4560235 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:13.037625 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 273/537] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:00:12 2022] GET /identity/v3/role_assignments?user.id=81124c3324d7427a9f29270b88e88f70&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=fe0e7f0760f74b09b441426d672df700 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:13.038609 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd82a6-b671-410c-8d23-6923e4560235 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:13.043749 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee75c9f-670e-4e01-b88b-9add81850566 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:13.080462 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58680dcf-d1ac-4f54-9bf8-71091122fed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:13.081428 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58680dcf-d1ac-4f54-9bf8-71091122fed7 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:13.081840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58680dcf-d1ac-4f54-9bf8-71091122fed7 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:13.082240 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58680dcf-d1ac-4f54-9bf8-71091122fed7 None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:13.083203 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58680dcf-d1ac-4f54-9bf8-71091122fed7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:13.083762 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58680dcf-d1ac-4f54-9bf8-71091122fed7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:13.085459 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58680dcf-d1ac-4f54-9bf8-71091122fed7 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:13.099983 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 265/538] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:13.117256 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58680dcf-d1ac-4f54-9bf8-71091122fed7 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:13.178440 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd82a6-b671-410c-8d23-6923e4560235 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:13.215108 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2c9cd-4053-4308-88cc-418d94a7daf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:13.215776 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2c9cd-4053-4308-88cc-418d94a7daf5 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:13.216054 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2c9cd-4053-4308-88cc-418d94a7daf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:13.216329 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2c9cd-4053-4308-88cc-418d94a7daf5 None admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:13.217150 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2c9cd-4053-4308-88cc-418d94a7daf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:13.217459 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2c9cd-4053-4308-88cc-418d94a7daf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:13.218920 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2c9cd-4053-4308-88cc-418d94a7daf5 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:13.234381 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 274/539] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:13.244694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2c9cd-4053-4308-88cc-418d94a7daf5 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:13.323778 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58680dcf-d1ac-4f54-9bf8-71091122fed7 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:13.356322 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2c9cd-4053-4308-88cc-418d94a7daf5 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:13.362216 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaa702-748a-4bd7-a135-a761f2be25f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:13.363201 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaa702-748a-4bd7-a135-a761f2be25f4 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:13.363686 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaa702-748a-4bd7-a135-a761f2be25f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:13.364172 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaa702-748a-4bd7-a135-a761f2be25f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:13.365253 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaa702-748a-4bd7-a135-a761f2be25f4 None admin] RBAC: Adding query filter params (role.id=fe0e7f0760f74b09b441426d672df700, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=b9a2746615c14162be82dea409930590) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:13.365772 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaa702-748a-4bd7-a135-a761f2be25f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:13.367434 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaa702-748a-4bd7-a135-a761f2be25f4 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:13.374438 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 266/540] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:00:13 2022] GET /identity/v3/role_assignments?user.id=b9a2746615c14162be82dea409930590&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=fe0e7f0760f74b09b441426d672df700 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:13.418107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e41a4c-c753-4f65-9e16-816f127ef09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:13.418787 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e41a4c-c753-4f65-9e16-816f127ef09f None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:13.419070 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e41a4c-c753-4f65-9e16-816f127ef09f None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:13.419343 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e41a4c-c753-4f65-9e16-816f127ef09f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:13.420180 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e41a4c-c753-4f65-9e16-816f127ef09f None admin] RBAC: Adding query filter params (role.id=fe0e7f0760f74b09b441426d672df700, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=22bf06400d8f47f4bb3badd7f65bc205) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:13.420489 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e41a4c-c753-4f65-9e16-816f127ef09f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:13.421952 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e41a4c-c753-4f65-9e16-816f127ef09f None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:13.433624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 275/541] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:00:13 2022] GET /identity/v3/role_assignments?user.id=22bf06400d8f47f4bb3badd7f65bc205&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=fe0e7f0760f74b09b441426d672df700 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:14.395813 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f838ca-a22e-4618-8c6f-e1baa6c8eb4f None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:14.396364 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f838ca-a22e-4618-8c6f-e1baa6c8eb4f None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:14.396364 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f838ca-a22e-4618-8c6f-e1baa6c8eb4f None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:14.398427 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 267/542] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:14.405022 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bb367-4b04-47a1-943e-38f3aba34923 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:14.405500 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bb367-4b04-47a1-943e-38f3aba34923 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:14.405591 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bb367-4b04-47a1-943e-38f3aba34923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:14.428924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-932bb367-4b04-47a1-943e-38f3aba34923 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:14.430175 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-932bb367-4b04-47a1-943e-38f3aba34923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:14.516428 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebd12a-7f30-46c9-a2b0-4a1490d5d478 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:14.516749 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebd12a-7f30-46c9-a2b0-4a1490d5d478 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:14.524000 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebd12a-7f30-46c9-a2b0-4a1490d5d478 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:14.524000 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 268/543] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:14.524859 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e823588-2dc6-47bd-85aa-af7b77cd0fa3 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:14.525213 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e823588-2dc6-47bd-85aa-af7b77cd0fa3 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:14.525493 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e823588-2dc6-47bd-85aa-af7b77cd0fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:14.528761 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 276/544] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:00:14.553015 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bb367-4b04-47a1-943e-38f3aba34923 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:14.557073 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-6e823588-2dc6-47bd-85aa-af7b77cd0fa3 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:14.558637 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6e823588-2dc6-47bd-85aa-af7b77cd0fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:14.776847 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 269/545] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:14.799374 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bb367-4b04-47a1-943e-38f3aba34923 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:14.815539 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e823588-2dc6-47bd-85aa-af7b77cd0fa3 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:14.865172 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07b645-427c-4bef-b41a-edffd71179a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:14.865973 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07b645-427c-4bef-b41a-edffd71179a1 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:14.866257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07b645-427c-4bef-b41a-edffd71179a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:14.866531 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07b645-427c-4bef-b41a-edffd71179a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:14.897563 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07b645-427c-4bef-b41a-edffd71179a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:14.912682 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-ad07b645-427c-4bef-b41a-edffd71179a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:00:14.912682 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 277/546] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:14.916083 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07b645-427c-4bef-b41a-edffd71179a1 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:14.945367 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e823588-2dc6-47bd-85aa-af7b77cd0fa3 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:14.988812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0318dca-e874-4764-ba0f-6f0c53ed93bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:14.989636 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0318dca-e874-4764-ba0f-6f0c53ed93bd None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:14.989922 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0318dca-e874-4764-ba0f-6f0c53ed93bd None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:14.990199 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0318dca-e874-4764-ba0f-6f0c53ed93bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:15.016204 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0318dca-e874-4764-ba0f-6f0c53ed93bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:15.026542 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-e0318dca-e874-4764-ba0f-6f0c53ed93bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:00:15.028387 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 270/547] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:15.033994 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0318dca-e874-4764-ba0f-6f0c53ed93bd None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:15.084189 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07b645-427c-4bef-b41a-edffd71179a1 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:15.129715 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b59cb-402b-4876-b5ec-6c8e3c424d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:15.130387 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b59cb-402b-4876-b5ec-6c8e3c424d35 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:15.130734 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b59cb-402b-4876-b5ec-6c8e3c424d35 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:15.131010 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b59cb-402b-4876-b5ec-6c8e3c424d35 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:15.131812 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b59cb-402b-4876-b5ec-6c8e3c424d35 None admin] RBAC: Adding query filter params (name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:15.132122 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b59cb-402b-4876-b5ec-6c8e3c424d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:15.134007 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b59cb-402b-4876-b5ec-6c8e3c424d35 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:15.143960 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 278/548] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:00:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:15.149685 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b59cb-402b-4876-b5ec-6c8e3c424d35 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:15.261972 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b59cb-402b-4876-b5ec-6c8e3c424d35 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:15.270561 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0318dca-e874-4764-ba0f-6f0c53ed93bd None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:15.304833 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98724b25-688d-4684-b0d3-046f9062d7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:15.305557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98724b25-688d-4684-b0d3-046f9062d7e8 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:15.305839 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98724b25-688d-4684-b0d3-046f9062d7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:15.306112 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98724b25-688d-4684-b0d3-046f9062d7e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:15.337606 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98724b25-688d-4684-b0d3-046f9062d7e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:15.339149 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98724b25-688d-4684-b0d3-046f9062d7e8 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:15.357571 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328abdb0-a19c-4e79-9853-83ebcd9cf3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:15.358254 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328abdb0-a19c-4e79-9853-83ebcd9cf3e2 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:15.358539 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328abdb0-a19c-4e79-9853-83ebcd9cf3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:15.358817 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328abdb0-a19c-4e79-9853-83ebcd9cf3e2 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:15.359574 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328abdb0-a19c-4e79-9853-83ebcd9cf3e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:15.359884 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328abdb0-a19c-4e79-9853-83ebcd9cf3e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:15.361308 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328abdb0-a19c-4e79-9853-83ebcd9cf3e2 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:15.379780 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 271/549] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:00:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:15.381228 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-98724b25-688d-4684-b0d3-046f9062d7e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:15.382971 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 279/550] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:15.389633 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328abdb0-a19c-4e79-9853-83ebcd9cf3e2 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:15.391514 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98724b25-688d-4684-b0d3-046f9062d7e8 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:15.517921 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328abdb0-a19c-4e79-9853-83ebcd9cf3e2 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:15.553701 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedd8c3-48b7-462f-95d9-51564df48ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:15.554930 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd8c3-48b7-462f-95d9-51564df48ada None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:15.555420 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd8c3-48b7-462f-95d9-51564df48ada None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:15.555915 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd8c3-48b7-462f-95d9-51564df48ada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:15.567359 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedd8c3-48b7-462f-95d9-51564df48ada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:15.569267 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedd8c3-48b7-462f-95d9-51564df48ada None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:15.590654 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-5cedd8c3-48b7-462f-95d9-51564df48ada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:15.592718 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 272/551] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:15.597997 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedd8c3-48b7-462f-95d9-51564df48ada None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:15.598883 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98724b25-688d-4684-b0d3-046f9062d7e8 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:15.689664 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c5d8b-3250-4377-a2b1-5e4934428b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:15.690322 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c5d8b-3250-4377-a2b1-5e4934428b31 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:15.690601 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c5d8b-3250-4377-a2b1-5e4934428b31 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:15.690875 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c5d8b-3250-4377-a2b1-5e4934428b31 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:15.691623 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c5d8b-3250-4377-a2b1-5e4934428b31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:15.691932 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c5d8b-3250-4377-a2b1-5e4934428b31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:15.698693 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c5d8b-3250-4377-a2b1-5e4934428b31 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:15.731283 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 280/552] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:15.733633 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedd8c3-48b7-462f-95d9-51564df48ada None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:15.737143 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c5d8b-3250-4377-a2b1-5e4934428b31 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:15.772550 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d80c50-5f76-4b1b-98d7-5dd580e08c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:15.773500 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d80c50-5f76-4b1b-98d7-5dd580e08c2e None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:15.773939 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d80c50-5f76-4b1b-98d7-5dd580e08c2e None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:15.774423 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d80c50-5f76-4b1b-98d7-5dd580e08c2e None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:15.775982 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d80c50-5f76-4b1b-98d7-5dd580e08c2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:15.776451 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d80c50-5f76-4b1b-98d7-5dd580e08c2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:15.778770 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d80c50-5f76-4b1b-98d7-5dd580e08c2e None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:15.793194 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 273/553] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:15.805437 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d80c50-5f76-4b1b-98d7-5dd580e08c2e None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:15.906810 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d80c50-5f76-4b1b-98d7-5dd580e08c2e None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:15.908272 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c5d8b-3250-4377-a2b1-5e4934428b31 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:15.952051 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f464e23-53fb-4723-849b-f04e956b84d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:15.952975 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f464e23-53fb-4723-849b-f04e956b84d3 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:15.953261 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f464e23-53fb-4723-849b-f04e956b84d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:15.953534 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f464e23-53fb-4723-849b-f04e956b84d3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:15.956730 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec43d01-adea-49d2-9055-91eb565aaec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:15.957971 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec43d01-adea-49d2-9055-91eb565aaec2 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:15.958412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec43d01-adea-49d2-9055-91eb565aaec2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:15.958901 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec43d01-adea-49d2-9055-91eb565aaec2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:15.963143 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f464e23-53fb-4723-849b-f04e956b84d3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:15.964720 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f464e23-53fb-4723-849b-f04e956b84d3 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:15.968228 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec43d01-adea-49d2-9055-91eb565aaec2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:15.969989 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec43d01-adea-49d2-9055-91eb565aaec2 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:15.980826 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-0f464e23-53fb-4723-849b-f04e956b84d3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 13:00:15.982429 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 274/554] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:00:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:15.983729 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfef91-84d4-4882-82e2-1a9a1320b564 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:15.984007 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfef91-84d4-4882-82e2-1a9a1320b564 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:15.984642 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfef91-84d4-4882-82e2-1a9a1320b564 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:15.986394 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 275/555] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:15.986890 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-1ec43d01-adea-49d2-9055-91eb565aaec2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 13:00:15.988684 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 281/556] 10.222.0.52 () {56 vars in 1093 bytes} [Tue Mar 8 13:00:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:15.991176 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfef91-84d4-4882-82e2-1a9a1320b564 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:15.993240 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee7780-45db-49d1-92b5-9784833aae4f None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:15.993523 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee7780-45db-49d1-92b5-9784833aae4f None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:15.994749 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee7780-45db-49d1-92b5-9784833aae4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:16.017831 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-9eee7780-45db-49d1-92b5-9784833aae4f None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:16.019514 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9eee7780-45db-49d1-92b5-9784833aae4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:16.098480 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 282/557] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:00:16.099190 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee7780-45db-49d1-92b5-9784833aae4f None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:16.138266 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfef91-84d4-4882-82e2-1a9a1320b564 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:16.171581 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03e32c-1514-4fb5-9506-d89c6afff056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:16.172241 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03e32c-1514-4fb5-9506-d89c6afff056 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:16.172521 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03e32c-1514-4fb5-9506-d89c6afff056 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:16.172823 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03e32c-1514-4fb5-9506-d89c6afff056 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:16.173652 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03e32c-1514-4fb5-9506-d89c6afff056 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:16.173963 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03e32c-1514-4fb5-9506-d89c6afff056 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:16.175389 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03e32c-1514-4fb5-9506-d89c6afff056 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:16.195260 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 276/558] 10.222.0.52 () {56 vars in 1135 bytes} [Tue Mar 8 13:00:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:16.196588 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f758f3-97e2-479b-89d5-57a13b271061 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:16.197433 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f758f3-97e2-479b-89d5-57a13b271061 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:16.197816 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f758f3-97e2-479b-89d5-57a13b271061 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:16.199802 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 277/559] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:16.200491 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f758f3-97e2-479b-89d5-57a13b271061 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:16.204019 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee7780-45db-49d1-92b5-9784833aae4f None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:16.238650 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689a53c-f6f1-45c4-b150-4838ad9a88f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:16.239322 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689a53c-f6f1-45c4-b150-4838ad9a88f7 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:16.239598 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689a53c-f6f1-45c4-b150-4838ad9a88f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:16.239864 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689a53c-f6f1-45c4-b150-4838ad9a88f7 None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:16.240701 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689a53c-f6f1-45c4-b150-4838ad9a88f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:16.241438 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689a53c-f6f1-45c4-b150-4838ad9a88f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:16.243079 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689a53c-f6f1-45c4-b150-4838ad9a88f7 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:16.264744 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 283/560] 10.222.0.52 () {56 vars in 1133 bytes} [Tue Mar 8 13:00:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:16.264744 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689a53c-f6f1-45c4-b150-4838ad9a88f7 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:16.306275 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f758f3-97e2-479b-89d5-57a13b271061 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:16.341822 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9e5b0-6ccb-4157-87b2-6ba678f9a1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:16.342619 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9e5b0-6ccb-4157-87b2-6ba678f9a1b0 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:16.342946 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9e5b0-6ccb-4157-87b2-6ba678f9a1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:16.343155 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9e5b0-6ccb-4157-87b2-6ba678f9a1b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:16.353888 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9e5b0-6ccb-4157-87b2-6ba678f9a1b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:16.360383 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-9eb9e5b0-6ccb-4157-87b2-6ba678f9a1b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:00:16.361611 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 278/561] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:16.362755 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c72342-b914-4b17-ab6d-42acb328f813 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:16.363036 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c72342-b914-4b17-ab6d-42acb328f813 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:16.363315 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c72342-b914-4b17-ab6d-42acb328f813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:16.373149 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689a53c-f6f1-45c4-b150-4838ad9a88f7 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:16.380069 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-13c72342-b914-4b17-ab6d-42acb328f813 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:16.381266 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-13c72342-b914-4b17-ab6d-42acb328f813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:16.407592 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a2e41-c74f-4a1f-aee5-7400f3a9ed5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:16.408242 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a2e41-c74f-4a1f-aee5-7400f3a9ed5f None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:16.408524 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a2e41-c74f-4a1f-aee5-7400f3a9ed5f None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:16.408843 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a2e41-c74f-4a1f-aee5-7400f3a9ed5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:16.449712 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 279/562] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:16.450378 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c72342-b914-4b17-ab6d-42acb328f813 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:16.474780 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a2e41-c74f-4a1f-aee5-7400f3a9ed5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:16.476232 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a2e41-c74f-4a1f-aee5-7400f3a9ed5f None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:16.545225 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c72342-b914-4b17-ab6d-42acb328f813 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:16.569912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 284/563] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:00:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:00:16.571061 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e500b-a01a-4b51-98ad-9eb9f1e6c999 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:16.571348 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e500b-a01a-4b51-98ad-9eb9f1e6c999 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:16.571623 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e500b-a01a-4b51-98ad-9eb9f1e6c999 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:16.573610 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 285/564] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:16.574186 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e500b-a01a-4b51-98ad-9eb9f1e6c999 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:16.579039 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14ce21-75fe-484f-931e-4c4e3b9075bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:16.579827 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14ce21-75fe-484f-931e-4c4e3b9075bd None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:16.580158 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14ce21-75fe-484f-931e-4c4e3b9075bd None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:16.580432 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14ce21-75fe-484f-931e-4c4e3b9075bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:16.590688 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14ce21-75fe-484f-931e-4c4e3b9075bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:16.592156 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14ce21-75fe-484f-931e-4c4e3b9075bd None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:16.609001 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-9f14ce21-75fe-484f-931e-4c4e3b9075bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:16.610105 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 280/565] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:16.610864 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14ce21-75fe-484f-931e-4c4e3b9075bd None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:16.670938 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e500b-a01a-4b51-98ad-9eb9f1e6c999 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:16.702131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370c94a-aa4d-46ef-a233-1232c896e6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:16.702787 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370c94a-aa4d-46ef-a233-1232c896e6f8 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:16.703066 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370c94a-aa4d-46ef-a233-1232c896e6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:16.703337 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370c94a-aa4d-46ef-a233-1232c896e6f8 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:16.704064 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370c94a-aa4d-46ef-a233-1232c896e6f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:16.704392 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370c94a-aa4d-46ef-a233-1232c896e6f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:16.705792 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370c94a-aa4d-46ef-a233-1232c896e6f8 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:16.706038 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14ce21-75fe-484f-931e-4c4e3b9075bd None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:16.713797 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 286/566] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:00:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:16.714563 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370c94a-aa4d-46ef-a233-1232c896e6f8 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:16.741417 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19b9e7-2964-438c-a387-540a853d76fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:16.742194 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19b9e7-2964-438c-a387-540a853d76fb None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:16.742472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19b9e7-2964-438c-a387-540a853d76fb None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:16.742740 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19b9e7-2964-438c-a387-540a853d76fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:16.752344 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19b9e7-2964-438c-a387-540a853d76fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:16.759781 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-4b19b9e7-2964-438c-a387-540a853d76fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:00:16.760986 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 281/567] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:16.762123 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed95226-a060-468d-8566-975ae4c50b02 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:16.762406 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed95226-a060-468d-8566-975ae4c50b02 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:16.762679 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed95226-a060-468d-8566-975ae4c50b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:16.778668 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-1ed95226-a060-468d-8566-975ae4c50b02 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:16.779865 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1ed95226-a060-468d-8566-975ae4c50b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:16.807324 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370c94a-aa4d-46ef-a233-1232c896e6f8 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:16.838959 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d11d5-4618-4b4b-a84f-059032147c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:16.839744 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d11d5-4618-4b4b-a84f-059032147c12 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:16.840023 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d11d5-4618-4b4b-a84f-059032147c12 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:16.840291 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d11d5-4618-4b4b-a84f-059032147c12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:16.841718 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 282/568] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:16.842525 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed95226-a060-468d-8566-975ae4c50b02 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:16.866458 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d11d5-4618-4b4b-a84f-059032147c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:16.867845 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d11d5-4618-4b4b-a84f-059032147c12 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:16.883788 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-1d8d11d5-4618-4b4b-a84f-059032147c12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:16.885693 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 287/569] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:16.886458 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d11d5-4618-4b4b-a84f-059032147c12 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:16.939088 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed95226-a060-468d-8566-975ae4c50b02 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:16.971336 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f9034-990e-47c0-a8e1-3094e6556be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:16.971986 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f9034-990e-47c0-a8e1-3094e6556be8 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:16.972266 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f9034-990e-47c0-a8e1-3094e6556be8 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:16.972541 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f9034-990e-47c0-a8e1-3094e6556be8 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:16.973292 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f9034-990e-47c0-a8e1-3094e6556be8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:16.973595 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f9034-990e-47c0-a8e1-3094e6556be8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:16.974958 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f9034-990e-47c0-a8e1-3094e6556be8 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:16.979690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d11d5-4618-4b4b-a84f-059032147c12 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:16.985803 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 283/570] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:16.986581 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f9034-990e-47c0-a8e1-3094e6556be8 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:17.012301 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf46ae-8f87-414d-a066-8de115c66c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:17.013123 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf46ae-8f87-414d-a066-8de115c66c98 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:17.013399 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf46ae-8f87-414d-a066-8de115c66c98 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:17.013665 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf46ae-8f87-414d-a066-8de115c66c98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:17.023638 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf46ae-8f87-414d-a066-8de115c66c98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:17.025772 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf46ae-8f87-414d-a066-8de115c66c98 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:17.041606 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-bdcf46ae-8f87-414d-a066-8de115c66c98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:17.042756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 288/571] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:17.043516 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf46ae-8f87-414d-a066-8de115c66c98 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:17.083548 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f9034-990e-47c0-a8e1-3094e6556be8 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:17.114830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e558c54-26bd-44d2-8d5e-b4d1a69ead42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:17.115477 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e558c54-26bd-44d2-8d5e-b4d1a69ead42 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:17.115756 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e558c54-26bd-44d2-8d5e-b4d1a69ead42 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:17.116027 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e558c54-26bd-44d2-8d5e-b4d1a69ead42 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:17.116844 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e558c54-26bd-44d2-8d5e-b4d1a69ead42 None admin] RBAC: Adding query filter params (name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:17.117096 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e558c54-26bd-44d2-8d5e-b4d1a69ead42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:17.118490 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e558c54-26bd-44d2-8d5e-b4d1a69ead42 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:17.126570 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 284/572] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:00:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:17.127332 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e558c54-26bd-44d2-8d5e-b4d1a69ead42 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:17.137465 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf46ae-8f87-414d-a066-8de115c66c98 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:17.170221 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993bede-3656-4507-9df1-477b1818b0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:17.171006 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993bede-3656-4507-9df1-477b1818b0ed None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:17.171286 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993bede-3656-4507-9df1-477b1818b0ed None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:17.171556 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993bede-3656-4507-9df1-477b1818b0ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:17.181113 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993bede-3656-4507-9df1-477b1818b0ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:17.187944 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-2993bede-3656-4507-9df1-477b1818b0ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:00:17.189287 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 289/573] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:17.189963 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993bede-3656-4507-9df1-477b1818b0ed None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:17.222366 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e558c54-26bd-44d2-8d5e-b4d1a69ead42 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:17.253264 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc868a9-4d4b-4963-a233-be12ec5b1a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:17.253909 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc868a9-4d4b-4963-a233-be12ec5b1a3f None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:17.254182 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc868a9-4d4b-4963-a233-be12ec5b1a3f None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:17.254450 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc868a9-4d4b-4963-a233-be12ec5b1a3f None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:17.255159 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc868a9-4d4b-4963-a233-be12ec5b1a3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:17.255459 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc868a9-4d4b-4963-a233-be12ec5b1a3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:17.256855 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc868a9-4d4b-4963-a233-be12ec5b1a3f None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:17.267889 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 285/574] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:17.268680 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc868a9-4d4b-4963-a233-be12ec5b1a3f None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:17.285056 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993bede-3656-4507-9df1-477b1818b0ed None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:17.316995 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b3e05-8d61-44f6-a406-61a9460d0097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:17.317783 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b3e05-8d61-44f6-a406-61a9460d0097 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:17.318066 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b3e05-8d61-44f6-a406-61a9460d0097 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:17.318339 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b3e05-8d61-44f6-a406-61a9460d0097 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:17.325123 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b3e05-8d61-44f6-a406-61a9460d0097 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:17.326561 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b3e05-8d61-44f6-a406-61a9460d0097 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:17.340353 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-e93b3e05-8d61-44f6-a406-61a9460d0097 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:17.341537 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 290/575] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:17.342296 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b3e05-8d61-44f6-a406-61a9460d0097 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:17.365507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc868a9-4d4b-4963-a233-be12ec5b1a3f None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:17.401739 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f823f5b-4772-4b47-9e32-c8504a21432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:17.402316 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f823f5b-4772-4b47-9e32-c8504a21432b None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:17.402597 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f823f5b-4772-4b47-9e32-c8504a21432b None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:17.402871 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f823f5b-4772-4b47-9e32-c8504a21432b None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:17.403841 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f823f5b-4772-4b47-9e32-c8504a21432b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:17.404144 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f823f5b-4772-4b47-9e32-c8504a21432b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:17.405599 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f823f5b-4772-4b47-9e32-c8504a21432b None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:17.416864 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 286/576] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:17.417645 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f823f5b-4772-4b47-9e32-c8504a21432b None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:17.447703 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b3e05-8d61-44f6-a406-61a9460d0097 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:17.480810 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ea312-4f6e-432d-a611-51abf2bea82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:17.481590 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ea312-4f6e-432d-a611-51abf2bea82e None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:17.481869 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ea312-4f6e-432d-a611-51abf2bea82e None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:17.482142 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ea312-4f6e-432d-a611-51abf2bea82e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:17.491603 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ea312-4f6e-432d-a611-51abf2bea82e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:17.493094 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ea312-4f6e-432d-a611-51abf2bea82e None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:17.509131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-309ea312-4f6e-432d-a611-51abf2bea82e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:17.510797 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 291/577] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:17.511556 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ea312-4f6e-432d-a611-51abf2bea82e None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:17.514231 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f823f5b-4772-4b47-9e32-c8504a21432b None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:17.550732 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82596d15-5416-48dc-bf4d-5cf562906b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:17.551396 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82596d15-5416-48dc-bf4d-5cf562906b46 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:17.551664 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82596d15-5416-48dc-bf4d-5cf562906b46 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:17.551943 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82596d15-5416-48dc-bf4d-5cf562906b46 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:17.552709 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82596d15-5416-48dc-bf4d-5cf562906b46 None admin] RBAC: Adding query filter params (name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:17.553024 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82596d15-5416-48dc-bf4d-5cf562906b46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:17.554409 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82596d15-5416-48dc-bf4d-5cf562906b46 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:17.562604 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 287/578] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:00:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:17.563447 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82596d15-5416-48dc-bf4d-5cf562906b46 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:17.612107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ea312-4f6e-432d-a611-51abf2bea82e None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:17.644513 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160a455-15c0-42f4-8c9f-5180e20fb22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:17.645615 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160a455-15c0-42f4-8c9f-5180e20fb22f None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:17.645897 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160a455-15c0-42f4-8c9f-5180e20fb22f None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:17.646166 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160a455-15c0-42f4-8c9f-5180e20fb22f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:17.653412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160a455-15c0-42f4-8c9f-5180e20fb22f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:17.654796 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160a455-15c0-42f4-8c9f-5180e20fb22f None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:17.657744 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82596d15-5416-48dc-bf4d-5cf562906b46 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:17.672266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-2160a455-15c0-42f4-8c9f-5180e20fb22f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:17.673497 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 292/579] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:17.674256 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160a455-15c0-42f4-8c9f-5180e20fb22f None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:17.693251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edc7c1-ae2e-443b-8e38-dbe8b3bbe79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:17.693908 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edc7c1-ae2e-443b-8e38-dbe8b3bbe79c None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:17.694185 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edc7c1-ae2e-443b-8e38-dbe8b3bbe79c None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:17.694457 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edc7c1-ae2e-443b-8e38-dbe8b3bbe79c None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:17.695247 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edc7c1-ae2e-443b-8e38-dbe8b3bbe79c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:17.695736 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edc7c1-ae2e-443b-8e38-dbe8b3bbe79c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:17.697239 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edc7c1-ae2e-443b-8e38-dbe8b3bbe79c None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:17.709487 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 288/580] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:17.710089 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edc7c1-ae2e-443b-8e38-dbe8b3bbe79c None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:17.787064 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160a455-15c0-42f4-8c9f-5180e20fb22f None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:17.805553 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edc7c1-ae2e-443b-8e38-dbe8b3bbe79c None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:17.819116 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753193cb-4644-41bd-beb6-d7381fc016fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:17.819903 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753193cb-4644-41bd-beb6-d7381fc016fe None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:17.820182 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753193cb-4644-41bd-beb6-d7381fc016fe None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:17.820454 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753193cb-4644-41bd-beb6-d7381fc016fe None admin] PATH_INFO: `/v3/users/glance` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:17.827842 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753193cb-4644-41bd-beb6-d7381fc016fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:17.829314 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753193cb-4644-41bd-beb6-d7381fc016fe None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:17.838161 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08aac8-f32f-480e-9f7c-8d0c78ac4969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:17.838810 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08aac8-f32f-480e-9f7c-8d0c78ac4969 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:17.839094 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08aac8-f32f-480e-9f7c-8d0c78ac4969 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:17.839371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08aac8-f32f-480e-9f7c-8d0c78ac4969 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:17.840095 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08aac8-f32f-480e-9f7c-8d0c78ac4969 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:17.840400 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08aac8-f32f-480e-9f7c-8d0c78ac4969 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:17.841807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08aac8-f32f-480e-9f7c-8d0c78ac4969 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:17.842243 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-753193cb-4644-41bd-beb6-d7381fc016fe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 08 13:00:17.843415 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 293/581] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:00:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:17.844183 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753193cb-4644-41bd-beb6-d7381fc016fe None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:17.857616 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 289/582] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:17.857616 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08aac8-f32f-480e-9f7c-8d0c78ac4969 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:17.936410 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753193cb-4644-41bd-beb6-d7381fc016fe None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:17.949313 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08aac8-f32f-480e-9f7c-8d0c78ac4969 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:17.967444 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002696b-621b-4e6f-bdb0-6fa84774d4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:17.968217 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002696b-621b-4e6f-bdb0-6fa84774d4cc None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:17.968495 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002696b-621b-4e6f-bdb0-6fa84774d4cc None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:17.968792 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002696b-621b-4e6f-bdb0-6fa84774d4cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:17.979490 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002696b-621b-4e6f-bdb0-6fa84774d4cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:17.980968 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002696b-621b-4e6f-bdb0-6fa84774d4cc None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:17.983112 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63c504-4986-47cf-aa3f-ebf7271e48a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:17.983769 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63c504-4986-47cf-aa3f-ebf7271e48a5 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:17.984046 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63c504-4986-47cf-aa3f-ebf7271e48a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:17.984316 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63c504-4986-47cf-aa3f-ebf7271e48a5 None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:17.985127 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63c504-4986-47cf-aa3f-ebf7271e48a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:17.985429 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63c504-4986-47cf-aa3f-ebf7271e48a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:17.986858 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63c504-4986-47cf-aa3f-ebf7271e48a5 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:17.997442 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-d002696b-621b-4e6f-bdb0-6fa84774d4cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:17.998657 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 294/583] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:17.999413 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002696b-621b-4e6f-bdb0-6fa84774d4cc None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:18.000284 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 290/584] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:18.001117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63c504-4986-47cf-aa3f-ebf7271e48a5 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:18.093470 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63c504-4986-47cf-aa3f-ebf7271e48a5 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:18.096448 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002696b-621b-4e6f-bdb0-6fa84774d4cc None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:18.125159 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9e0da-62c7-4147-9eb2-9fc9915a690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:18.125812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9e0da-62c7-4147-9eb2-9fc9915a690d None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:18.126097 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9e0da-62c7-4147-9eb2-9fc9915a690d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:18.126364 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9e0da-62c7-4147-9eb2-9fc9915a690d None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:18.127189 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9e0da-62c7-4147-9eb2-9fc9915a690d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:18.127493 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9e0da-62c7-4147-9eb2-9fc9915a690d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:18.128360 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdff29b-00f4-4c76-9d65-0c589d702a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:18.128940 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9e0da-62c7-4147-9eb2-9fc9915a690d None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:18.129269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdff29b-00f4-4c76-9d65-0c589d702a44 None admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:18.129550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdff29b-00f4-4c76-9d65-0c589d702a44 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:18.129824 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdff29b-00f4-4c76-9d65-0c589d702a44 None admin] PATH_INFO: `/v3/projects/2b478af53391486eb72c85c786ed4abb/users/72d4ac44d04943a5b24c7a1d6a31b7f2/roles/fe0e7f0760f74b09b441426d672df700` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:18.143662 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdff29b-00f4-4c76-9d65-0c589d702a44 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b478af53391486eb72c85c786ed4abb, user_id=72d4ac44d04943a5b24c7a1d6a31b7f2, role_id=fe0e7f0760f74b09b441426d672df700)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:18.145128 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdff29b-00f4-4c76-9d65-0c589d702a44 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:18.145265 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 291/585] 10.222.0.52 () {56 vars in 1137 bytes} [Tue Mar 8 13:00:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:18.146052 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9e0da-62c7-4147-9eb2-9fc9915a690d None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:18.239106 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9e0da-62c7-4147-9eb2-9fc9915a690d None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:18.260848 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 295/586] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 13:00:17 2022] PUT /identity/v3/projects/2b478af53391486eb72c85c786ed4abb/users/72d4ac44d04943a5b24c7a1d6a31b7f2/roles/fe0e7f0760f74b09b441426d672df700 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:00:18.261662 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdff29b-00f4-4c76-9d65-0c589d702a44 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:18.272722 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f05db0-a504-4137-8aea-61cf0f099373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:18.273550 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f05db0-a504-4137-8aea-61cf0f099373 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:18.273836 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f05db0-a504-4137-8aea-61cf0f099373 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:18.274110 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f05db0-a504-4137-8aea-61cf0f099373 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:18.283141 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f05db0-a504-4137-8aea-61cf0f099373 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:18.284828 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f05db0-a504-4137-8aea-61cf0f099373 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:18.299802 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-18f05db0-a504-4137-8aea-61cf0f099373 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 08 13:00:18.304747 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 292/587] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:18.304747 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f05db0-a504-4137-8aea-61cf0f099373 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:18.382001 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdff29b-00f4-4c76-9d65-0c589d702a44 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:18.413610 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f05db0-a504-4137-8aea-61cf0f099373 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:18.421287 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec0bb9-83e3-406d-9e17-e2926d1641af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:18.422245 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec0bb9-83e3-406d-9e17-e2926d1641af None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:18.422697 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec0bb9-83e3-406d-9e17-e2926d1641af None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:18.422970 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec0bb9-83e3-406d-9e17-e2926d1641af None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:18.423717 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec0bb9-83e3-406d-9e17-e2926d1641af None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:18.424025 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec0bb9-83e3-406d-9e17-e2926d1641af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:18.425471 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec0bb9-83e3-406d-9e17-e2926d1641af None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:18.443543 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 296/588] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:18.443543 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec0bb9-83e3-406d-9e17-e2926d1641af None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:18.453087 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48728c-6cfb-4ecf-ad2b-76acdedb582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:18.453757 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48728c-6cfb-4ecf-ad2b-76acdedb582b None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:18.454041 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48728c-6cfb-4ecf-ad2b-76acdedb582b None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:18.454323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48728c-6cfb-4ecf-ad2b-76acdedb582b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:18.455159 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48728c-6cfb-4ecf-ad2b-76acdedb582b None admin] RBAC: Adding query filter params (role.id=fe0e7f0760f74b09b441426d672df700, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=f375d86747d248fa95f487b073d92d83) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:18.455473 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48728c-6cfb-4ecf-ad2b-76acdedb582b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:18.456938 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48728c-6cfb-4ecf-ad2b-76acdedb582b None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:18.462841 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 293/589] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:00:18 2022] GET /identity/v3/role_assignments?user.id=f375d86747d248fa95f487b073d92d83&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=fe0e7f0760f74b09b441426d672df700 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:18.463778 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48728c-6cfb-4ecf-ad2b-76acdedb582b None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:18.558313 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec0bb9-83e3-406d-9e17-e2926d1641af None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:18.610272 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48728c-6cfb-4ecf-ad2b-76acdedb582b None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:18.611945 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62ac24-9750-4350-8f91-c2bebdb73a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:18.612787 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62ac24-9750-4350-8f91-c2bebdb73a23 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:18.613222 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62ac24-9750-4350-8f91-c2bebdb73a23 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:18.613328 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62ac24-9750-4350-8f91-c2bebdb73a23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:18.625342 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62ac24-9750-4350-8f91-c2bebdb73a23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:18.626895 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62ac24-9750-4350-8f91-c2bebdb73a23 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:18.644247 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-fe62ac24-9750-4350-8f91-c2bebdb73a23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:18.645824 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 297/590] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:18.646638 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62ac24-9750-4350-8f91-c2bebdb73a23 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:18.651465 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bc0b4-e328-43a0-8683-73a02a6bb625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:18.652555 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bc0b4-e328-43a0-8683-73a02a6bb625 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:18.653326 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bc0b4-e328-43a0-8683-73a02a6bb625 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:18.653698 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bc0b4-e328-43a0-8683-73a02a6bb625 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:18.654688 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623bc0b4-e328-43a0-8683-73a02a6bb625 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:18.655079 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623bc0b4-e328-43a0-8683-73a02a6bb625 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:18.656629 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623bc0b4-e328-43a0-8683-73a02a6bb625 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:18.678365 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 294/591] 10.222.0.52 () {56 vars in 1139 bytes} [Tue Mar 8 13:00:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:18.679557 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bc0b4-e328-43a0-8683-73a02a6bb625 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:18.767393 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62ac24-9750-4350-8f91-c2bebdb73a23 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:18.790187 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bc0b4-e328-43a0-8683-73a02a6bb625 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:18.810003 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0b400-9f17-4bd7-880f-330871738430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:18.811029 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0b400-9f17-4bd7-880f-330871738430 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:18.811457 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0b400-9f17-4bd7-880f-330871738430 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:18.811882 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0b400-9f17-4bd7-880f-330871738430 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:18.819957 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0b400-9f17-4bd7-880f-330871738430 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:18.821727 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0b400-9f17-4bd7-880f-330871738430 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:18.827933 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602ca5c-e788-4fc5-8f1a-4a4c083d311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:18.828996 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602ca5c-e788-4fc5-8f1a-4a4c083d311b None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:18.829396 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602ca5c-e788-4fc5-8f1a-4a4c083d311b None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:18.829773 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602ca5c-e788-4fc5-8f1a-4a4c083d311b None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:18.830613 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602ca5c-e788-4fc5-8f1a-4a4c083d311b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:18.831018 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602ca5c-e788-4fc5-8f1a-4a4c083d311b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:18.832484 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602ca5c-e788-4fc5-8f1a-4a4c083d311b None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:18.837833 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-6be0b400-9f17-4bd7-880f-330871738430 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 08 13:00:18.839725 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 298/592] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:00:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:18.840801 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0b400-9f17-4bd7-880f-330871738430 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:18.854926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 295/593] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:18.854926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602ca5c-e788-4fc5-8f1a-4a4c083d311b None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:18.956792 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602ca5c-e788-4fc5-8f1a-4a4c083d311b None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:18.969291 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0b400-9f17-4bd7-880f-330871738430 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:18.994568 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a349c22-8879-4ad3-a69b-0c96519da47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:18.995493 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a349c22-8879-4ad3-a69b-0c96519da47c None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:18.995923 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a349c22-8879-4ad3-a69b-0c96519da47c None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:18.996364 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a349c22-8879-4ad3-a69b-0c96519da47c None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:18.997435 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a349c22-8879-4ad3-a69b-0c96519da47c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:18.997918 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a349c22-8879-4ad3-a69b-0c96519da47c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:18.999508 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a349c22-8879-4ad3-a69b-0c96519da47c None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:19.011336 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55363813-378b-42d7-99f6-16b1c6b2fcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:19.012372 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55363813-378b-42d7-99f6-16b1c6b2fcee None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:19.012789 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55363813-378b-42d7-99f6-16b1c6b2fcee None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:19.013167 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55363813-378b-42d7-99f6-16b1c6b2fcee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:19.019672 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 296/594] 10.222.0.52 () {56 vars in 1137 bytes} [Tue Mar 8 13:00:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:19.020780 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a349c22-8879-4ad3-a69b-0c96519da47c None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:19.037114 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55363813-378b-42d7-99f6-16b1c6b2fcee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:19.039252 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55363813-378b-42d7-99f6-16b1c6b2fcee None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:19.061911 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-55363813-378b-42d7-99f6-16b1c6b2fcee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:19.063209 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 299/595] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:19.064535 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55363813-378b-42d7-99f6-16b1c6b2fcee None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:19.140640 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a349c22-8879-4ad3-a69b-0c96519da47c None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:19.168535 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55363813-378b-42d7-99f6-16b1c6b2fcee None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:19.183923 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5de90-9300-4c75-85c0-31da47cdde73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:19.184963 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5de90-9300-4c75-85c0-31da47cdde73 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:19.185582 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5de90-9300-4c75-85c0-31da47cdde73 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:19.185997 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5de90-9300-4c75-85c0-31da47cdde73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:19.195120 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5de90-9300-4c75-85c0-31da47cdde73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:19.198212 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5de90-9300-4c75-85c0-31da47cdde73 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:19.203899 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4476c0f-8657-4877-b18a-401c85b76222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:19.204840 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4476c0f-8657-4877-b18a-401c85b76222 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:19.205222 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4476c0f-8657-4877-b18a-401c85b76222 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:19.205596 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4476c0f-8657-4877-b18a-401c85b76222 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:19.213585 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-5bf5de90-9300-4c75-85c0-31da47cdde73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:19.219996 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 297/596] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:19.219996 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5de90-9300-4c75-85c0-31da47cdde73 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:19.222358 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4476c0f-8657-4877-b18a-401c85b76222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:19.223944 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4476c0f-8657-4877-b18a-401c85b76222 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:19.241811 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-c4476c0f-8657-4877-b18a-401c85b76222 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:19.247712 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 300/597] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:19.247712 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4476c0f-8657-4877-b18a-401c85b76222 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:19.349945 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5de90-9300-4c75-85c0-31da47cdde73 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:19.359170 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4476c0f-8657-4877-b18a-401c85b76222 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:19.389311 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb564c9-ae3c-46db-8278-7b289708f3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:19.390131 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb564c9-ae3c-46db-8278-7b289708f3d3 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:19.390505 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb564c9-ae3c-46db-8278-7b289708f3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:19.390881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb564c9-ae3c-46db-8278-7b289708f3d3 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:19.391705 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb564c9-ae3c-46db-8278-7b289708f3d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:19.392114 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb564c9-ae3c-46db-8278-7b289708f3d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:19.393690 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb564c9-ae3c-46db-8278-7b289708f3d3 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:19.401821 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ba2f0-bc15-4ef9-b1b7-029d1a599bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:19.402996 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ba2f0-bc15-4ef9-b1b7-029d1a599bb9 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:19.403421 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ba2f0-bc15-4ef9-b1b7-029d1a599bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:19.404295 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ba2f0-bc15-4ef9-b1b7-029d1a599bb9 None admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:19.405538 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ba2f0-bc15-4ef9-b1b7-029d1a599bb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:19.405992 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ba2f0-bc15-4ef9-b1b7-029d1a599bb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:19.407580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ba2f0-bc15-4ef9-b1b7-029d1a599bb9 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:19.407771 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 298/598] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:19.408697 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb564c9-ae3c-46db-8278-7b289708f3d3 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:19.425027 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 301/599] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:19.426226 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ba2f0-bc15-4ef9-b1b7-029d1a599bb9 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:19.514635 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb564c9-ae3c-46db-8278-7b289708f3d3 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:19.531833 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ba2f0-bc15-4ef9-b1b7-029d1a599bb9 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:19.551467 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7a8f0-f85b-44a7-9fbe-3fbdd880d2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:19.552363 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7a8f0-f85b-44a7-9fbe-3fbdd880d2e6 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:19.552851 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7a8f0-f85b-44a7-9fbe-3fbdd880d2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:19.553296 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7a8f0-f85b-44a7-9fbe-3fbdd880d2e6 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:19.554198 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7a8f0-f85b-44a7-9fbe-3fbdd880d2e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:19.554682 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7a8f0-f85b-44a7-9fbe-3fbdd880d2e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:19.556303 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7a8f0-f85b-44a7-9fbe-3fbdd880d2e6 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:19.572756 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 299/600] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:19.573621 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7a8f0-f85b-44a7-9fbe-3fbdd880d2e6 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:19.574612 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302bf95-2e10-4e76-9c2d-26545a911030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:19.575411 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302bf95-2e10-4e76-9c2d-26545a911030 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:19.575688 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302bf95-2e10-4e76-9c2d-26545a911030 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:19.575960 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302bf95-2e10-4e76-9c2d-26545a911030 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:19.583476 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302bf95-2e10-4e76-9c2d-26545a911030 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:19.584943 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302bf95-2e10-4e76-9c2d-26545a911030 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:19.599916 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-1302bf95-2e10-4e76-9c2d-26545a911030 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:19.601191 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 302/601] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:19.602089 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302bf95-2e10-4e76-9c2d-26545a911030 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:19.678889 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7a8f0-f85b-44a7-9fbe-3fbdd880d2e6 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:19.703812 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302bf95-2e10-4e76-9c2d-26545a911030 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:19.714187 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17b506-9a21-4c87-bbe2-6d6cca6ad907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:19.715359 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17b506-9a21-4c87-bbe2-6d6cca6ad907 None admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:19.715833 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17b506-9a21-4c87-bbe2-6d6cca6ad907 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:19.716326 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17b506-9a21-4c87-bbe2-6d6cca6ad907 None admin] PATH_INFO: `/v3/projects/2b478af53391486eb72c85c786ed4abb/users/81124c3324d7427a9f29270b88e88f70/roles/fe0e7f0760f74b09b441426d672df700` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:19.732023 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17b506-9a21-4c87-bbe2-6d6cca6ad907 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b478af53391486eb72c85c786ed4abb, user_id=81124c3324d7427a9f29270b88e88f70, role_id=fe0e7f0760f74b09b441426d672df700)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:19.733832 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17b506-9a21-4c87-bbe2-6d6cca6ad907 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:19.738542 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffb427-0279-4233-aaea-74a873c3d321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:19.739389 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffb427-0279-4233-aaea-74a873c3d321 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:19.739672 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffb427-0279-4233-aaea-74a873c3d321 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:19.739946 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffb427-0279-4233-aaea-74a873c3d321 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:19.747388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffb427-0279-4233-aaea-74a873c3d321 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:19.748938 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffb427-0279-4233-aaea-74a873c3d321 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:19.762801 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-a4ffb427-0279-4233-aaea-74a873c3d321 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:19.768517 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 303/602] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:19.768517 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffb427-0279-4233-aaea-74a873c3d321 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:19.837261 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 300/603] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 13:00:19 2022] PUT /identity/v3/projects/2b478af53391486eb72c85c786ed4abb/users/81124c3324d7427a9f29270b88e88f70/roles/fe0e7f0760f74b09b441426d672df700 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:00:19.838648 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17b506-9a21-4c87-bbe2-6d6cca6ad907 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:19.918205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffb427-0279-4233-aaea-74a873c3d321 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:19.993451 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4ddba-ab87-4c0b-9e9c-7428336f5b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:19.994576 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4ddba-ab87-4c0b-9e9c-7428336f5b94 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:19.995084 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4ddba-ab87-4c0b-9e9c-7428336f5b94 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:19.995640 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4ddba-ab87-4c0b-9e9c-7428336f5b94 None admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:19.996673 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4ddba-ab87-4c0b-9e9c-7428336f5b94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:19.997188 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4ddba-ab87-4c0b-9e9c-7428336f5b94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:19.998833 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4ddba-ab87-4c0b-9e9c-7428336f5b94 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:20.015101 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17b506-9a21-4c87-bbe2-6d6cca6ad907 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:20.023960 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 304/604] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:20.033692 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4ddba-ab87-4c0b-9e9c-7428336f5b94 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:20.055155 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23a3ee-9def-4dc2-b365-6d4c5eafd409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:20.055854 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23a3ee-9def-4dc2-b365-6d4c5eafd409 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:20.056910 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23a3ee-9def-4dc2-b365-6d4c5eafd409 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:20.057312 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23a3ee-9def-4dc2-b365-6d4c5eafd409 None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:20.058109 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23a3ee-9def-4dc2-b365-6d4c5eafd409 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:20.064684 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23a3ee-9def-4dc2-b365-6d4c5eafd409 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:20.064684 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23a3ee-9def-4dc2-b365-6d4c5eafd409 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:20.074231 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 301/605] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:20.080359 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23a3ee-9def-4dc2-b365-6d4c5eafd409 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:20.188118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4ddba-ab87-4c0b-9e9c-7428336f5b94 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:20.201286 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23a3ee-9def-4dc2-b365-6d4c5eafd409 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:20.231394 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ccca2-dbfc-4d2c-856e-b4c39231c0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:20.232626 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ccca2-dbfc-4d2c-856e-b4c39231c0bb None admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:20.233123 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ccca2-dbfc-4d2c-856e-b4c39231c0bb None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:20.233707 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ccca2-dbfc-4d2c-856e-b4c39231c0bb None admin] PATH_INFO: `/v3/projects/2b478af53391486eb72c85c786ed4abb/users/22bf06400d8f47f4bb3badd7f65bc205/roles/fe0e7f0760f74b09b441426d672df700` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:20.236811 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997dd80d-a217-4e04-8971-c0333a16d458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:20.238271 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dd80d-a217-4e04-8971-c0333a16d458 None admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:20.238271 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dd80d-a217-4e04-8971-c0333a16d458 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:20.238456 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dd80d-a217-4e04-8971-c0333a16d458 None admin] PATH_INFO: `/v3/projects/2b478af53391486eb72c85c786ed4abb/users/b9a2746615c14162be82dea409930590/roles/fe0e7f0760f74b09b441426d672df700` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:20.251029 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ccca2-dbfc-4d2c-856e-b4c39231c0bb None admin] RBAC: Authorizing `identity:create_grant(project_id=2b478af53391486eb72c85c786ed4abb, user_id=22bf06400d8f47f4bb3badd7f65bc205, role_id=fe0e7f0760f74b09b441426d672df700)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:20.252902 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ccca2-dbfc-4d2c-856e-b4c39231c0bb None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:20.254108 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997dd80d-a217-4e04-8971-c0333a16d458 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b478af53391486eb72c85c786ed4abb, user_id=b9a2746615c14162be82dea409930590, role_id=fe0e7f0760f74b09b441426d672df700)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:20.255627 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997dd80d-a217-4e04-8971-c0333a16d458 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:20.361540 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 305/606] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 13:00:20 2022] PUT /identity/v3/projects/2b478af53391486eb72c85c786ed4abb/users/22bf06400d8f47f4bb3badd7f65bc205/roles/fe0e7f0760f74b09b441426d672df700 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:00:20.409076 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 302/607] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 13:00:20 2022] PUT /identity/v3/projects/2b478af53391486eb72c85c786ed4abb/users/b9a2746615c14162be82dea409930590/roles/fe0e7f0760f74b09b441426d672df700 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:00:20.662613 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91858839-b2e4-48f1-b5e0-dec2afa57b4a None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:20.662976 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91858839-b2e4-48f1-b5e0-dec2afa57b4a None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:20.663090 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91858839-b2e4-48f1-b5e0-dec2afa57b4a None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:20.665202 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 306/608] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:20.672356 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a70c7-7944-4b27-9c39-4a103692c46f None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:20.672356 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a70c7-7944-4b27-9c39-4a103692c46f None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:20.672356 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a70c7-7944-4b27-9c39-4a103692c46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:20.689401 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-8f9a70c7-7944-4b27-9c39-4a103692c46f None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:20.690595 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-8f9a70c7-7944-4b27-9c39-4a103692c46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:20.764151 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 303/609] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:20.789285 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91858839-b2e4-48f1-b5e0-dec2afa57b4a None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:20.867727 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a11f01-7628-4767-b7b3-57996b787cb7 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:20.868183 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a11f01-7628-4767-b7b3-57996b787cb7 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:20.868769 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a11f01-7628-4767-b7b3-57996b787cb7 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:20.870908 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 304/610] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:00:20.877833 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e210b5-6154-41b7-98f6-559deb2ed6a7 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:20.878245 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e210b5-6154-41b7-98f6-559deb2ed6a7 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:20.878626 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e210b5-6154-41b7-98f6-559deb2ed6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:20.923406 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-a9e210b5-6154-41b7-98f6-559deb2ed6a7 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:20.923406 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-a9e210b5-6154-41b7-98f6-559deb2ed6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:20.923633 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91858839-b2e4-48f1-b5e0-dec2afa57b4a None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:20.966974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990cf0f-daad-4558-bb9a-2a7e2d4073c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:20.967826 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990cf0f-daad-4558-bb9a-2a7e2d4073c3 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:20.968113 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990cf0f-daad-4558-bb9a-2a7e2d4073c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:20.968388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990cf0f-daad-4558-bb9a-2a7e2d4073c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:20.984945 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990cf0f-daad-4558-bb9a-2a7e2d4073c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:21.002245 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-7990cf0f-daad-4558-bb9a-2a7e2d4073c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:00:21.005584 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 307/611] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:21.011538 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990cf0f-daad-4558-bb9a-2a7e2d4073c3 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:21.047909 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 305/612] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:00:21.087576 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e210b5-6154-41b7-98f6-559deb2ed6a7 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:21.167416 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990cf0f-daad-4558-bb9a-2a7e2d4073c3 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:21.234442 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee44b72-cb2d-4a53-8587-d54614e6cf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:21.235121 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee44b72-cb2d-4a53-8587-d54614e6cf5f None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:21.235401 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee44b72-cb2d-4a53-8587-d54614e6cf5f None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:21.235675 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee44b72-cb2d-4a53-8587-d54614e6cf5f None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:21.236424 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee44b72-cb2d-4a53-8587-d54614e6cf5f None admin] RBAC: Adding query filter params (name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:21.236750 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee44b72-cb2d-4a53-8587-d54614e6cf5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:21.238123 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee44b72-cb2d-4a53-8587-d54614e6cf5f None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:21.255652 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 308/613] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:00:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:21.261743 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee44b72-cb2d-4a53-8587-d54614e6cf5f None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:21.262869 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e210b5-6154-41b7-98f6-559deb2ed6a7 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:21.354037 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764a3b2-d339-446c-a575-ce5a7c47ca9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:21.354870 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764a3b2-d339-446c-a575-ce5a7c47ca9d None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:21.355154 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764a3b2-d339-446c-a575-ce5a7c47ca9d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:21.355427 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764a3b2-d339-446c-a575-ce5a7c47ca9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:21.375902 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee44b72-cb2d-4a53-8587-d54614e6cf5f None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:21.389620 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764a3b2-d339-446c-a575-ce5a7c47ca9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:21.396835 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-a764a3b2-d339-446c-a575-ce5a7c47ca9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:00:21.405237 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 306/614] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:21.411797 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764a3b2-d339-446c-a575-ce5a7c47ca9d None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:21.425708 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5b37b-1df1-49a0-876a-6dc3e5fa7837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:21.426563 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5b37b-1df1-49a0-876a-6dc3e5fa7837 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:21.426848 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5b37b-1df1-49a0-876a-6dc3e5fa7837 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:21.427117 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5b37b-1df1-49a0-876a-6dc3e5fa7837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:21.446976 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5b37b-1df1-49a0-876a-6dc3e5fa7837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:21.450878 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5b37b-1df1-49a0-876a-6dc3e5fa7837 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:21.483633 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-68a5b37b-1df1-49a0-876a-6dc3e5fa7837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:21.488829 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 309/615] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:21.490540 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5b37b-1df1-49a0-876a-6dc3e5fa7837 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:21.605930 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764a3b2-d339-446c-a575-ce5a7c47ca9d None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:21.671820 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdb768-ab7c-40ae-a1e1-49cb455a9d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:21.672490 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdb768-ab7c-40ae-a1e1-49cb455a9d64 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:21.672795 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdb768-ab7c-40ae-a1e1-49cb455a9d64 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:21.673067 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdb768-ab7c-40ae-a1e1-49cb455a9d64 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:21.673812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdb768-ab7c-40ae-a1e1-49cb455a9d64 None admin] RBAC: Adding query filter params (name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:21.674111 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdb768-ab7c-40ae-a1e1-49cb455a9d64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:21.675511 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdb768-ab7c-40ae-a1e1-49cb455a9d64 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:21.678816 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5b37b-1df1-49a0-876a-6dc3e5fa7837 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:21.694456 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 307/616] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:00:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:21.701061 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdb768-ab7c-40ae-a1e1-49cb455a9d64 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:21.753470 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6a69d-03ec-422a-8182-5b116a2756c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:21.754069 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6a69d-03ec-422a-8182-5b116a2756c3 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:21.754357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6a69d-03ec-422a-8182-5b116a2756c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:21.754634 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6a69d-03ec-422a-8182-5b116a2756c3 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:21.755368 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6a69d-03ec-422a-8182-5b116a2756c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:21.755674 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6a69d-03ec-422a-8182-5b116a2756c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:21.757081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6a69d-03ec-422a-8182-5b116a2756c3 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:21.769789 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 310/617] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:21.776014 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6a69d-03ec-422a-8182-5b116a2756c3 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:21.877586 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6a69d-03ec-422a-8182-5b116a2756c3 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:21.914179 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdb768-ab7c-40ae-a1e1-49cb455a9d64 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:21.922911 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab71fe-22e0-4d6a-b1d3-665749914306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:21.923710 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab71fe-22e0-4d6a-b1d3-665749914306 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:21.923988 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab71fe-22e0-4d6a-b1d3-665749914306 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:21.924257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab71fe-22e0-4d6a-b1d3-665749914306 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:21.935400 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab71fe-22e0-4d6a-b1d3-665749914306 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:21.936891 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab71fe-22e0-4d6a-b1d3-665749914306 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:21.956372 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-27ab71fe-22e0-4d6a-b1d3-665749914306 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 13:00:21.967232 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 311/618] 10.222.0.52 () {56 vars in 1093 bytes} [Tue Mar 8 13:00:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:21.974194 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab71fe-22e0-4d6a-b1d3-665749914306 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:21.987688 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef956a6-dcd0-41f6-8a89-30055140ba52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:21.988489 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef956a6-dcd0-41f6-8a89-30055140ba52 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:21.988945 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef956a6-dcd0-41f6-8a89-30055140ba52 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:21.989225 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef956a6-dcd0-41f6-8a89-30055140ba52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:22.007026 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef956a6-dcd0-41f6-8a89-30055140ba52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:22.008414 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef956a6-dcd0-41f6-8a89-30055140ba52 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:22.050308 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-5ef956a6-dcd0-41f6-8a89-30055140ba52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:22.051839 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 308/619] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:22.062235 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef956a6-dcd0-41f6-8a89-30055140ba52 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:22.107288 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab71fe-22e0-4d6a-b1d3-665749914306 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:22.147593 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a459f5-ace0-43a4-b02c-36cf69bcd422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:22.148624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a459f5-ace0-43a4-b02c-36cf69bcd422 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:22.151342 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a459f5-ace0-43a4-b02c-36cf69bcd422 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:22.151820 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a459f5-ace0-43a4-b02c-36cf69bcd422 None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:22.153183 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a459f5-ace0-43a4-b02c-36cf69bcd422 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:22.153688 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a459f5-ace0-43a4-b02c-36cf69bcd422 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:22.161148 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a459f5-ace0-43a4-b02c-36cf69bcd422 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:22.181269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 312/620] 10.222.0.52 () {56 vars in 1133 bytes} [Tue Mar 8 13:00:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:22.187896 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a459f5-ace0-43a4-b02c-36cf69bcd422 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:22.241252 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef956a6-dcd0-41f6-8a89-30055140ba52 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:22.284642 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0e916-e9dc-4ba4-ba9d-d3531cda479a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:22.285325 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0e916-e9dc-4ba4-ba9d-d3531cda479a None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:22.285616 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0e916-e9dc-4ba4-ba9d-d3531cda479a None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:22.285894 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0e916-e9dc-4ba4-ba9d-d3531cda479a None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:22.286627 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0e916-e9dc-4ba4-ba9d-d3531cda479a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:22.286942 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0e916-e9dc-4ba4-ba9d-d3531cda479a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:22.288327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0e916-e9dc-4ba4-ba9d-d3531cda479a None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:22.326097 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a459f5-ace0-43a4-b02c-36cf69bcd422 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:22.327398 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 309/621] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:22.334232 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0e916-e9dc-4ba4-ba9d-d3531cda479a None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:22.381329 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b3dac-3117-46ab-bc7f-0d162c254cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:22.382382 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b3dac-3117-46ab-bc7f-0d162c254cdc None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:22.382860 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b3dac-3117-46ab-bc7f-0d162c254cdc None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:22.383345 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b3dac-3117-46ab-bc7f-0d162c254cdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:22.453080 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0e916-e9dc-4ba4-ba9d-d3531cda479a None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:22.490043 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704ce57-4485-453d-a149-d0b6451a8b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:22.490841 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704ce57-4485-453d-a149-d0b6451a8b20 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:22.491122 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704ce57-4485-453d-a149-d0b6451a8b20 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:22.491398 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704ce57-4485-453d-a149-d0b6451a8b20 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:22.506398 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704ce57-4485-453d-a149-d0b6451a8b20 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:22.507875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704ce57-4485-453d-a149-d0b6451a8b20 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:22.532988 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-8704ce57-4485-453d-a149-d0b6451a8b20 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 13:00:22.533749 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b3dac-3117-46ab-bc7f-0d162c254cdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:22.534435 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 310/622] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:00:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:22.535392 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b3dac-3117-46ab-bc7f-0d162c254cdc None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:22.541899 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704ce57-4485-453d-a149-d0b6451a8b20 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:22.636847 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 313/623] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:00:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:00:22.643787 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b3dac-3117-46ab-bc7f-0d162c254cdc None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:22.677975 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704ce57-4485-453d-a149-d0b6451a8b20 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:22.725446 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642e95a-f55c-4d86-af4a-482b0deefc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:22.726838 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642e95a-f55c-4d86-af4a-482b0deefc12 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:22.727271 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642e95a-f55c-4d86-af4a-482b0deefc12 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:22.727748 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642e95a-f55c-4d86-af4a-482b0deefc12 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:22.728828 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642e95a-f55c-4d86-af4a-482b0deefc12 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:22.729368 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642e95a-f55c-4d86-af4a-482b0deefc12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:22.730985 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642e95a-f55c-4d86-af4a-482b0deefc12 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:22.752629 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b3dac-3117-46ab-bc7f-0d162c254cdc None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:22.763926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 311/624] 10.222.0.52 () {56 vars in 1135 bytes} [Tue Mar 8 13:00:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:22.768893 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642e95a-f55c-4d86-af4a-482b0deefc12 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:22.790225 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7178785-a4c8-467e-bf10-4e463e5f88cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:22.791166 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7178785-a4c8-467e-bf10-4e463e5f88cc None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:22.791558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7178785-a4c8-467e-bf10-4e463e5f88cc None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:22.791924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7178785-a4c8-467e-bf10-4e463e5f88cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:22.802125 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7178785-a4c8-467e-bf10-4e463e5f88cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:22.803678 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7178785-a4c8-467e-bf10-4e463e5f88cc None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:22.820589 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-f7178785-a4c8-467e-bf10-4e463e5f88cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:22.823074 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 314/625] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:22.824590 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ea0a3-d46d-40a4-be43-f8c07c8e4f6c None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:22.825115 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ea0a3-d46d-40a4-be43-f8c07c8e4f6c None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:22.825597 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ea0a3-d46d-40a4-be43-f8c07c8e4f6c None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:22.827856 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 315/626] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:22.828862 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ea0a3-d46d-40a4-be43-f8c07c8e4f6c None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:22.875181 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642e95a-f55c-4d86-af4a-482b0deefc12 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:22.912072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca466c94-8e1e-4f3e-9bbe-ed68148e12d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:22.913237 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca466c94-8e1e-4f3e-9bbe-ed68148e12d1 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:22.913730 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca466c94-8e1e-4f3e-9bbe-ed68148e12d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:22.914218 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca466c94-8e1e-4f3e-9bbe-ed68148e12d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:22.928694 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca466c94-8e1e-4f3e-9bbe-ed68148e12d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:22.930772 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca466c94-8e1e-4f3e-9bbe-ed68148e12d1 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:22.934686 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ea0a3-d46d-40a4-be43-f8c07c8e4f6c None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:22.951538 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-ca466c94-8e1e-4f3e-9bbe-ed68148e12d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:22.953399 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 312/627] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:22.954793 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba063d-8a5f-46cb-959b-bae5dec12e83 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:22.955279 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba063d-8a5f-46cb-959b-bae5dec12e83 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:22.955752 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba063d-8a5f-46cb-959b-bae5dec12e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:22.970137 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f39c02-72c6-412b-a1f3-39e35a628229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:22.970815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f39c02-72c6-412b-a1f3-39e35a628229 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:22.971094 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f39c02-72c6-412b-a1f3-39e35a628229 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:22.971365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f39c02-72c6-412b-a1f3-39e35a628229 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:22.972081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f39c02-72c6-412b-a1f3-39e35a628229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:22.972383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f39c02-72c6-412b-a1f3-39e35a628229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:22.973789 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f39c02-72c6-412b-a1f3-39e35a628229 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:22.974635 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-9bba063d-8a5f-46cb-959b-bae5dec12e83 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:22.976057 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-9bba063d-8a5f-46cb-959b-bae5dec12e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:22.986621 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 316/628] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:22.987342 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f39c02-72c6-412b-a1f3-39e35a628229 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:23.046902 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 313/629] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:23.048120 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba063d-8a5f-46cb-959b-bae5dec12e83 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:23.085816 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f39c02-72c6-412b-a1f3-39e35a628229 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:23.119443 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f0156-ef30-4052-b38f-954ab6e74186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:23.120108 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f0156-ef30-4052-b38f-954ab6e74186 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:23.120388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f0156-ef30-4052-b38f-954ab6e74186 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:23.120685 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f0156-ef30-4052-b38f-954ab6e74186 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:23.121411 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f0156-ef30-4052-b38f-954ab6e74186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:23.121713 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f0156-ef30-4052-b38f-954ab6e74186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:23.123076 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f0156-ef30-4052-b38f-954ab6e74186 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:23.139246 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 317/630] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:23.139246 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38e59a-c1af-47c9-9a8f-caf43bfe0c99 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:23.139246 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38e59a-c1af-47c9-9a8f-caf43bfe0c99 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:23.139246 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38e59a-c1af-47c9-9a8f-caf43bfe0c99 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:23.139246 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 318/631] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:23.139660 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38e59a-c1af-47c9-9a8f-caf43bfe0c99 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:23.155495 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba063d-8a5f-46cb-959b-bae5dec12e83 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:23.191265 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e528eed-d6f4-4ca4-8e09-23d15a432850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:23.192047 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e528eed-d6f4-4ca4-8e09-23d15a432850 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:23.192329 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e528eed-d6f4-4ca4-8e09-23d15a432850 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:23.192602 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e528eed-d6f4-4ca4-8e09-23d15a432850 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:23.199472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e528eed-d6f4-4ca4-8e09-23d15a432850 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:23.200960 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e528eed-d6f4-4ca4-8e09-23d15a432850 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:23.214410 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-6e528eed-d6f4-4ca4-8e09-23d15a432850 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:23.217000 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 314/632] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:23.217859 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e528eed-d6f4-4ca4-8e09-23d15a432850 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:23.242995 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38e59a-c1af-47c9-9a8f-caf43bfe0c99 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:23.277296 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd70d7-c855-43e2-bb2d-6accf903d4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:23.278343 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd70d7-c855-43e2-bb2d-6accf903d4ec None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:23.278627 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd70d7-c855-43e2-bb2d-6accf903d4ec None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:23.278898 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd70d7-c855-43e2-bb2d-6accf903d4ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:23.288696 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd70d7-c855-43e2-bb2d-6accf903d4ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:23.296840 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-b0bd70d7-c855-43e2-bb2d-6accf903d4ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:00:23.302697 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 319/633] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:23.302697 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0d626-9e27-4174-94fd-be40bb312b72 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:23.302697 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0d626-9e27-4174-94fd-be40bb312b72 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:23.302697 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0d626-9e27-4174-94fd-be40bb312b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:23.316883 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-f3b0d626-9e27-4174-94fd-be40bb312b72 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:23.318057 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f3b0d626-9e27-4174-94fd-be40bb312b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:23.323646 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e528eed-d6f4-4ca4-8e09-23d15a432850 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:23.355717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28c33c-00d7-4b1e-b1a9-1ba35cf22e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:23.356496 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28c33c-00d7-4b1e-b1a9-1ba35cf22e0d None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:23.356807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28c33c-00d7-4b1e-b1a9-1ba35cf22e0d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:23.357079 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28c33c-00d7-4b1e-b1a9-1ba35cf22e0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:23.363497 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28c33c-00d7-4b1e-b1a9-1ba35cf22e0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:23.364967 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28c33c-00d7-4b1e-b1a9-1ba35cf22e0d None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:23.378417 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-9b28c33c-00d7-4b1e-b1a9-1ba35cf22e0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:23.379558 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 315/634] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:23.380306 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28c33c-00d7-4b1e-b1a9-1ba35cf22e0d None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:23.381304 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 320/635] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:23.382707 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b067d-88ac-4cc4-ba2e-364ec441467b None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:23.382997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b067d-88ac-4cc4-ba2e-364ec441467b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:23.383269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b067d-88ac-4cc4-ba2e-364ec441467b None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:23.393257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 321/636] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:23.393257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b067d-88ac-4cc4-ba2e-364ec441467b None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:23.483571 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28c33c-00d7-4b1e-b1a9-1ba35cf22e0d None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:23.489692 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b067d-88ac-4cc4-ba2e-364ec441467b None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:23.515522 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793d084-3e4c-4306-a6ea-caa852de948b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:23.516169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793d084-3e4c-4306-a6ea-caa852de948b None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:23.516456 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793d084-3e4c-4306-a6ea-caa852de948b None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:23.516756 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793d084-3e4c-4306-a6ea-caa852de948b None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:23.517534 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793d084-3e4c-4306-a6ea-caa852de948b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:23.517840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793d084-3e4c-4306-a6ea-caa852de948b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:23.519326 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793d084-3e4c-4306-a6ea-caa852de948b None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:23.528790 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd04db8-8566-4919-901f-9dd5b4313c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:23.528790 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd04db8-8566-4919-901f-9dd5b4313c0a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:23.528790 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd04db8-8566-4919-901f-9dd5b4313c0a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:23.528790 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd04db8-8566-4919-901f-9dd5b4313c0a None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:23.529085 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd04db8-8566-4919-901f-9dd5b4313c0a None admin] RBAC: Adding query filter params (name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:23.529085 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd04db8-8566-4919-901f-9dd5b4313c0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:23.529085 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd04db8-8566-4919-901f-9dd5b4313c0a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:23.530801 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 316/637] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:23.531599 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793d084-3e4c-4306-a6ea-caa852de948b None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:23.543622 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 322/638] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:00:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:23.543622 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e4a8f-4549-42bd-95dd-fc70eb7f722e None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:23.543622 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e4a8f-4549-42bd-95dd-fc70eb7f722e None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:23.543622 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e4a8f-4549-42bd-95dd-fc70eb7f722e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:23.564808 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-f46e4a8f-4549-42bd-95dd-fc70eb7f722e None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:23.564808 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f46e4a8f-4549-42bd-95dd-fc70eb7f722e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:23.622932 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 323/639] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:23.623757 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e4a8f-4549-42bd-95dd-fc70eb7f722e None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:23.632428 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793d084-3e4c-4306-a6ea-caa852de948b None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:23.663847 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d24ed-c898-40ab-8e48-532fec887441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:23.664494 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d24ed-c898-40ab-8e48-532fec887441 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:23.664803 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d24ed-c898-40ab-8e48-532fec887441 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:23.665616 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d24ed-c898-40ab-8e48-532fec887441 None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:23.666476 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d24ed-c898-40ab-8e48-532fec887441 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:23.666782 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d24ed-c898-40ab-8e48-532fec887441 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:23.668225 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d24ed-c898-40ab-8e48-532fec887441 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:23.679501 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 317/640] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:23.680269 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d24ed-c898-40ab-8e48-532fec887441 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:23.717250 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e4a8f-4549-42bd-95dd-fc70eb7f722e None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:23.749210 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217d2ef-bd2d-465f-8e16-fb51ecf663eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:23.750002 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217d2ef-bd2d-465f-8e16-fb51ecf663eb None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:23.750286 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217d2ef-bd2d-465f-8e16-fb51ecf663eb None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:23.750559 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217d2ef-bd2d-465f-8e16-fb51ecf663eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:23.761021 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217d2ef-bd2d-465f-8e16-fb51ecf663eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:23.767889 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-b217d2ef-bd2d-465f-8e16-fb51ecf663eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:00:23.769093 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 324/641] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:23.769855 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217d2ef-bd2d-465f-8e16-fb51ecf663eb None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:23.773385 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d24ed-c898-40ab-8e48-532fec887441 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:23.805557 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85087f54-b32e-4453-894c-42bda0d9fb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:23.806270 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85087f54-b32e-4453-894c-42bda0d9fb9a None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:23.806555 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85087f54-b32e-4453-894c-42bda0d9fb9a None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:23.806830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85087f54-b32e-4453-894c-42bda0d9fb9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:23.807639 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85087f54-b32e-4453-894c-42bda0d9fb9a None admin] RBAC: Adding query filter params (role.id=fe0e7f0760f74b09b441426d672df700, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=72d4ac44d04943a5b24c7a1d6a31b7f2) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:23.807945 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85087f54-b32e-4453-894c-42bda0d9fb9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:23.809390 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85087f54-b32e-4453-894c-42bda0d9fb9a None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:23.824521 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 318/642] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:00:23 2022] GET /identity/v3/role_assignments?user.id=72d4ac44d04943a5b24c7a1d6a31b7f2&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=fe0e7f0760f74b09b441426d672df700 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:23.824521 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85087f54-b32e-4453-894c-42bda0d9fb9a None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:23.880856 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217d2ef-bd2d-465f-8e16-fb51ecf663eb None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:23.928098 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6d541-7c9d-4353-b154-c7df9ff5b44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:23.928696 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85087f54-b32e-4453-894c-42bda0d9fb9a None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:23.928937 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6d541-7c9d-4353-b154-c7df9ff5b44a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:23.929219 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6d541-7c9d-4353-b154-c7df9ff5b44a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:23.929494 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6d541-7c9d-4353-b154-c7df9ff5b44a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:23.944293 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6d541-7c9d-4353-b154-c7df9ff5b44a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:23.946133 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6d541-7c9d-4353-b154-c7df9ff5b44a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:23.964403 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-e2d6d541-7c9d-4353-b154-c7df9ff5b44a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:23.970455 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 325/643] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:23.970665 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6e948-9617-4cda-b4b1-15f584e274d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:23.970784 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6d541-7c9d-4353-b154-c7df9ff5b44a None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:23.970867 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6e948-9617-4cda-b4b1-15f584e274d2 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:23.970867 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6e948-9617-4cda-b4b1-15f584e274d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:23.970867 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6e948-9617-4cda-b4b1-15f584e274d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:23.979522 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6e948-9617-4cda-b4b1-15f584e274d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:23.986569 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-a9b6e948-9617-4cda-b4b1-15f584e274d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:00:23.987802 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 319/644] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:23.988575 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6e948-9617-4cda-b4b1-15f584e274d2 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:24.087925 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6d541-7c9d-4353-b154-c7df9ff5b44a None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:24.102256 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6e948-9617-4cda-b4b1-15f584e274d2 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:24.121259 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea13be-7a44-4959-ba0d-5c74379c8c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:24.122148 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea13be-7a44-4959-ba0d-5c74379c8c93 None admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:24.122429 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea13be-7a44-4959-ba0d-5c74379c8c93 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:24.122707 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea13be-7a44-4959-ba0d-5c74379c8c93 None admin] PATH_INFO: `/v3/projects/2b478af53391486eb72c85c786ed4abb/users/f375d86747d248fa95f487b073d92d83/roles/fe0e7f0760f74b09b441426d672df700` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:24.135955 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72363c56-3371-4f59-85aa-17e8e81a444a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:24.136622 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72363c56-3371-4f59-85aa-17e8e81a444a None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:24.136943 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72363c56-3371-4f59-85aa-17e8e81a444a None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:24.137099 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea13be-7a44-4959-ba0d-5c74379c8c93 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b478af53391486eb72c85c786ed4abb, user_id=f375d86747d248fa95f487b073d92d83, role_id=fe0e7f0760f74b09b441426d672df700)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:24.137207 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72363c56-3371-4f59-85aa-17e8e81a444a None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:24.137950 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72363c56-3371-4f59-85aa-17e8e81a444a None admin] RBAC: Adding query filter params (name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:24.138254 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72363c56-3371-4f59-85aa-17e8e81a444a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:24.138557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea13be-7a44-4959-ba0d-5c74379c8c93 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:24.139628 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72363c56-3371-4f59-85aa-17e8e81a444a None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:24.147697 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 320/645] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:00:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:24.148799 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72363c56-3371-4f59-85aa-17e8e81a444a None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:24.252695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 326/646] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 13:00:23 2022] PUT /identity/v3/projects/2b478af53391486eb72c85c786ed4abb/users/f375d86747d248fa95f487b073d92d83/roles/fe0e7f0760f74b09b441426d672df700 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:00:24.252695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea13be-7a44-4959-ba0d-5c74379c8c93 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:24.252986 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72363c56-3371-4f59-85aa-17e8e81a444a None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:24.289547 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b4efd-93e5-4e9e-bbfc-1ee81385ea3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:24.290843 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b4efd-93e5-4e9e-bbfc-1ee81385ea3a None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:24.291082 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b4efd-93e5-4e9e-bbfc-1ee81385ea3a None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:24.291353 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b4efd-93e5-4e9e-bbfc-1ee81385ea3a None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:24.292093 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b4efd-93e5-4e9e-bbfc-1ee81385ea3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:24.292399 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b4efd-93e5-4e9e-bbfc-1ee81385ea3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:24.293963 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b4efd-93e5-4e9e-bbfc-1ee81385ea3a None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:24.307233 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 321/647] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:24.308106 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b4efd-93e5-4e9e-bbfc-1ee81385ea3a None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:24.381044 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea13be-7a44-4959-ba0d-5c74379c8c93 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:24.419614 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea306ee3-d127-49b1-b5e2-c8f8737a9698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:24.420327 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea306ee3-d127-49b1-b5e2-c8f8737a9698 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:24.420609 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea306ee3-d127-49b1-b5e2-c8f8737a9698 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:24.420937 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea306ee3-d127-49b1-b5e2-c8f8737a9698 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:24.421695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea306ee3-d127-49b1-b5e2-c8f8737a9698 None admin] RBAC: Adding query filter params (name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:24.422001 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea306ee3-d127-49b1-b5e2-c8f8737a9698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:24.423405 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea306ee3-d127-49b1-b5e2-c8f8737a9698 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:24.428330 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b4efd-93e5-4e9e-bbfc-1ee81385ea3a None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:24.432870 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 327/648] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:00:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:24.433747 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea306ee3-d127-49b1-b5e2-c8f8737a9698 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:24.464380 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffd475-a6b0-4fda-8ac6-33afbc607350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:24.465202 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffd475-a6b0-4fda-8ac6-33afbc607350 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:24.465489 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffd475-a6b0-4fda-8ac6-33afbc607350 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:24.465754 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffd475-a6b0-4fda-8ac6-33afbc607350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:24.476442 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffd475-a6b0-4fda-8ac6-33afbc607350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:24.478536 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffd475-a6b0-4fda-8ac6-33afbc607350 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:24.495495 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-2cffd475-a6b0-4fda-8ac6-33afbc607350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:24.497009 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 322/649] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:24.497789 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffd475-a6b0-4fda-8ac6-33afbc607350 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:24.541605 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea306ee3-d127-49b1-b5e2-c8f8737a9698 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:24.579617 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6af04-e89a-4cf8-a902-1e46e4022b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:24.580424 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6af04-e89a-4cf8-a902-1e46e4022b41 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:24.580739 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6af04-e89a-4cf8-a902-1e46e4022b41 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:24.581020 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6af04-e89a-4cf8-a902-1e46e4022b41 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:24.588978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6af04-e89a-4cf8-a902-1e46e4022b41 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:24.590507 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6af04-e89a-4cf8-a902-1e46e4022b41 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:24.605345 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-90a6af04-e89a-4cf8-a902-1e46e4022b41 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 08 13:00:24.606789 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 328/650] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:00:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:24.607636 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6af04-e89a-4cf8-a902-1e46e4022b41 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:24.611208 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffd475-a6b0-4fda-8ac6-33afbc607350 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:24.654512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e456a2-06ee-4c32-b443-eb759e9f1ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:24.655594 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e456a2-06ee-4c32-b443-eb759e9f1ea7 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:24.656019 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e456a2-06ee-4c32-b443-eb759e9f1ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:24.656297 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e456a2-06ee-4c32-b443-eb759e9f1ea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:24.669184 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e456a2-06ee-4c32-b443-eb759e9f1ea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:24.683293 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e456a2-06ee-4c32-b443-eb759e9f1ea7 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:24.690037 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-53e456a2-06ee-4c32-b443-eb759e9f1ea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:24.691565 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 323/651] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:24.692340 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e456a2-06ee-4c32-b443-eb759e9f1ea7 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:24.718378 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6af04-e89a-4cf8-a902-1e46e4022b41 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:24.753762 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab368a-8eb3-4e4b-a0f4-1fad9089bfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:24.754581 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab368a-8eb3-4e4b-a0f4-1fad9089bfd1 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:24.755146 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab368a-8eb3-4e4b-a0f4-1fad9089bfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:24.755527 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab368a-8eb3-4e4b-a0f4-1fad9089bfd1 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:24.756412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab368a-8eb3-4e4b-a0f4-1fad9089bfd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:24.756847 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab368a-8eb3-4e4b-a0f4-1fad9089bfd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:24.758334 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab368a-8eb3-4e4b-a0f4-1fad9089bfd1 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:24.776897 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 329/652] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:24.778284 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab368a-8eb3-4e4b-a0f4-1fad9089bfd1 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:24.794609 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e456a2-06ee-4c32-b443-eb759e9f1ea7 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:24.829651 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073852e-c6c1-45f4-bd11-8cd586541d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:24.829651 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073852e-c6c1-45f4-bd11-8cd586541d65 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:24.832680 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073852e-c6c1-45f4-bd11-8cd586541d65 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:24.832680 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073852e-c6c1-45f4-bd11-8cd586541d65 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:24.832680 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073852e-c6c1-45f4-bd11-8cd586541d65 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:24.832680 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073852e-c6c1-45f4-bd11-8cd586541d65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:24.833510 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073852e-c6c1-45f4-bd11-8cd586541d65 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:24.851557 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 324/653] 10.222.0.52 () {56 vars in 1137 bytes} [Tue Mar 8 13:00:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:24.853323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073852e-c6c1-45f4-bd11-8cd586541d65 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:24.881407 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab368a-8eb3-4e4b-a0f4-1fad9089bfd1 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:24.917684 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417d132-cc67-418e-a12b-36d9d40bb986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:24.918444 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417d132-cc67-418e-a12b-36d9d40bb986 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:24.918804 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417d132-cc67-418e-a12b-36d9d40bb986 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:24.919228 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417d132-cc67-418e-a12b-36d9d40bb986 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:24.919964 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417d132-cc67-418e-a12b-36d9d40bb986 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:24.920343 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417d132-cc67-418e-a12b-36d9d40bb986 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:24.921818 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417d132-cc67-418e-a12b-36d9d40bb986 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:24.934274 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 330/654] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:24.935281 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417d132-cc67-418e-a12b-36d9d40bb986 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:24.956963 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073852e-c6c1-45f4-bd11-8cd586541d65 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:24.991548 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce999c08-1081-4b12-9392-4942dcb30417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:24.992685 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce999c08-1081-4b12-9392-4942dcb30417 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:24.993207 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce999c08-1081-4b12-9392-4942dcb30417 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:24.993667 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce999c08-1081-4b12-9392-4942dcb30417 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:25.001362 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce999c08-1081-4b12-9392-4942dcb30417 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:25.003135 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce999c08-1081-4b12-9392-4942dcb30417 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:25.018887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-ce999c08-1081-4b12-9392-4942dcb30417 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 08 13:00:25.020840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 325/655] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:00:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:25.021876 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce999c08-1081-4b12-9392-4942dcb30417 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:25.045056 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417d132-cc67-418e-a12b-36d9d40bb986 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:25.081912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0859c87-4f4d-47a7-b8bd-9a84d7de41bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:25.082550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859c87-4f4d-47a7-b8bd-9a84d7de41bd None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:25.082837 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859c87-4f4d-47a7-b8bd-9a84d7de41bd None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:25.083115 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859c87-4f4d-47a7-b8bd-9a84d7de41bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:25.128858 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce999c08-1081-4b12-9392-4942dcb30417 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:25.153863 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0859c87-4f4d-47a7-b8bd-9a84d7de41bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:25.155651 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0859c87-4f4d-47a7-b8bd-9a84d7de41bd None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:25.172694 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8c210-3142-4366-867f-fdbc1ead81d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:25.173915 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8c210-3142-4366-867f-fdbc1ead81d9 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:25.174208 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8c210-3142-4366-867f-fdbc1ead81d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:25.174487 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8c210-3142-4366-867f-fdbc1ead81d9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:25.184058 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8c210-3142-4366-867f-fdbc1ead81d9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:25.185754 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8c210-3142-4366-867f-fdbc1ead81d9 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:25.204074 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-24d8c210-3142-4366-867f-fdbc1ead81d9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 08 13:00:25.206183 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 326/656] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:25.207042 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8c210-3142-4366-867f-fdbc1ead81d9 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:25.261676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 331/657] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:00:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:00:25.262842 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0859c87-4f4d-47a7-b8bd-9a84d7de41bd None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:25.341892 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8c210-3142-4366-867f-fdbc1ead81d9 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:25.370802 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0859c87-4f4d-47a7-b8bd-9a84d7de41bd None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:25.375791 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfe785-240a-494f-9637-9ef9bf5768e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:25.376627 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfe785-240a-494f-9637-9ef9bf5768e1 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:25.377038 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfe785-240a-494f-9637-9ef9bf5768e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:25.377411 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfe785-240a-494f-9637-9ef9bf5768e1 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:25.378379 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfe785-240a-494f-9637-9ef9bf5768e1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:25.378788 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfe785-240a-494f-9637-9ef9bf5768e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:25.380377 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfe785-240a-494f-9637-9ef9bf5768e1 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:25.403327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 327/658] 10.222.0.52 () {56 vars in 1137 bytes} [Tue Mar 8 13:00:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:25.403327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfe785-240a-494f-9637-9ef9bf5768e1 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:25.416912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8a7e3-1aad-4b4a-9682-2adb6f62f04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:25.417675 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8a7e3-1aad-4b4a-9682-2adb6f62f04c None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:25.418135 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8a7e3-1aad-4b4a-9682-2adb6f62f04c None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:25.418459 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8a7e3-1aad-4b4a-9682-2adb6f62f04c None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:25.419443 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8a7e3-1aad-4b4a-9682-2adb6f62f04c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:25.419791 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8a7e3-1aad-4b4a-9682-2adb6f62f04c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:25.421398 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8a7e3-1aad-4b4a-9682-2adb6f62f04c None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:25.440090 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 332/659] 10.222.0.52 () {56 vars in 1139 bytes} [Tue Mar 8 13:00:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:25.442007 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8a7e3-1aad-4b4a-9682-2adb6f62f04c None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:25.515963 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfe785-240a-494f-9637-9ef9bf5768e1 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:25.544975 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8a7e3-1aad-4b4a-9682-2adb6f62f04c None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:25.551764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86614db-8e62-4789-82f7-44eb3f38e72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:25.552875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86614db-8e62-4789-82f7-44eb3f38e72c None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:25.553371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86614db-8e62-4789-82f7-44eb3f38e72c None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:25.553843 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86614db-8e62-4789-82f7-44eb3f38e72c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:25.570009 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86614db-8e62-4789-82f7-44eb3f38e72c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:25.572447 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86614db-8e62-4789-82f7-44eb3f38e72c None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:25.581340 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee30b4-3197-4a9a-aabc-fc552ecaf3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:25.581989 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee30b4-3197-4a9a-aabc-fc552ecaf3c9 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:25.582417 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee30b4-3197-4a9a-aabc-fc552ecaf3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:25.582693 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee30b4-3197-4a9a-aabc-fc552ecaf3c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:25.595703 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-f86614db-8e62-4789-82f7-44eb3f38e72c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:25.597539 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 328/660] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:25.598516 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86614db-8e62-4789-82f7-44eb3f38e72c None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:25.653300 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee30b4-3197-4a9a-aabc-fc552ecaf3c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:25.654758 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee30b4-3197-4a9a-aabc-fc552ecaf3c9 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:25.701036 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86614db-8e62-4789-82f7-44eb3f38e72c None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:25.735151 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cd492-dba5-4439-b2d7-b0b8ccb3d549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:25.736146 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cd492-dba5-4439-b2d7-b0b8ccb3d549 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:25.736811 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cd492-dba5-4439-b2d7-b0b8ccb3d549 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:25.737302 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cd492-dba5-4439-b2d7-b0b8ccb3d549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:25.760051 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 333/661] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:00:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:00:25.760051 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee30b4-3197-4a9a-aabc-fc552ecaf3c9 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:25.811682 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89cd492-dba5-4439-b2d7-b0b8ccb3d549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:25.813843 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89cd492-dba5-4439-b2d7-b0b8ccb3d549 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:25.856748 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee30b4-3197-4a9a-aabc-fc552ecaf3c9 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:25.890911 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742b4a5-b304-41be-a060-81327ba32044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:25.891581 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742b4a5-b304-41be-a060-81327ba32044 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:25.891863 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742b4a5-b304-41be-a060-81327ba32044 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:25.892138 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742b4a5-b304-41be-a060-81327ba32044 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:25.892887 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742b4a5-b304-41be-a060-81327ba32044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:25.893197 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742b4a5-b304-41be-a060-81327ba32044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:25.894569 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742b4a5-b304-41be-a060-81327ba32044 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:25.907140 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 334/662] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:25.907896 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742b4a5-b304-41be-a060-81327ba32044 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:25.924139 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 329/663] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:00:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:00:25.925445 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cd492-dba5-4439-b2d7-b0b8ccb3d549 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:26.013489 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742b4a5-b304-41be-a060-81327ba32044 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:26.054958 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cd492-dba5-4439-b2d7-b0b8ccb3d549 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:26.061187 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1c8a4-cd01-4490-82a1-c9544c774d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:26.061990 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1c8a4-cd01-4490-82a1-c9544c774d17 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:26.062266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1c8a4-cd01-4490-82a1-c9544c774d17 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:26.062535 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1c8a4-cd01-4490-82a1-c9544c774d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:26.077856 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1c8a4-cd01-4490-82a1-c9544c774d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:26.078569 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1c8a4-cd01-4490-82a1-c9544c774d17 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:26.096087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-c9c1c8a4-cd01-4490-82a1-c9544c774d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:26.101796 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 335/664] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:26.101796 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1c8a4-cd01-4490-82a1-c9544c774d17 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:26.110885 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23590f-5e32-4d24-a566-533df005389c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:26.112030 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23590f-5e32-4d24-a566-533df005389c None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:26.112530 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23590f-5e32-4d24-a566-533df005389c None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:26.113049 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23590f-5e32-4d24-a566-533df005389c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:26.120860 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23590f-5e32-4d24-a566-533df005389c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:26.122632 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23590f-5e32-4d24-a566-533df005389c None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:26.136725 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-ce23590f-5e32-4d24-a566-533df005389c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:26.138690 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 330/665] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:26.139727 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23590f-5e32-4d24-a566-533df005389c None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:26.203305 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1c8a4-cd01-4490-82a1-c9544c774d17 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:26.236796 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935d237-363e-4a1b-8df0-f75082c3b53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:26.237682 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935d237-363e-4a1b-8df0-f75082c3b53d None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:26.237973 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935d237-363e-4a1b-8df0-f75082c3b53d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:26.238253 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935d237-363e-4a1b-8df0-f75082c3b53d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:26.241740 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23590f-5e32-4d24-a566-533df005389c None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:26.249988 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935d237-363e-4a1b-8df0-f75082c3b53d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:26.251450 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935d237-363e-4a1b-8df0-f75082c3b53d None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:26.268564 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-8935d237-363e-4a1b-8df0-f75082c3b53d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:26.270227 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 336/666] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:26.270810 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935d237-363e-4a1b-8df0-f75082c3b53d None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:26.279471 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084c7bc-d101-409f-92fa-a332a859f08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:26.280454 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084c7bc-d101-409f-92fa-a332a859f08c None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:26.281087 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084c7bc-d101-409f-92fa-a332a859f08c None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:26.281581 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084c7bc-d101-409f-92fa-a332a859f08c None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:26.282507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084c7bc-d101-409f-92fa-a332a859f08c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:26.283032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084c7bc-d101-409f-92fa-a332a859f08c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:26.284724 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084c7bc-d101-409f-92fa-a332a859f08c None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:26.298774 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 331/667] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:26.299987 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084c7bc-d101-409f-92fa-a332a859f08c None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:26.395523 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935d237-363e-4a1b-8df0-f75082c3b53d None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:26.406424 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084c7bc-d101-409f-92fa-a332a859f08c None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:26.433862 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b14a3-28d7-4d2d-ac5e-c671ca679a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:26.434522 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b14a3-28d7-4d2d-ac5e-c671ca679a78 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:26.434800 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b14a3-28d7-4d2d-ac5e-c671ca679a78 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:26.435071 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b14a3-28d7-4d2d-ac5e-c671ca679a78 None admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:26.435855 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b14a3-28d7-4d2d-ac5e-c671ca679a78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:26.436161 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b14a3-28d7-4d2d-ac5e-c671ca679a78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:26.437622 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b14a3-28d7-4d2d-ac5e-c671ca679a78 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:26.450171 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 337/668] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:26.451477 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c4fbb-72fc-422c-9671-7d6729198258 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:26.451759 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c4fbb-72fc-422c-9671-7d6729198258 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:26.452033 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c4fbb-72fc-422c-9671-7d6729198258 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:26.453885 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 338/669] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:26.456530 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a47ea-0f67-4047-9b2f-f84185340da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:26.457411 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a47ea-0f67-4047-9b2f-f84185340da7 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:26.457972 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a47ea-0f67-4047-9b2f-f84185340da7 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:26.458487 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a47ea-0f67-4047-9b2f-f84185340da7 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:26.458588 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c4fbb-72fc-422c-9671-7d6729198258 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:26.459487 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a47ea-0f67-4047-9b2f-f84185340da7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:26.459966 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a47ea-0f67-4047-9b2f-f84185340da7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:26.461612 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a47ea-0f67-4047-9b2f-f84185340da7 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:26.474074 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 332/670] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:26.475093 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a47ea-0f67-4047-9b2f-f84185340da7 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:26.566293 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c4fbb-72fc-422c-9671-7d6729198258 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:26.578413 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a47ea-0f67-4047-9b2f-f84185340da7 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:26.599273 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a333232-8539-43b4-8062-fa9f13d91fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:26.600062 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a333232-8539-43b4-8062-fa9f13d91fdc None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:26.600341 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a333232-8539-43b4-8062-fa9f13d91fdc None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:26.600614 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a333232-8539-43b4-8062-fa9f13d91fdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:26.607673 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a333232-8539-43b4-8062-fa9f13d91fdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:26.609157 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a333232-8539-43b4-8062-fa9f13d91fdc None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:26.611361 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0636e4c-124d-431d-8672-083e6452c5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:26.612012 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0636e4c-124d-431d-8672-083e6452c5c8 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:26.612297 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0636e4c-124d-431d-8672-083e6452c5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:26.612572 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0636e4c-124d-431d-8672-083e6452c5c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:26.613429 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0636e4c-124d-431d-8672-083e6452c5c8 None admin] RBAC: Adding query filter params (role.id=fe0e7f0760f74b09b441426d672df700, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=81124c3324d7427a9f29270b88e88f70) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:26.613743 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0636e4c-124d-431d-8672-083e6452c5c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:26.615161 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0636e4c-124d-431d-8672-083e6452c5c8 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:26.628683 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 333/671] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:00:26 2022] GET /identity/v3/role_assignments?user.id=81124c3324d7427a9f29270b88e88f70&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=fe0e7f0760f74b09b441426d672df700 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:26.628897 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-0a333232-8539-43b4-8062-fa9f13d91fdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:26.628994 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec83201-3dbf-43ac-9c96-fb587d7e242c None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:26.628994 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec83201-3dbf-43ac-9c96-fb587d7e242c None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:26.628994 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec83201-3dbf-43ac-9c96-fb587d7e242c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:26.629228 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 339/672] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:26.629228 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a333232-8539-43b4-8062-fa9f13d91fdc None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:26.646902 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-0ec83201-3dbf-43ac-9c96-fb587d7e242c None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:26.648136 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-0ec83201-3dbf-43ac-9c96-fb587d7e242c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:26.734824 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 334/673] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:26.735758 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec83201-3dbf-43ac-9c96-fb587d7e242c None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:26.759489 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a333232-8539-43b4-8062-fa9f13d91fdc None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:26.804643 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31f26e-7c94-4204-8b4d-b31485ca61d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:26.806094 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31f26e-7c94-4204-8b4d-b31485ca61d9 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:26.806369 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31f26e-7c94-4204-8b4d-b31485ca61d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:26.806742 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31f26e-7c94-4204-8b4d-b31485ca61d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:26.813905 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31f26e-7c94-4204-8b4d-b31485ca61d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:26.815385 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31f26e-7c94-4204-8b4d-b31485ca61d9 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:26.829384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-8f31f26e-7c94-4204-8b4d-b31485ca61d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:26.830546 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 340/674] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:26.831920 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e891ee-12a6-4727-a3db-93e4514dd2bb None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:26.832205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e891ee-12a6-4727-a3db-93e4514dd2bb None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:26.832475 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e891ee-12a6-4727-a3db-93e4514dd2bb None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:26.837006 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 341/675] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:26.837946 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e891ee-12a6-4727-a3db-93e4514dd2bb None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:26.843466 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec83201-3dbf-43ac-9c96-fb587d7e242c None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:26.881335 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e250e14-799e-4099-854e-c019d6aaaece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:26.881996 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e250e14-799e-4099-854e-c019d6aaaece None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:26.882273 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e250e14-799e-4099-854e-c019d6aaaece None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:26.882543 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e250e14-799e-4099-854e-c019d6aaaece None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:26.883354 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e250e14-799e-4099-854e-c019d6aaaece None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:26.883665 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e250e14-799e-4099-854e-c019d6aaaece None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:26.885170 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e250e14-799e-4099-854e-c019d6aaaece None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:26.896537 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 335/676] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:26.897375 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e250e14-799e-4099-854e-c019d6aaaece None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:26.955126 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e891ee-12a6-4727-a3db-93e4514dd2bb None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:26.992576 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0963d77-a7d0-4759-8c1a-01d5e587c2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:26.993939 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0963d77-a7d0-4759-8c1a-01d5e587c2dd None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:26.994225 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0963d77-a7d0-4759-8c1a-01d5e587c2dd None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:26.994503 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0963d77-a7d0-4759-8c1a-01d5e587c2dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:26.997864 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e250e14-799e-4099-854e-c019d6aaaece None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:27.004464 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0963d77-a7d0-4759-8c1a-01d5e587c2dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:27.011412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-d0963d77-a7d0-4759-8c1a-01d5e587c2dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:00:27.012798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 342/677] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:00:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:27.018073 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb49f57-1a72-441d-a225-f95a5a721fe5 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:27.018365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb49f57-1a72-441d-a225-f95a5a721fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:27.018647 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb49f57-1a72-441d-a225-f95a5a721fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:27.033262 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f335a58-d56f-4107-90da-974f37e5be25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:27.033912 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f335a58-d56f-4107-90da-974f37e5be25 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:27.034191 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f335a58-d56f-4107-90da-974f37e5be25 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:27.034463 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f335a58-d56f-4107-90da-974f37e5be25 None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:27.035240 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f335a58-d56f-4107-90da-974f37e5be25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:27.035545 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f335a58-d56f-4107-90da-974f37e5be25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:27.036786 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-5fb49f57-1a72-441d-a225-f95a5a721fe5 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:27.036997 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f335a58-d56f-4107-90da-974f37e5be25 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:27.037964 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-5fb49f57-1a72-441d-a225-f95a5a721fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:27.049132 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 336/678] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:27.049941 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f335a58-d56f-4107-90da-974f37e5be25 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:27.115676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 343/679] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:27.117098 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb49f57-1a72-441d-a225-f95a5a721fe5 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:27.161930 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f335a58-d56f-4107-90da-974f37e5be25 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:27.196652 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3141d-0321-4ff4-a1a3-8d084f27ccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:27.197355 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3141d-0321-4ff4-a1a3-8d084f27ccf3 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:27.197643 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3141d-0321-4ff4-a1a3-8d084f27ccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:27.197919 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3141d-0321-4ff4-a1a3-8d084f27ccf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:27.198749 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3141d-0321-4ff4-a1a3-8d084f27ccf3 None admin] RBAC: Adding query filter params (role.id=fe0e7f0760f74b09b441426d672df700, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=b9a2746615c14162be82dea409930590) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:27.199237 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3141d-0321-4ff4-a1a3-8d084f27ccf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:27.200552 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3141d-0321-4ff4-a1a3-8d084f27ccf3 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:27.212764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 337/680] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:00:27 2022] GET /identity/v3/role_assignments?user.id=b9a2746615c14162be82dea409930590&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=fe0e7f0760f74b09b441426d672df700 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:27.212764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3141d-0321-4ff4-a1a3-8d084f27ccf3 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:27.223075 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb49f57-1a72-441d-a225-f95a5a721fe5 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:27.268277 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3361cd-7390-4e37-947c-8301dd236d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:27.269096 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3361cd-7390-4e37-947c-8301dd236d0c None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:27.269453 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3361cd-7390-4e37-947c-8301dd236d0c None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:27.269800 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3361cd-7390-4e37-947c-8301dd236d0c None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:27.271154 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3361cd-7390-4e37-947c-8301dd236d0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:27.271875 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3361cd-7390-4e37-947c-8301dd236d0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:27.273741 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3361cd-7390-4e37-947c-8301dd236d0c None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:27.287409 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 344/681] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:00:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:27.288580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3361cd-7390-4e37-947c-8301dd236d0c None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:27.333561 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3141d-0321-4ff4-a1a3-8d084f27ccf3 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:27.373331 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b7137-ef64-4e92-a8f4-c6465412f827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:27.374356 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b7137-ef64-4e92-a8f4-c6465412f827 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:27.374866 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b7137-ef64-4e92-a8f4-c6465412f827 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:27.375334 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b7137-ef64-4e92-a8f4-c6465412f827 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:27.376371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b7137-ef64-4e92-a8f4-c6465412f827 None admin] RBAC: Adding query filter params (role.id=fe0e7f0760f74b09b441426d672df700, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=22bf06400d8f47f4bb3badd7f65bc205) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:27.376982 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b7137-ef64-4e92-a8f4-c6465412f827 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:27.378677 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b7137-ef64-4e92-a8f4-c6465412f827 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:27.386814 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 338/682] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:00:27 2022] GET /identity/v3/role_assignments?user.id=22bf06400d8f47f4bb3badd7f65bc205&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=fe0e7f0760f74b09b441426d672df700 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:27.387988 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b7137-ef64-4e92-a8f4-c6465412f827 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:27.421265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3361cd-7390-4e37-947c-8301dd236d0c None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:27.460017 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46486f3d-19cd-47e6-b107-e5b7aa2d6b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:27.460880 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46486f3d-19cd-47e6-b107-e5b7aa2d6b09 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:27.461164 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46486f3d-19cd-47e6-b107-e5b7aa2d6b09 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:27.462063 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46486f3d-19cd-47e6-b107-e5b7aa2d6b09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:27.475621 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46486f3d-19cd-47e6-b107-e5b7aa2d6b09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:27.482966 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-46486f3d-19cd-47e6-b107-e5b7aa2d6b09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:00:27.484505 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 345/683] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:27.490269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46486f3d-19cd-47e6-b107-e5b7aa2d6b09 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:27.506788 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b7137-ef64-4e92-a8f4-c6465412f827 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:27.550929 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb627f5d-6edf-4bf9-bb4a-2245ee38febf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:27.551813 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb627f5d-6edf-4bf9-bb4a-2245ee38febf None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:27.552158 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb627f5d-6edf-4bf9-bb4a-2245ee38febf None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:27.552442 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb627f5d-6edf-4bf9-bb4a-2245ee38febf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:27.564815 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb627f5d-6edf-4bf9-bb4a-2245ee38febf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:27.566321 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb627f5d-6edf-4bf9-bb4a-2245ee38febf None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:27.589042 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-fb627f5d-6edf-4bf9-bb4a-2245ee38febf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:27.590499 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 339/684] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:27.596931 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb627f5d-6edf-4bf9-bb4a-2245ee38febf None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:27.605930 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46486f3d-19cd-47e6-b107-e5b7aa2d6b09 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:27.643031 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22f731-d329-4240-8346-a1356eaeb34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:27.643625 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22f731-d329-4240-8346-a1356eaeb34e None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:27.643909 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22f731-d329-4240-8346-a1356eaeb34e None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:27.644186 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22f731-d329-4240-8346-a1356eaeb34e None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:27.644974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22f731-d329-4240-8346-a1356eaeb34e None admin] RBAC: Adding query filter params (name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:27.645281 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22f731-d329-4240-8346-a1356eaeb34e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:27.646669 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22f731-d329-4240-8346-a1356eaeb34e None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:27.656997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 346/685] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:27.662409 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22f731-d329-4240-8346-a1356eaeb34e None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:27.716178 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb627f5d-6edf-4bf9-bb4a-2245ee38febf None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:27.751189 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28e52e-f779-4154-8b3f-99df1f1b82d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:27.751862 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28e52e-f779-4154-8b3f-99df1f1b82d8 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:27.752145 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28e52e-f779-4154-8b3f-99df1f1b82d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:27.752465 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28e52e-f779-4154-8b3f-99df1f1b82d8 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:27.753189 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28e52e-f779-4154-8b3f-99df1f1b82d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:27.753495 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28e52e-f779-4154-8b3f-99df1f1b82d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:27.754878 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28e52e-f779-4154-8b3f-99df1f1b82d8 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:27.770874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 340/686] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:27.773425 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28e52e-f779-4154-8b3f-99df1f1b82d8 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:27.774571 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22f731-d329-4240-8346-a1356eaeb34e None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:27.808980 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c2c47-b3cd-48fc-8ec9-200d1985453b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:27.810045 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c2c47-b3cd-48fc-8ec9-200d1985453b None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:27.810466 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c2c47-b3cd-48fc-8ec9-200d1985453b None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:27.810877 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c2c47-b3cd-48fc-8ec9-200d1985453b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:27.822607 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c2c47-b3cd-48fc-8ec9-200d1985453b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:27.824259 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c2c47-b3cd-48fc-8ec9-200d1985453b None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:27.841531 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-373c2c47-b3cd-48fc-8ec9-200d1985453b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:27.843266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 347/687] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:27.848612 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c2c47-b3cd-48fc-8ec9-200d1985453b None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:27.885190 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28e52e-f779-4154-8b3f-99df1f1b82d8 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:27.938494 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65425e8f-7cb6-4649-8e9b-982b06d5874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:27.940332 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65425e8f-7cb6-4649-8e9b-982b06d5874f None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:27.941002 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65425e8f-7cb6-4649-8e9b-982b06d5874f None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:27.942793 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65425e8f-7cb6-4649-8e9b-982b06d5874f None admin] PATH_INFO: `/v3/users/nova` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:27.957745 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65425e8f-7cb6-4649-8e9b-982b06d5874f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:27.959690 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65425e8f-7cb6-4649-8e9b-982b06d5874f None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:27.972786 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c2c47-b3cd-48fc-8ec9-200d1985453b None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:27.987115 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-65425e8f-7cb6-4649-8e9b-982b06d5874f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 13:00:27.996829 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 341/688] 10.222.0.52 () {56 vars in 1093 bytes} [Tue Mar 8 13:00:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:28.001913 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65425e8f-7cb6-4649-8e9b-982b06d5874f None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:28.046641 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54daa91-7bdb-4fe7-ab66-30a690901bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:28.047687 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54daa91-7bdb-4fe7-ab66-30a690901bcc None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:28.048174 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54daa91-7bdb-4fe7-ab66-30a690901bcc None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:28.048685 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54daa91-7bdb-4fe7-ab66-30a690901bcc None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:28.049734 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54daa91-7bdb-4fe7-ab66-30a690901bcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:28.050257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54daa91-7bdb-4fe7-ab66-30a690901bcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:28.051868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54daa91-7bdb-4fe7-ab66-30a690901bcc None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:28.068863 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 348/689] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:28.070406 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54daa91-7bdb-4fe7-ab66-30a690901bcc None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:28.181398 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65425e8f-7cb6-4649-8e9b-982b06d5874f None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:28.223169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5b86f-766a-41f3-8efc-3a780546ca75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:28.223757 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5b86f-766a-41f3-8efc-3a780546ca75 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:28.224040 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5b86f-766a-41f3-8efc-3a780546ca75 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:28.224318 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5b86f-766a-41f3-8efc-3a780546ca75 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:28.225186 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5b86f-766a-41f3-8efc-3a780546ca75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:28.225495 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5b86f-766a-41f3-8efc-3a780546ca75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:28.227500 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5b86f-766a-41f3-8efc-3a780546ca75 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:28.227609 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54daa91-7bdb-4fe7-ab66-30a690901bcc None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:28.261550 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 342/690] 10.222.0.52 () {56 vars in 1133 bytes} [Tue Mar 8 13:00:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:28.267078 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5b86f-766a-41f3-8efc-3a780546ca75 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:28.269264 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa84b5-c6df-4dab-b92d-e97dd1d862b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:28.270105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa84b5-c6df-4dab-b92d-e97dd1d862b7 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:28.270391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa84b5-c6df-4dab-b92d-e97dd1d862b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:28.270846 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa84b5-c6df-4dab-b92d-e97dd1d862b7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:28.287072 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa84b5-c6df-4dab-b92d-e97dd1d862b7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:28.288870 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa84b5-c6df-4dab-b92d-e97dd1d862b7 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:28.309170 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-0efa84b5-c6df-4dab-b92d-e97dd1d862b7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 13:00:28.321836 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 349/691] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:00:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:28.325779 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa84b5-c6df-4dab-b92d-e97dd1d862b7 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:28.392008 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5b86f-766a-41f3-8efc-3a780546ca75 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:28.441649 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbff978-ba45-4f56-9653-6db2876ccea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:28.442302 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbff978-ba45-4f56-9653-6db2876ccea1 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:28.442581 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbff978-ba45-4f56-9653-6db2876ccea1 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:28.442851 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbff978-ba45-4f56-9653-6db2876ccea1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:28.502703 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa84b5-c6df-4dab-b92d-e97dd1d862b7 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:28.548407 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbff978-ba45-4f56-9653-6db2876ccea1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:28.549896 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbff978-ba45-4f56-9653-6db2876ccea1 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:28.550249 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63dbb2-01d0-431c-84ba-2b3712d041a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:28.550922 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63dbb2-01d0-431c-84ba-2b3712d041a1 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:28.551203 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63dbb2-01d0-431c-84ba-2b3712d041a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:28.551476 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63dbb2-01d0-431c-84ba-2b3712d041a1 None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:28.552313 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63dbb2-01d0-431c-84ba-2b3712d041a1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:28.552616 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63dbb2-01d0-431c-84ba-2b3712d041a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:28.554062 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63dbb2-01d0-431c-84ba-2b3712d041a1 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:28.573067 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 350/692] 10.222.0.52 () {56 vars in 1135 bytes} [Tue Mar 8 13:00:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:28.578373 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63dbb2-01d0-431c-84ba-2b3712d041a1 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:28.648449 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 343/693] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:00:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:00:28.655162 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbff978-ba45-4f56-9653-6db2876ccea1 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:28.677462 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63dbb2-01d0-431c-84ba-2b3712d041a1 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:28.718333 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750cd26-eb9d-4ed3-88bc-9a6163eed341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:28.718994 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750cd26-eb9d-4ed3-88bc-9a6163eed341 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:28.719259 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750cd26-eb9d-4ed3-88bc-9a6163eed341 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:28.719525 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750cd26-eb9d-4ed3-88bc-9a6163eed341 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:28.793740 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750cd26-eb9d-4ed3-88bc-9a6163eed341 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:28.795142 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750cd26-eb9d-4ed3-88bc-9a6163eed341 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:28.878802 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbff978-ba45-4f56-9653-6db2876ccea1 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:28.894894 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 351/694] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:00:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 13:00:28.901410 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750cd26-eb9d-4ed3-88bc-9a6163eed341 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:28.948026 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a41bf-4397-48bf-be13-845e48102c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:28.949551 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a41bf-4397-48bf-be13-845e48102c7f None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:28.950067 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a41bf-4397-48bf-be13-845e48102c7f None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:28.950542 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a41bf-4397-48bf-be13-845e48102c7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:28.975069 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a41bf-4397-48bf-be13-845e48102c7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:28.977524 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a41bf-4397-48bf-be13-845e48102c7f None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:29.017224 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750cd26-eb9d-4ed3-88bc-9a6163eed341 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:29.020847 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-902a41bf-4397-48bf-be13-845e48102c7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:29.022401 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 344/695] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:29.028056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a41bf-4397-48bf-be13-845e48102c7f None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:29.058470 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db82d11-c351-4a40-b3aa-6c08f87bfbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:29.059205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db82d11-c351-4a40-b3aa-6c08f87bfbde None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:29.059486 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db82d11-c351-4a40-b3aa-6c08f87bfbde None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:29.059760 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db82d11-c351-4a40-b3aa-6c08f87bfbde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:29.078885 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db82d11-c351-4a40-b3aa-6c08f87bfbde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:29.080410 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db82d11-c351-4a40-b3aa-6c08f87bfbde None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:29.111000 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-2db82d11-c351-4a40-b3aa-6c08f87bfbde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:29.113655 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 352/696] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:29.129635 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db82d11-c351-4a40-b3aa-6c08f87bfbde None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:29.184458 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a41bf-4397-48bf-be13-845e48102c7f None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:29.231592 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099750d-381b-4f05-b23c-72355f1a6a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:29.232244 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099750d-381b-4f05-b23c-72355f1a6a01 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:29.232601 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099750d-381b-4f05-b23c-72355f1a6a01 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:29.232838 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099750d-381b-4f05-b23c-72355f1a6a01 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:29.233566 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099750d-381b-4f05-b23c-72355f1a6a01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:29.233867 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099750d-381b-4f05-b23c-72355f1a6a01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:29.235240 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099750d-381b-4f05-b23c-72355f1a6a01 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:29.235614 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db82d11-c351-4a40-b3aa-6c08f87bfbde None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:29.253981 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 345/697] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:29.260037 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099750d-381b-4f05-b23c-72355f1a6a01 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:29.298169 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11604e1-199e-488c-914e-10e24d89330e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:29.299137 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11604e1-199e-488c-914e-10e24d89330e None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:29.299624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11604e1-199e-488c-914e-10e24d89330e None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:29.300116 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11604e1-199e-488c-914e-10e24d89330e None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:29.301089 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11604e1-199e-488c-914e-10e24d89330e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:29.302408 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11604e1-199e-488c-914e-10e24d89330e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:29.303957 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11604e1-199e-488c-914e-10e24d89330e None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:29.325309 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 353/698] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:29.330243 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11604e1-199e-488c-914e-10e24d89330e None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:29.448715 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099750d-381b-4f05-b23c-72355f1a6a01 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:29.487974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11604e1-199e-488c-914e-10e24d89330e None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:29.498538 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd44ed-2778-4c34-9071-414a048629a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:29.500233 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd44ed-2778-4c34-9071-414a048629a6 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:29.500749 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd44ed-2778-4c34-9071-414a048629a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:29.501244 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd44ed-2778-4c34-9071-414a048629a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:29.511280 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd44ed-2778-4c34-9071-414a048629a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:29.512770 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd44ed-2778-4c34-9071-414a048629a6 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:29.526874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-5bcd44ed-2778-4c34-9071-414a048629a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:29.532316 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 346/699] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:29.532316 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e549de4-f152-4ff0-ab51-51eba93bb799 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:29.532316 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e549de4-f152-4ff0-ab51-51eba93bb799 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:29.532316 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e549de4-f152-4ff0-ab51-51eba93bb799 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:29.532316 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 347/700] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:29.533185 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550767e-6d87-4677-bcf2-a6137583c291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:29.534148 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550767e-6d87-4677-bcf2-a6137583c291 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:29.534148 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550767e-6d87-4677-bcf2-a6137583c291 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:29.534492 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550767e-6d87-4677-bcf2-a6137583c291 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:29.535709 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e549de4-f152-4ff0-ab51-51eba93bb799 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:29.543092 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550767e-6d87-4677-bcf2-a6137583c291 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:29.544570 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550767e-6d87-4677-bcf2-a6137583c291 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:29.559448 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-e550767e-6d87-4677-bcf2-a6137583c291 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:29.565189 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 354/701] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:29.566475 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329226ce-fbef-4c30-ae40-b870740099c3 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:29.566758 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329226ce-fbef-4c30-ae40-b870740099c3 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:29.567034 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329226ce-fbef-4c30-ae40-b870740099c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:29.587016 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-329226ce-fbef-4c30-ae40-b870740099c3 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:29.588087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-329226ce-fbef-4c30-ae40-b870740099c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:29.663537 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e549de4-f152-4ff0-ab51-51eba93bb799 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:29.675640 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 355/702] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:29.677097 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329226ce-fbef-4c30-ae40-b870740099c3 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:29.699528 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f13a6-c04d-4860-b0c6-ffc23bfd7d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:29.700197 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f13a6-c04d-4860-b0c6-ffc23bfd7d21 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:29.700454 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f13a6-c04d-4860-b0c6-ffc23bfd7d21 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:29.700866 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f13a6-c04d-4860-b0c6-ffc23bfd7d21 None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:29.701741 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f13a6-c04d-4860-b0c6-ffc23bfd7d21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:29.702083 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f13a6-c04d-4860-b0c6-ffc23bfd7d21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:29.703642 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f13a6-c04d-4860-b0c6-ffc23bfd7d21 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:29.716897 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 348/703] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:29.721752 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f13a6-c04d-4860-b0c6-ffc23bfd7d21 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:29.804407 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329226ce-fbef-4c30-ae40-b870740099c3 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:29.838779 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f13a6-c04d-4860-b0c6-ffc23bfd7d21 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:29.839091 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ef6e8-3d62-413b-b05b-9a1c0f5102ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:29.839760 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef6e8-3d62-413b-b05b-9a1c0f5102ac None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:29.840040 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef6e8-3d62-413b-b05b-9a1c0f5102ac None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:29.840312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef6e8-3d62-413b-b05b-9a1c0f5102ac None admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:29.841304 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ef6e8-3d62-413b-b05b-9a1c0f5102ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:29.841678 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ef6e8-3d62-413b-b05b-9a1c0f5102ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:29.843292 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ef6e8-3d62-413b-b05b-9a1c0f5102ac None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:29.860320 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 356/704] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:29.861265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ef6e8-3d62-413b-b05b-9a1c0f5102ac None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:29.885825 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abab721-ca0d-463c-b039-f04810ecf613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:29.887192 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abab721-ca0d-463c-b039-f04810ecf613 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:29.888020 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abab721-ca0d-463c-b039-f04810ecf613 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:29.888783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abab721-ca0d-463c-b039-f04810ecf613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:29.904631 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abab721-ca0d-463c-b039-f04810ecf613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:29.907067 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abab721-ca0d-463c-b039-f04810ecf613 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:29.929747 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-5abab721-ca0d-463c-b039-f04810ecf613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:29.932027 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 349/705] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:29.934072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abab721-ca0d-463c-b039-f04810ecf613 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:29.977515 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ef6e8-3d62-413b-b05b-9a1c0f5102ac None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:30.021837 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d61c6a-2ee4-439c-9865-bc34b905f874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:30.022496 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d61c6a-2ee4-439c-9865-bc34b905f874 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:30.023078 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d61c6a-2ee4-439c-9865-bc34b905f874 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:30.023352 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d61c6a-2ee4-439c-9865-bc34b905f874 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:30.024518 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d61c6a-2ee4-439c-9865-bc34b905f874 None admin] RBAC: Adding query filter params (role.id=f9ec85924a914e078096b38cae4e6caa, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=72d4ac44d04943a5b24c7a1d6a31b7f2) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:30.024858 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d61c6a-2ee4-439c-9865-bc34b905f874 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:30.026824 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d61c6a-2ee4-439c-9865-bc34b905f874 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:30.036751 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 357/706] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:00:29 2022] GET /identity/v3/role_assignments?user.id=72d4ac44d04943a5b24c7a1d6a31b7f2&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=f9ec85924a914e078096b38cae4e6caa => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:30.037646 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d61c6a-2ee4-439c-9865-bc34b905f874 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:30.063874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abab721-ca0d-463c-b039-f04810ecf613 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:30.101837 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e556d7-6170-42b9-a3ea-b963eb1e8899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:30.102963 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e556d7-6170-42b9-a3ea-b963eb1e8899 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:30.103250 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e556d7-6170-42b9-a3ea-b963eb1e8899 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:30.103631 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e556d7-6170-42b9-a3ea-b963eb1e8899 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:30.104506 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e556d7-6170-42b9-a3ea-b963eb1e8899 None admin] RBAC: Adding query filter params (role.id=fe0e7f0760f74b09b441426d672df700, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=f375d86747d248fa95f487b073d92d83) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:30.104875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e556d7-6170-42b9-a3ea-b963eb1e8899 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:30.106396 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e556d7-6170-42b9-a3ea-b963eb1e8899 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:30.113265 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 350/707] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:00:29 2022] GET /identity/v3/role_assignments?user.id=f375d86747d248fa95f487b073d92d83&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=fe0e7f0760f74b09b441426d672df700 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:30.114630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc4f19-96c7-4422-9a03-e4c2254a51a2 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:30.114918 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc4f19-96c7-4422-9a03-e4c2254a51a2 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:30.115201 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc4f19-96c7-4422-9a03-e4c2254a51a2 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:30.125473 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 351/708] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:30 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:30.131044 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a306d5-7efc-401a-b1cf-6371c1041c58 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:30.131343 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a306d5-7efc-401a-b1cf-6371c1041c58 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:30.131621 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a306d5-7efc-401a-b1cf-6371c1041c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:30.169889 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-83a306d5-7efc-401a-b1cf-6371c1041c58 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:30.171136 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-83a306d5-7efc-401a-b1cf-6371c1041c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:30.178670 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d61c6a-2ee4-439c-9865-bc34b905f874 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:30.221524 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f390f4-1540-4ebd-83ca-cde451b1c6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:30.222207 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f390f4-1540-4ebd-83ca-cde451b1c6b8 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:30.222669 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f390f4-1540-4ebd-83ca-cde451b1c6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:30.222959 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f390f4-1540-4ebd-83ca-cde451b1c6b8 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:30.223791 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f390f4-1540-4ebd-83ca-cde451b1c6b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:30.224096 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f390f4-1540-4ebd-83ca-cde451b1c6b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:30.225650 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f390f4-1540-4ebd-83ca-cde451b1c6b8 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:30.241156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 358/709] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:30.247379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f390f4-1540-4ebd-83ca-cde451b1c6b8 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:30.311547 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 352/710] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:00:30.355931 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a306d5-7efc-401a-b1cf-6371c1041c58 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:30.374347 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f390f4-1540-4ebd-83ca-cde451b1c6b8 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:30.422869 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb1e46-6183-4da4-8c80-e58860118f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:30.423919 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb1e46-6183-4da4-8c80-e58860118f82 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:30.424509 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb1e46-6183-4da4-8c80-e58860118f82 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:30.424613 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb1e46-6183-4da4-8c80-e58860118f82 None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:30.425825 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb1e46-6183-4da4-8c80-e58860118f82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:30.426956 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb1e46-6183-4da4-8c80-e58860118f82 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:30.475918 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a306d5-7efc-401a-b1cf-6371c1041c58 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:30.512045 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec8901-0215-48d1-8089-1ebff5b2c612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:30.512899 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec8901-0215-48d1-8089-1ebff5b2c612 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:30.513189 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec8901-0215-48d1-8089-1ebff5b2c612 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:30.513482 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec8901-0215-48d1-8089-1ebff5b2c612 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:30.514118 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec8901-0215-48d1-8089-1ebff5b2c612 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:30.515522 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec8901-0215-48d1-8089-1ebff5b2c612 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:30.525127 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 359/711] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 13:00:30 2022] POST /identity/v3/users => generated 254 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:00:30.528142 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d46e04-d2eb-4d65-b19a-fb85b0a96884 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:30.528142 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d46e04-d2eb-4d65-b19a-fb85b0a96884 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:30.528142 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d46e04-d2eb-4d65-b19a-fb85b0a96884 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:30.532291 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-c4ec8901-0215-48d1-8089-1ebff5b2c612 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 08 13:00:30.532291 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 353/712] 10.222.0.52 () {56 vars in 1129 bytes} [Tue Mar 8 13:00:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:30.534297 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 360/713] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:30.536981 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec8901-0215-48d1-8089-1ebff5b2c612 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:30.539667 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09ca42-639d-475b-ae25-b33875ba33aa None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:30.540225 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09ca42-639d-475b-ae25-b33875ba33aa None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:30.540997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09ca42-639d-475b-ae25-b33875ba33aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:30.584031 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-bf09ca42-639d-475b-ae25-b33875ba33aa None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:30.588308 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-bf09ca42-639d-475b-ae25-b33875ba33aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:30.701507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec8901-0215-48d1-8089-1ebff5b2c612 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:30.741720 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d20fb-a93a-4fdf-8963-4b20f6d47026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:30.743176 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d20fb-a93a-4fdf-8963-4b20f6d47026 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:30.744148 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d20fb-a93a-4fdf-8963-4b20f6d47026 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:30.744432 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d20fb-a93a-4fdf-8963-4b20f6d47026 None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:30.745194 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d20fb-a93a-4fdf-8963-4b20f6d47026 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:30.745506 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d20fb-a93a-4fdf-8963-4b20f6d47026 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:30.746938 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d20fb-a93a-4fdf-8963-4b20f6d47026 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:30.753421 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 361/714] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:00:30.758558 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 354/715] 10.222.0.52 () {56 vars in 1124 bytes} [Tue Mar 8 13:00:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:30.766093 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09ca42-639d-475b-ae25-b33875ba33aa None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:30.784849 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d20fb-a93a-4fdf-8963-4b20f6d47026 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:30.874655 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09ca42-639d-475b-ae25-b33875ba33aa None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:30.885691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d20fb-a93a-4fdf-8963-4b20f6d47026 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:30.909766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88368b-006d-40fa-b3d7-e073e937cba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:30.910665 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88368b-006d-40fa-b3d7-e073e937cba5 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:30.911024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88368b-006d-40fa-b3d7-e073e937cba5 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:30.911418 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88368b-006d-40fa-b3d7-e073e937cba5 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:30.912152 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88368b-006d-40fa-b3d7-e073e937cba5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:30.912554 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88368b-006d-40fa-b3d7-e073e937cba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:30.914138 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88368b-006d-40fa-b3d7-e073e937cba5 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:30.920741 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 362/716] 10.222.0.52 () {56 vars in 1124 bytes} [Tue Mar 8 13:00:30 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:30.930812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6570a25-d986-4918-a2ec-49425e726e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:30.931638 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6570a25-d986-4918-a2ec-49425e726e34 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:30.931916 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6570a25-d986-4918-a2ec-49425e726e34 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:30.932191 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6570a25-d986-4918-a2ec-49425e726e34 None admin] PATH_INFO: `/v3/services/network` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:30.932909 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6570a25-d986-4918-a2ec-49425e726e34 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:30.934413 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6570a25-d986-4918-a2ec-49425e726e34 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:30.946622 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-f6570a25-d986-4918-a2ec-49425e726e34 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 08 13:00:30.949629 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 355/717] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:30 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:30.955812 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88368b-006d-40fa-b3d7-e073e937cba5 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:31.075691 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88368b-006d-40fa-b3d7-e073e937cba5 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:31.116590 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927f5d7-ea19-4309-92db-d02a86d434e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:31.117649 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927f5d7-ea19-4309-92db-d02a86d434e3 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:31.118739 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927f5d7-ea19-4309-92db-d02a86d434e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:31.119162 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927f5d7-ea19-4309-92db-d02a86d434e3 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:31.120029 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927f5d7-ea19-4309-92db-d02a86d434e3 None admin] RBAC: Adding query filter params (name=network) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:31.122310 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927f5d7-ea19-4309-92db-d02a86d434e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:31.123864 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927f5d7-ea19-4309-92db-d02a86d434e3 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:31.131987 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 363/718] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 13:00:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:31.140068 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6570a25-d986-4918-a2ec-49425e726e34 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:31.276482 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6570a25-d986-4918-a2ec-49425e726e34 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:31.330349 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4084743-0658-4590-88c4-81492528765e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:31.331034 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4084743-0658-4590-88c4-81492528765e None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:31.331319 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4084743-0658-4590-88c4-81492528765e None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:31.331596 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4084743-0658-4590-88c4-81492528765e None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:31.332319 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4084743-0658-4590-88c4-81492528765e None admin] RBAC: Adding query filter params (type=network) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:31.332627 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4084743-0658-4590-88c4-81492528765e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:31.334047 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4084743-0658-4590-88c4-81492528765e None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:31.341346 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 356/719] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 13:00:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:32.658389 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf21ce-e831-43c5-8db8-6673f0319009 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:32.659372 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf21ce-e831-43c5-8db8-6673f0319009 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:32.659890 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf21ce-e831-43c5-8db8-6673f0319009 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:32.661933 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 364/720] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:32.668769 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eae1d-8120-4bd9-844e-73fbf87df579 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:32.669682 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eae1d-8120-4bd9-844e-73fbf87df579 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:32.670172 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eae1d-8120-4bd9-844e-73fbf87df579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:32.693669 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-af9eae1d-8120-4bd9-844e-73fbf87df579 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:32.695180 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-af9eae1d-8120-4bd9-844e-73fbf87df579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:32.782793 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 357/721] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:32.833424 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf21ce-e831-43c5-8db8-6673f0319009 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:32.974756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf21ce-e831-43c5-8db8-6673f0319009 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:33.019160 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6584be4-58cf-4911-827d-e1f927ae7d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:33.019958 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6584be4-58cf-4911-827d-e1f927ae7d19 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:33.020235 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6584be4-58cf-4911-827d-e1f927ae7d19 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:33.020507 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6584be4-58cf-4911-827d-e1f927ae7d19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:33.034685 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6584be4-58cf-4911-827d-e1f927ae7d19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:33.041779 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-d6584be4-58cf-4911-827d-e1f927ae7d19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:00:33.043354 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 365/722] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:00:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:33.049017 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9eae1d-8120-4bd9-844e-73fbf87df579 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:33.084305 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687ae5e-29f3-42b9-a636-425a88d13175 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:33.084984 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687ae5e-29f3-42b9-a636-425a88d13175 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:33.085484 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687ae5e-29f3-42b9-a636-425a88d13175 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:33.088927 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 366/723] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:33.095415 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a8230-8921-40dc-b87c-9b6017262333 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:33.096182 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a8230-8921-40dc-b87c-9b6017262333 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:33.096874 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a8230-8921-40dc-b87c-9b6017262333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:33.129494 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-6e4a8230-8921-40dc-b87c-9b6017262333 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:33.131976 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-6e4a8230-8921-40dc-b87c-9b6017262333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:33.261690 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9eae1d-8120-4bd9-844e-73fbf87df579 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:33.275977 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 367/724] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:33.322766 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb527a66-2e49-4ace-8838-888f3b3595be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:33.323835 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb527a66-2e49-4ace-8838-888f3b3595be None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:33.324322 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb527a66-2e49-4ace-8838-888f3b3595be None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:33.324823 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb527a66-2e49-4ace-8838-888f3b3595be None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:33.325777 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb527a66-2e49-4ace-8838-888f3b3595be None admin] RBAC: Adding query filter params (name=admin) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:33.326306 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb527a66-2e49-4ace-8838-888f3b3595be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:33.327906 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb527a66-2e49-4ace-8838-888f3b3595be None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:33.332594 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a8230-8921-40dc-b87c-9b6017262333 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:33.353240 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 358/725] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:00:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:33.361249 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb527a66-2e49-4ace-8838-888f3b3595be None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:33.511477 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb527a66-2e49-4ace-8838-888f3b3595be None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:33.549219 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a8230-8921-40dc-b87c-9b6017262333 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:33.583940 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb324448-3509-4d15-b8eb-8125dd3ce0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:33.585136 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb324448-3509-4d15-b8eb-8125dd3ce0c7 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:33.585627 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb324448-3509-4d15-b8eb-8125dd3ce0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:33.587948 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb324448-3509-4d15-b8eb-8125dd3ce0c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:33.615165 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb324448-3509-4d15-b8eb-8125dd3ce0c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:33.618679 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb324448-3509-4d15-b8eb-8125dd3ce0c7 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:33.623126 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c487c0a-144a-432c-bc36-4afe335f572e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:33.629446 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c487c0a-144a-432c-bc36-4afe335f572e None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:33.630444 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c487c0a-144a-432c-bc36-4afe335f572e None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:33.630931 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c487c0a-144a-432c-bc36-4afe335f572e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:33.642406 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c487c0a-144a-432c-bc36-4afe335f572e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:33.650985 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-7c487c0a-144a-432c-bc36-4afe335f572e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:00:33.653008 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 368/726] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:00:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:33.658924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c487c0a-144a-432c-bc36-4afe335f572e None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:33.659992 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-eb324448-3509-4d15-b8eb-8125dd3ce0c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:33.664105 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 359/727] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:33.671783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb324448-3509-4d15-b8eb-8125dd3ce0c7 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:33.828637 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c487c0a-144a-432c-bc36-4afe335f572e None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:33.829289 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb324448-3509-4d15-b8eb-8125dd3ce0c7 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:33.871893 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91f5f3-dacc-4707-8300-2a6b6e37b591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:33.872720 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd8d50-9597-460a-83c5-cd3b1ae40f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:33.873176 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91f5f3-dacc-4707-8300-2a6b6e37b591 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:33.873383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd8d50-9597-460a-83c5-cd3b1ae40f63 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:33.873663 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd8d50-9597-460a-83c5-cd3b1ae40f63 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:33.873936 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd8d50-9597-460a-83c5-cd3b1ae40f63 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:33.874285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91f5f3-dacc-4707-8300-2a6b6e37b591 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:33.874670 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd8d50-9597-460a-83c5-cd3b1ae40f63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:33.874974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd8d50-9597-460a-83c5-cd3b1ae40f63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:33.875086 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91f5f3-dacc-4707-8300-2a6b6e37b591 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:33.875997 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91f5f3-dacc-4707-8300-2a6b6e37b591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:33.876339 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd8d50-9597-460a-83c5-cd3b1ae40f63 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:33.876747 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91f5f3-dacc-4707-8300-2a6b6e37b591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:33.878817 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91f5f3-dacc-4707-8300-2a6b6e37b591 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:33.885136 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 369/728] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:00:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:33.886388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407ca95-ea8a-40aa-abf7-4fcb6bce9ae2 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:33.886673 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407ca95-ea8a-40aa-abf7-4fcb6bce9ae2 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:33.886948 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407ca95-ea8a-40aa-abf7-4fcb6bce9ae2 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:33.892451 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 370/729] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:33.893724 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5e53a-7e67-4e25-bbbb-3374cce0b6ec None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:33.894005 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5e53a-7e67-4e25-bbbb-3374cce0b6ec None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:33.894279 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5e53a-7e67-4e25-bbbb-3374cce0b6ec None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:33.898976 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 360/730] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:33.899134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 371/731] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:33.899134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ff4ac-2317-49d7-a9bd-621e30606ecf None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:33.899134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ff4ac-2317-49d7-a9bd-621e30606ecf None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:33.899134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ff4ac-2317-49d7-a9bd-621e30606ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:33.900187 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91f5f3-dacc-4707-8300-2a6b6e37b591 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:33.915051 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-f80ff4ac-2317-49d7-a9bd-621e30606ecf None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:33.916213 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f80ff4ac-2317-49d7-a9bd-621e30606ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:33.982078 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 372/732] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:33.982918 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ff4ac-2317-49d7-a9bd-621e30606ecf None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:34.021128 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91f5f3-dacc-4707-8300-2a6b6e37b591 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:34.057540 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b855d7c-a8aa-41d7-8b3c-0f4d620f1916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:34.058363 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b855d7c-a8aa-41d7-8b3c-0f4d620f1916 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:34.058642 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b855d7c-a8aa-41d7-8b3c-0f4d620f1916 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:34.058914 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b855d7c-a8aa-41d7-8b3c-0f4d620f1916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:34.069740 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b855d7c-a8aa-41d7-8b3c-0f4d620f1916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:34.071853 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b855d7c-a8aa-41d7-8b3c-0f4d620f1916 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:34.090045 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ff4ac-2317-49d7-a9bd-621e30606ecf None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:34.093615 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-6b855d7c-a8aa-41d7-8b3c-0f4d620f1916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:34.099328 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 361/733] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:34.099328 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3599ca-4de3-4e1e-94a8-a8ec5b9de0d1 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:34.099328 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3599ca-4de3-4e1e-94a8-a8ec5b9de0d1 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:34.099328 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3599ca-4de3-4e1e-94a8-a8ec5b9de0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:34.113689 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-5e3599ca-4de3-4e1e-94a8-a8ec5b9de0d1 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:34.114867 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-5e3599ca-4de3-4e1e-94a8-a8ec5b9de0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:34.126019 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c9ef3-fc4a-470c-9239-3f2d5836c4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:34.126814 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c9ef3-fc4a-470c-9239-3f2d5836c4e7 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:34.127094 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c9ef3-fc4a-470c-9239-3f2d5836c4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:34.127366 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c9ef3-fc4a-470c-9239-3f2d5836c4e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:34.135081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c9ef3-fc4a-470c-9239-3f2d5836c4e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:34.136513 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c9ef3-fc4a-470c-9239-3f2d5836c4e7 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:34.150272 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-9e3c9ef3-fc4a-470c-9239-3f2d5836c4e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 13:00:34.156458 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 373/734] 10.222.0.52 () {56 vars in 1093 bytes} [Tue Mar 8 13:00:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:34.156458 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c9ef3-fc4a-470c-9239-3f2d5836c4e7 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:34.189024 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 362/735] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:34.189883 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3599ca-4de3-4e1e-94a8-a8ec5b9de0d1 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:34.256668 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c9ef3-fc4a-470c-9239-3f2d5836c4e7 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:34.291828 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623fd292-7266-4719-ae28-efe6abb44d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:34.292486 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fd292-7266-4719-ae28-efe6abb44d78 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:34.292864 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fd292-7266-4719-ae28-efe6abb44d78 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:34.293143 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fd292-7266-4719-ae28-efe6abb44d78 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:34.293856 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623fd292-7266-4719-ae28-efe6abb44d78 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:34.295240 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623fd292-7266-4719-ae28-efe6abb44d78 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:34.300881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3599ca-4de3-4e1e-94a8-a8ec5b9de0d1 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:34.334028 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c4f2-5e2a-4114-8398-b029d02bd188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:34.334689 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c4f2-5e2a-4114-8398-b029d02bd188 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:34.334974 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c4f2-5e2a-4114-8398-b029d02bd188 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:34.335253 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c4f2-5e2a-4114-8398-b029d02bd188 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:34.336013 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2c4f2-5e2a-4114-8398-b029d02bd188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:34.336425 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2c4f2-5e2a-4114-8398-b029d02bd188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:34.337853 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2c4f2-5e2a-4114-8398-b029d02bd188 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:34.348785 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 363/736] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:34.349594 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c4f2-5e2a-4114-8398-b029d02bd188 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:34.404362 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 374/737] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 13:00:34 2022] POST /identity/v3/services => generated 251 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:00:34.404362 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623fd292-7266-4719-ae28-efe6abb44d78 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:34.453206 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c4f2-5e2a-4114-8398-b029d02bd188 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:34.496779 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1331fc6-130e-45a3-9c26-f88df4e18938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:34.497464 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1331fc6-130e-45a3-9c26-f88df4e18938 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:34.497748 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1331fc6-130e-45a3-9c26-f88df4e18938 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:34.498023 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1331fc6-130e-45a3-9c26-f88df4e18938 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:34.498871 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1331fc6-130e-45a3-9c26-f88df4e18938 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:34.499175 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1331fc6-130e-45a3-9c26-f88df4e18938 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:34.500636 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1331fc6-130e-45a3-9c26-f88df4e18938 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:34.517182 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623fd292-7266-4719-ae28-efe6abb44d78 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:34.520176 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 364/738] 10.222.0.52 () {56 vars in 1133 bytes} [Tue Mar 8 13:00:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:34.521106 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1331fc6-130e-45a3-9c26-f88df4e18938 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:34.558363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b250e-a643-4fc2-b539-a9f6dab471c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:34.559174 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b250e-a643-4fc2-b539-a9f6dab471c9 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:34.559451 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b250e-a643-4fc2-b539-a9f6dab471c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:34.559720 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b250e-a643-4fc2-b539-a9f6dab471c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:34.571366 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b250e-a643-4fc2-b539-a9f6dab471c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:34.578470 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-b91b250e-a643-4fc2-b539-a9f6dab471c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:00:34.579867 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 375/739] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:34.581137 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b5eb1-1d04-4dcf-b95e-c8480db18185 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:34.581420 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b5eb1-1d04-4dcf-b95e-c8480db18185 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:34.581694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b5eb1-1d04-4dcf-b95e-c8480db18185 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:34.583526 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 376/740] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:34.588803 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b5eb1-1d04-4dcf-b95e-c8480db18185 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:34.630283 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1331fc6-130e-45a3-9c26-f88df4e18938 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:34.663725 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7504410-c9dd-4067-be77-2d6d0f09ce06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:34.664595 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7504410-c9dd-4067-be77-2d6d0f09ce06 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:34.664973 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7504410-c9dd-4067-be77-2d6d0f09ce06 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:34.665254 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7504410-c9dd-4067-be77-2d6d0f09ce06 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:34.672377 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7504410-c9dd-4067-be77-2d6d0f09ce06 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:34.673859 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7504410-c9dd-4067-be77-2d6d0f09ce06 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:34.688695 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-a7504410-c9dd-4067-be77-2d6d0f09ce06 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 13:00:34.690041 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 365/741] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:00:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:34.690926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7504410-c9dd-4067-be77-2d6d0f09ce06 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:34.696597 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b5eb1-1d04-4dcf-b95e-c8480db18185 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:34.730322 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a6a99-6f4c-4a1c-a0e7-21017b98d422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:34.731170 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a6a99-6f4c-4a1c-a0e7-21017b98d422 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:34.731449 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a6a99-6f4c-4a1c-a0e7-21017b98d422 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:34.731716 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a6a99-6f4c-4a1c-a0e7-21017b98d422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:34.742419 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a6a99-6f4c-4a1c-a0e7-21017b98d422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:34.744206 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a6a99-6f4c-4a1c-a0e7-21017b98d422 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:34.761262 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-262a6a99-6f4c-4a1c-a0e7-21017b98d422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:34.766997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 377/742] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:34.767992 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f3c9a-313b-4f3e-ad80-3c7051e8a40e None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:34.768277 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f3c9a-313b-4f3e-ad80-3c7051e8a40e None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:34.768556 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f3c9a-313b-4f3e-ad80-3c7051e8a40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:34.787560 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-dd8f3c9a-313b-4f3e-ad80-3c7051e8a40e None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:34.788785 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-dd8f3c9a-313b-4f3e-ad80-3c7051e8a40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:34.795450 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7504410-c9dd-4067-be77-2d6d0f09ce06 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:34.831182 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afc4b1-42c7-4426-88a6-2628a5c58edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:34.831848 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afc4b1-42c7-4426-88a6-2628a5c58edd None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:34.832348 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afc4b1-42c7-4426-88a6-2628a5c58edd None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:34.832453 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afc4b1-42c7-4426-88a6-2628a5c58edd None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:34.833168 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8afc4b1-42c7-4426-88a6-2628a5c58edd None admin] RBAC: Adding query filter params (name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:34.833665 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8afc4b1-42c7-4426-88a6-2628a5c58edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:34.834846 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8afc4b1-42c7-4426-88a6-2628a5c58edd None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:34.847113 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 366/743] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:00:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:34.847113 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afc4b1-42c7-4426-88a6-2628a5c58edd None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:34.864832 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 378/744] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:00:34.864832 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f3c9a-313b-4f3e-ad80-3c7051e8a40e None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:34.944263 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afc4b1-42c7-4426-88a6-2628a5c58edd None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:34.959855 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f3c9a-313b-4f3e-ad80-3c7051e8a40e None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:34.976042 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de069b95-ec67-47e8-bd34-ef2e68bc63a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:34.977293 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de069b95-ec67-47e8-bd34-ef2e68bc63a6 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:34.977572 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de069b95-ec67-47e8-bd34-ef2e68bc63a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:34.977838 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de069b95-ec67-47e8-bd34-ef2e68bc63a6 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:34.978661 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de069b95-ec67-47e8-bd34-ef2e68bc63a6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:34.978972 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de069b95-ec67-47e8-bd34-ef2e68bc63a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:34.980408 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de069b95-ec67-47e8-bd34-ef2e68bc63a6 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:34.992579 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e48ecf-e291-44c9-955e-13496ca6bfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:34.993269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e48ecf-e291-44c9-955e-13496ca6bfad None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:34.993550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e48ecf-e291-44c9-955e-13496ca6bfad None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:34.993823 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e48ecf-e291-44c9-955e-13496ca6bfad None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:34.994544 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e48ecf-e291-44c9-955e-13496ca6bfad None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:34.994847 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e48ecf-e291-44c9-955e-13496ca6bfad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:34.996249 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e48ecf-e291-44c9-955e-13496ca6bfad None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:35.002127 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 367/745] 10.222.0.52 () {56 vars in 1135 bytes} [Tue Mar 8 13:00:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:35.002127 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de069b95-ec67-47e8-bd34-ef2e68bc63a6 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:35.016552 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 379/746] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:35.016552 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e48ecf-e291-44c9-955e-13496ca6bfad None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:35.093788 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de069b95-ec67-47e8-bd34-ef2e68bc63a6 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:35.113167 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e48ecf-e291-44c9-955e-13496ca6bfad None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:35.126555 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d201d-278c-483f-a065-682249bbecb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:35.127345 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d201d-278c-483f-a065-682249bbecb1 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:35.127628 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d201d-278c-483f-a065-682249bbecb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:35.127904 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d201d-278c-483f-a065-682249bbecb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:35.137978 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d201d-278c-483f-a065-682249bbecb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:35.139430 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d201d-278c-483f-a065-682249bbecb1 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:35.144918 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f36f4b-f7e4-4a93-9521-c256d90c4e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:35.145583 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f36f4b-f7e4-4a93-9521-c256d90c4e54 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:35.145866 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f36f4b-f7e4-4a93-9521-c256d90c4e54 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:35.146142 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f36f4b-f7e4-4a93-9521-c256d90c4e54 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:35.146885 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f36f4b-f7e4-4a93-9521-c256d90c4e54 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:35.148786 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f36f4b-f7e4-4a93-9521-c256d90c4e54 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:35.157170 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-d75d201d-278c-483f-a065-682249bbecb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:35.158348 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 368/747] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:35.159152 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d201d-278c-483f-a065-682249bbecb1 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:35.229797 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 380/748] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 13:00:35 2022] POST /identity/v3/services => generated 240 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:00:35.229797 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f36f4b-f7e4-4a93-9521-c256d90c4e54 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:35.261848 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d201d-278c-483f-a065-682249bbecb1 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:35.306525 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a537f-e43e-4c53-a5ac-a669299263c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:35.307196 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a537f-e43e-4c53-a5ac-a669299263c7 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:35.307468 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a537f-e43e-4c53-a5ac-a669299263c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:35.307744 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a537f-e43e-4c53-a5ac-a669299263c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:35.339243 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f36f4b-f7e4-4a93-9521-c256d90c4e54 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:35.375160 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5326fed-666c-472f-8297-9e2fe9e37e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:35.375973 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5326fed-666c-472f-8297-9e2fe9e37e24 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:35.376257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5326fed-666c-472f-8297-9e2fe9e37e24 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:35.376537 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5326fed-666c-472f-8297-9e2fe9e37e24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:35.379749 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a537f-e43e-4c53-a5ac-a669299263c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:35.381278 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a537f-e43e-4c53-a5ac-a669299263c7 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:35.384511 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5326fed-666c-472f-8297-9e2fe9e37e24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:35.386119 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5326fed-666c-472f-8297-9e2fe9e37e24 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:35.401865 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-c5326fed-666c-472f-8297-9e2fe9e37e24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:35.407919 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 381/749] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:35.409063 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5326fed-666c-472f-8297-9e2fe9e37e24 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:35.486426 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 369/750] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:00:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:00:35.487562 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a537f-e43e-4c53-a5ac-a669299263c7 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:35.530403 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5326fed-666c-472f-8297-9e2fe9e37e24 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:35.567624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a49dd-12db-409f-b6df-5677c38dc2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:35.568679 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a49dd-12db-409f-b6df-5677c38dc2c4 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:35.569179 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a49dd-12db-409f-b6df-5677c38dc2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:35.569684 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a49dd-12db-409f-b6df-5677c38dc2c4 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:35.571465 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a49dd-12db-409f-b6df-5677c38dc2c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:35.572027 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a49dd-12db-409f-b6df-5677c38dc2c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:35.573836 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a49dd-12db-409f-b6df-5677c38dc2c4 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:35.587510 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 382/751] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:35.588438 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a537f-e43e-4c53-a5ac-a669299263c7 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:35.588951 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a49dd-12db-409f-b6df-5677c38dc2c4 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:35.625681 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63763cb-571d-4c34-8b18-20c13698c70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:35.626342 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63763cb-571d-4c34-8b18-20c13698c70f None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:35.626775 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63763cb-571d-4c34-8b18-20c13698c70f None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:35.627061 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63763cb-571d-4c34-8b18-20c13698c70f None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:35.628173 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63763cb-571d-4c34-8b18-20c13698c70f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:35.628492 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63763cb-571d-4c34-8b18-20c13698c70f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:35.630397 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63763cb-571d-4c34-8b18-20c13698c70f None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:35.649806 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 370/752] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:35.649806 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63763cb-571d-4c34-8b18-20c13698c70f None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:35.712108 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a49dd-12db-409f-b6df-5677c38dc2c4 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:35.747262 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443315e2-be55-4a16-8024-78f4a7d807df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:35.748427 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443315e2-be55-4a16-8024-78f4a7d807df None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:35.748943 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443315e2-be55-4a16-8024-78f4a7d807df None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:35.749445 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443315e2-be55-4a16-8024-78f4a7d807df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:35.749779 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63763cb-571d-4c34-8b18-20c13698c70f None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:35.761653 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443315e2-be55-4a16-8024-78f4a7d807df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:35.763373 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443315e2-be55-4a16-8024-78f4a7d807df None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:35.781792 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-443315e2-be55-4a16-8024-78f4a7d807df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:35.783715 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 383/753] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:35.784492 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da811b5f-82a8-45f2-8e53-40031f98dcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:35.785090 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443315e2-be55-4a16-8024-78f4a7d807df None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:35.785346 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da811b5f-82a8-45f2-8e53-40031f98dcc5 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:35.785630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da811b5f-82a8-45f2-8e53-40031f98dcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:35.785905 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da811b5f-82a8-45f2-8e53-40031f98dcc5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:35.793696 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da811b5f-82a8-45f2-8e53-40031f98dcc5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:35.795145 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da811b5f-82a8-45f2-8e53-40031f98dcc5 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:35.809691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-da811b5f-82a8-45f2-8e53-40031f98dcc5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 13:00:35.810404 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 371/754] 10.222.0.52 () {56 vars in 1117 bytes} [Tue Mar 8 13:00:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:35.811196 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da811b5f-82a8-45f2-8e53-40031f98dcc5 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:35.900299 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443315e2-be55-4a16-8024-78f4a7d807df None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:35.909949 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da811b5f-82a8-45f2-8e53-40031f98dcc5 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:35.936332 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba2a74-58ed-49d3-ba5b-cd7fafb5d6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:35.937598 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba2a74-58ed-49d3-ba5b-cd7fafb5d6e5 None admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:35.938112 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba2a74-58ed-49d3-ba5b-cd7fafb5d6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:35.938593 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba2a74-58ed-49d3-ba5b-cd7fafb5d6e5 None admin] PATH_INFO: `/v3/projects/2b478af53391486eb72c85c786ed4abb/users/72d4ac44d04943a5b24c7a1d6a31b7f2/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:35.940917 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba2a74-58ed-49d3-ba5b-cd7fafb5d6e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b478af53391486eb72c85c786ed4abb, user_id=72d4ac44d04943a5b24c7a1d6a31b7f2, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:35.942828 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba2a74-58ed-49d3-ba5b-cd7fafb5d6e5 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:35.944771 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391172e-b969-4ed9-bc74-cd47ea816025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:35.945572 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391172e-b969-4ed9-bc74-cd47ea816025 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:35.946028 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391172e-b969-4ed9-bc74-cd47ea816025 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:35.946276 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391172e-b969-4ed9-bc74-cd47ea816025 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:35.946999 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391172e-b969-4ed9-bc74-cd47ea816025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:35.947302 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391172e-b969-4ed9-bc74-cd47ea816025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:35.948701 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391172e-b969-4ed9-bc74-cd47ea816025 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:35.964349 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 372/755] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:35.964349 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391172e-b969-4ed9-bc74-cd47ea816025 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:36.017319 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 384/756] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 13:00:35 2022] PUT /identity/v3/projects/2b478af53391486eb72c85c786ed4abb/users/72d4ac44d04943a5b24c7a1d6a31b7f2/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:00:36.026115 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba2a74-58ed-49d3-ba5b-cd7fafb5d6e5 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:36.078586 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391172e-b969-4ed9-bc74-cd47ea816025 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:36.119613 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c20b90-e7f9-4eb0-8b9f-701d7c6607fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:36.120294 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c20b90-e7f9-4eb0-8b9f-701d7c6607fb None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:36.120573 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c20b90-e7f9-4eb0-8b9f-701d7c6607fb None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:36.120871 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c20b90-e7f9-4eb0-8b9f-701d7c6607fb None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:36.121875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c20b90-e7f9-4eb0-8b9f-701d7c6607fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:36.122201 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c20b90-e7f9-4eb0-8b9f-701d7c6607fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:36.125684 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c20b90-e7f9-4eb0-8b9f-701d7c6607fb None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:36.145568 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 373/757] 10.222.0.52 () {56 vars in 1149 bytes} [Tue Mar 8 13:00:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:36.151926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c20b90-e7f9-4eb0-8b9f-701d7c6607fb None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:36.241211 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba2a74-58ed-49d3-ba5b-cd7fafb5d6e5 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:36.266004 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c20b90-e7f9-4eb0-8b9f-701d7c6607fb None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:36.283737 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb5403-1f67-466c-93c4-50f77711165d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:36.284510 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb5403-1f67-466c-93c4-50f77711165d None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:36.284821 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb5403-1f67-466c-93c4-50f77711165d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:36.285091 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb5403-1f67-466c-93c4-50f77711165d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:36.292162 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb5403-1f67-466c-93c4-50f77711165d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:36.295094 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb5403-1f67-466c-93c4-50f77711165d None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:36.302608 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8853e-c7c1-49d5-88ac-c18ce05c303f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:36.303258 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8853e-c7c1-49d5-88ac-c18ce05c303f None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:36.303537 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8853e-c7c1-49d5-88ac-c18ce05c303f None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:36.303811 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8853e-c7c1-49d5-88ac-c18ce05c303f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:36.310076 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-84cb5403-1f67-466c-93c4-50f77711165d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:36.311582 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 385/758] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:36.316734 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb5403-1f67-466c-93c4-50f77711165d None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:36.389429 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8853e-c7c1-49d5-88ac-c18ce05c303f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:36.391199 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8853e-c7c1-49d5-88ac-c18ce05c303f None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:36.449839 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb5403-1f67-466c-93c4-50f77711165d None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:36.494083 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df3c37-6440-4e35-9500-38998ade07e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:36.496363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df3c37-6440-4e35-9500-38998ade07e9 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:36.496363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df3c37-6440-4e35-9500-38998ade07e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:36.496363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df3c37-6440-4e35-9500-38998ade07e9 None admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:36.496363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df3c37-6440-4e35-9500-38998ade07e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:36.496694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df3c37-6440-4e35-9500-38998ade07e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:36.502064 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df3c37-6440-4e35-9500-38998ade07e9 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:36.513498 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 374/759] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:00:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:00:36.514753 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8853e-c7c1-49d5-88ac-c18ce05c303f None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:36.523908 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 386/760] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:36.530557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df3c37-6440-4e35-9500-38998ade07e9 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:36.653973 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df3c37-6440-4e35-9500-38998ade07e9 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:36.702558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6daf0c-00e5-4107-af36-6d3f7037f47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:36.703226 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6daf0c-00e5-4107-af36-6d3f7037f47a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:36.703543 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6daf0c-00e5-4107-af36-6d3f7037f47a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:36.703826 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6daf0c-00e5-4107-af36-6d3f7037f47a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:36.704681 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6daf0c-00e5-4107-af36-6d3f7037f47a None admin] RBAC: Adding query filter params (role.id=f9ec85924a914e078096b38cae4e6caa, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=f375d86747d248fa95f487b073d92d83) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:36.704990 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6daf0c-00e5-4107-af36-6d3f7037f47a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:36.706448 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6daf0c-00e5-4107-af36-6d3f7037f47a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:36.707161 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8853e-c7c1-49d5-88ac-c18ce05c303f None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:36.721228 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 387/761] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:00:36 2022] GET /identity/v3/role_assignments?user.id=f375d86747d248fa95f487b073d92d83&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=f9ec85924a914e078096b38cae4e6caa => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:36.742540 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256edf8-1ac4-4b6c-86dd-5058ae984bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:36.743400 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256edf8-1ac4-4b6c-86dd-5058ae984bf0 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:36.743677 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256edf8-1ac4-4b6c-86dd-5058ae984bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:36.743943 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256edf8-1ac4-4b6c-86dd-5058ae984bf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:36.755017 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256edf8-1ac4-4b6c-86dd-5058ae984bf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:36.756525 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256edf8-1ac4-4b6c-86dd-5058ae984bf0 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:36.774638 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-c256edf8-1ac4-4b6c-86dd-5058ae984bf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:36.776247 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 375/762] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:36.781923 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6daf0c-00e5-4107-af36-6d3f7037f47a None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:36.951651 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6daf0c-00e5-4107-af36-6d3f7037f47a None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:36.985789 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d99d3-f243-4cce-9751-e2a39b5f3a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:36.986455 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d99d3-f243-4cce-9751-e2a39b5f3a37 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:36.986735 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d99d3-f243-4cce-9751-e2a39b5f3a37 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:36.987012 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d99d3-f243-4cce-9751-e2a39b5f3a37 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:36.987790 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d99d3-f243-4cce-9751-e2a39b5f3a37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:36.988099 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d99d3-f243-4cce-9751-e2a39b5f3a37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:36.989544 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d99d3-f243-4cce-9751-e2a39b5f3a37 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:37.004774 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 388/763] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:37.009737 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256edf8-1ac4-4b6c-86dd-5058ae984bf0 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:37.018283 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbd1a9-05d2-45ad-840a-ccb687c23840 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:37.018569 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbd1a9-05d2-45ad-840a-ccb687c23840 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:37.018848 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbd1a9-05d2-45ad-840a-ccb687c23840 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:37.020625 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 389/764] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:37.026933 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed60cd9-dd49-4c1f-8232-57877c494c58 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:37.027217 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed60cd9-dd49-4c1f-8232-57877c494c58 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:37.027496 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed60cd9-dd49-4c1f-8232-57877c494c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:37.045364 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-2ed60cd9-dd49-4c1f-8232-57877c494c58 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:37.046909 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-2ed60cd9-dd49-4c1f-8232-57877c494c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:37.122637 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 390/765] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:00:37.153829 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed60cd9-dd49-4c1f-8232-57877c494c58 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:37.180346 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256edf8-1ac4-4b6c-86dd-5058ae984bf0 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:37.224234 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eb72c-9569-4325-b26c-af50a07e8abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:37.225046 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eb72c-9569-4325-b26c-af50a07e8abf None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:37.225335 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eb72c-9569-4325-b26c-af50a07e8abf None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:37.225613 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eb72c-9569-4325-b26c-af50a07e8abf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:37.235042 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384eb72c-9569-4325-b26c-af50a07e8abf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:37.236515 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384eb72c-9569-4325-b26c-af50a07e8abf None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:37.253657 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed60cd9-dd49-4c1f-8232-57877c494c58 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:37.264391 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-384eb72c-9569-4325-b26c-af50a07e8abf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:37.266026 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 376/766] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:37.271614 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eb72c-9569-4325-b26c-af50a07e8abf None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:37.316674 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd693a1-4f33-40a7-ae5c-5495e3d1b64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:37.317487 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd693a1-4f33-40a7-ae5c-5495e3d1b64a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:37.317766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd693a1-4f33-40a7-ae5c-5495e3d1b64a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:37.318037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd693a1-4f33-40a7-ae5c-5495e3d1b64a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:37.319848 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd693a1-4f33-40a7-ae5c-5495e3d1b64a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:37.323815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd693a1-4f33-40a7-ae5c-5495e3d1b64a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:37.352711 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-cfd693a1-4f33-40a7-ae5c-5495e3d1b64a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 08 13:00:37.358873 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 391/767] 10.222.0.52 () {56 vars in 1129 bytes} [Tue Mar 8 13:00:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:37.363929 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd693a1-4f33-40a7-ae5c-5495e3d1b64a None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:37.430543 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eb72c-9569-4325-b26c-af50a07e8abf None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:37.468027 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46043bf6-2b79-4e56-b587-f8a1b374810f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:37.468716 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46043bf6-2b79-4e56-b587-f8a1b374810f None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:37.469000 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46043bf6-2b79-4e56-b587-f8a1b374810f None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:37.469271 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46043bf6-2b79-4e56-b587-f8a1b374810f None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:37.470052 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46043bf6-2b79-4e56-b587-f8a1b374810f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:37.470359 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46043bf6-2b79-4e56-b587-f8a1b374810f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:37.471783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46043bf6-2b79-4e56-b587-f8a1b374810f None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:37.485171 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd693a1-4f33-40a7-ae5c-5495e3d1b64a None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:37.503209 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 377/768] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:37.509151 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46043bf6-2b79-4e56-b587-f8a1b374810f None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:37.525572 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f4d2b-b3ac-4e1c-bb8d-1f3e46d5fb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:37.526266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f4d2b-b3ac-4e1c-bb8d-1f3e46d5fb9d None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:37.536580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f4d2b-b3ac-4e1c-bb8d-1f3e46d5fb9d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:37.536580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f4d2b-b3ac-4e1c-bb8d-1f3e46d5fb9d None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:37.536580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f4d2b-b3ac-4e1c-bb8d-1f3e46d5fb9d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:37.536580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f4d2b-b3ac-4e1c-bb8d-1f3e46d5fb9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:37.536580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f4d2b-b3ac-4e1c-bb8d-1f3e46d5fb9d None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:37.539474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 392/769] 10.222.0.52 () {56 vars in 1124 bytes} [Tue Mar 8 13:00:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:37.546317 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f4d2b-b3ac-4e1c-bb8d-1f3e46d5fb9d None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:37.687735 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46043bf6-2b79-4e56-b587-f8a1b374810f None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:37.737973 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f4d2b-b3ac-4e1c-bb8d-1f3e46d5fb9d None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:37.749487 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04c2db-6bad-437a-ad70-abb7ad0c5442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:37.750144 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04c2db-6bad-437a-ad70-abb7ad0c5442 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:37.750422 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04c2db-6bad-437a-ad70-abb7ad0c5442 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:37.750694 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04c2db-6bad-437a-ad70-abb7ad0c5442 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:37.751519 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04c2db-6bad-437a-ad70-abb7ad0c5442 None admin] RBAC: Adding query filter params (role.id=fe0e7f0760f74b09b441426d672df700, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=556058de7b9f48b8a10188ec64496e72) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:37.751824 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04c2db-6bad-437a-ad70-abb7ad0c5442 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:37.753295 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04c2db-6bad-437a-ad70-abb7ad0c5442 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:37.765715 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 378/770] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:00:37 2022] GET /identity/v3/role_assignments?user.id=556058de7b9f48b8a10188ec64496e72&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=fe0e7f0760f74b09b441426d672df700 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:37.798725 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185776b-7204-4f35-95df-a5a3cb7694d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:37.799415 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185776b-7204-4f35-95df-a5a3cb7694d2 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:37.799695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185776b-7204-4f35-95df-a5a3cb7694d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:37.799968 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185776b-7204-4f35-95df-a5a3cb7694d2 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:37.800745 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185776b-7204-4f35-95df-a5a3cb7694d2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:37.801055 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185776b-7204-4f35-95df-a5a3cb7694d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:37.802474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185776b-7204-4f35-95df-a5a3cb7694d2 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:37.808959 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 393/771] 10.222.0.52 () {56 vars in 1124 bytes} [Tue Mar 8 13:00:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:37.814635 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04c2db-6bad-437a-ad70-abb7ad0c5442 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:37.921051 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04c2db-6bad-437a-ad70-abb7ad0c5442 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:37.957926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8143e-7069-4ee5-b8f3-d0f52ae0c0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:37.958595 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8143e-7069-4ee5-b8f3-d0f52ae0c0b4 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:37.958873 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8143e-7069-4ee5-b8f3-d0f52ae0c0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:37.959146 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8143e-7069-4ee5-b8f3-d0f52ae0c0b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:37.959938 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8143e-7069-4ee5-b8f3-d0f52ae0c0b4 None admin] RBAC: Adding query filter params (interface=public, service_id=be195991d7884b9795edb1b83f04f120, region_id=RegionOne) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:37.960246 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8143e-7069-4ee5-b8f3-d0f52ae0c0b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:37.962218 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8143e-7069-4ee5-b8f3-d0f52ae0c0b4 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:37.970264 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 379/772] 10.222.0.52 () {56 vars in 1251 bytes} [Tue Mar 8 13:00:37 2022] GET /identity/v3/endpoints?service_id=be195991d7884b9795edb1b83f04f120&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:37.975535 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185776b-7204-4f35-95df-a5a3cb7694d2 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:38.007208 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae75ed-5840-4faa-b83c-10324abc77b2 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:38.008025 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae75ed-5840-4faa-b83c-10324abc77b2 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:38.008274 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae75ed-5840-4faa-b83c-10324abc77b2 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:38.010064 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 380/773] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:00:38.015952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa5dae-3a64-443e-aa86-e7a4af091753 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:38.016239 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa5dae-3a64-443e-aa86-e7a4af091753 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:38.016518 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa5dae-3a64-443e-aa86-e7a4af091753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:38.047023 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-a2fa5dae-3a64-443e-aa86-e7a4af091753 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:38.048226 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-a2fa5dae-3a64-443e-aa86-e7a4af091753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:38.118094 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 381/774] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:00:38.158686 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185776b-7204-4f35-95df-a5a3cb7694d2 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:38.164950 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa5dae-3a64-443e-aa86-e7a4af091753 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:38.221894 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71fff4-e792-46f7-bf7d-c802342b7993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:38.222563 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71fff4-e792-46f7-bf7d-c802342b7993 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:38.222844 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71fff4-e792-46f7-bf7d-c802342b7993 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:38.223119 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71fff4-e792-46f7-bf7d-c802342b7993 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:38.223797 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71fff4-e792-46f7-bf7d-c802342b7993 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:38.225210 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71fff4-e792-46f7-bf7d-c802342b7993 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:38.237560 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 394/775] 10.222.0.52 () {56 vars in 1087 bytes} [Tue Mar 8 13:00:37 2022] GET /identity/v3/services => generated 772 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:38.278313 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa5dae-3a64-443e-aa86-e7a4af091753 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:38.328169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1a9a5-a1a4-4306-808d-5960468ec10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:38.329044 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1a9a5-a1a4-4306-808d-5960468ec10e None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:38.329314 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1a9a5-a1a4-4306-808d-5960468ec10e None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:38.329585 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1a9a5-a1a4-4306-808d-5960468ec10e None admin] PATH_INFO: `/v3/services/network` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:38.330263 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1a9a5-a1a4-4306-808d-5960468ec10e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:38.331717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1a9a5-a1a4-4306-808d-5960468ec10e None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:38.344269 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-93c1a9a5-a1a4-4306-808d-5960468ec10e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 08 13:00:38.345952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 382/776] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:38 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:38.354032 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71fff4-e792-46f7-bf7d-c802342b7993 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:38.490954 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71fff4-e792-46f7-bf7d-c802342b7993 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:38.539168 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9bfa1-4022-478e-b1fe-9efb7a4dbf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:38.539168 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9bfa1-4022-478e-b1fe-9efb7a4dbf67 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:38.539168 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9bfa1-4022-478e-b1fe-9efb7a4dbf67 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:38.539168 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9bfa1-4022-478e-b1fe-9efb7a4dbf67 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:38.539957 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9bfa1-4022-478e-b1fe-9efb7a4dbf67 None admin] RBAC: Adding query filter params (name=network) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:38.539957 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9bfa1-4022-478e-b1fe-9efb7a4dbf67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:38.539957 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9bfa1-4022-478e-b1fe-9efb7a4dbf67 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:38.542134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 395/777] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 13:00:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:38.547360 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1a9a5-a1a4-4306-808d-5960468ec10e None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:38.650464 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1a9a5-a1a4-4306-808d-5960468ec10e None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:38.684077 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e876c-edbc-4231-9bc4-091bfdf9f018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:38.684764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e876c-edbc-4231-9bc4-091bfdf9f018 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:38.685049 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e876c-edbc-4231-9bc4-091bfdf9f018 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:38.685318 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e876c-edbc-4231-9bc4-091bfdf9f018 None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:38.686018 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e876c-edbc-4231-9bc4-091bfdf9f018 None admin] RBAC: Adding query filter params (type=network) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:38.686359 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e876c-edbc-4231-9bc4-091bfdf9f018 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:38.687666 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e876c-edbc-4231-9bc4-091bfdf9f018 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:38.692810 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 383/778] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 13:00:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:38.701749 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9bfa1-4022-478e-b1fe-9efb7a4dbf67 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:38.818848 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9bfa1-4022-478e-b1fe-9efb7a4dbf67 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:38.862810 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41e02e-9fc2-450c-ad5d-7712997cf72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:38.863474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41e02e-9fc2-450c-ad5d-7712997cf72c None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:38.863750 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41e02e-9fc2-450c-ad5d-7712997cf72c None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:38.864022 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41e02e-9fc2-450c-ad5d-7712997cf72c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:38.864835 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41e02e-9fc2-450c-ad5d-7712997cf72c None admin] RBAC: Adding query filter params (interface=public, service_id=a88f6b58a47b474f8b7ddfefed01aa1b, region_id=RegionOne) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:38.865143 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41e02e-9fc2-450c-ad5d-7712997cf72c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:38.866509 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41e02e-9fc2-450c-ad5d-7712997cf72c None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:38.883359 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 396/779] 10.222.0.52 () {56 vars in 1251 bytes} [Tue Mar 8 13:00:38 2022] GET /identity/v3/endpoints?service_id=a88f6b58a47b474f8b7ddfefed01aa1b&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:38.883660 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4619a7e-e9de-44f8-ad83-4c7b838ce1a2 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:38.883660 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4619a7e-e9de-44f8-ad83-4c7b838ce1a2 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:38.883660 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4619a7e-e9de-44f8-ad83-4c7b838ce1a2 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:38.883660 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 384/780] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:00:38.888472 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41e02e-9fc2-450c-ad5d-7712997cf72c None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:38.890009 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce88523-ae40-48e6-a951-aa922466f087 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:38.890293 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce88523-ae40-48e6-a951-aa922466f087 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:38.890575 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce88523-ae40-48e6-a951-aa922466f087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:38.916563 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-cce88523-ae40-48e6-a951-aa922466f087 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:38.919874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-cce88523-ae40-48e6-a951-aa922466f087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:39.051165 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 385/781] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:00:39.064952 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41e02e-9fc2-450c-ad5d-7712997cf72c None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:39.077243 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce88523-ae40-48e6-a951-aa922466f087 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:39.128317 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba820e-9b1b-4cef-9abb-df774711e1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:39.129375 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba820e-9b1b-4cef-9abb-df774711e1ec None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:39.129909 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba820e-9b1b-4cef-9abb-df774711e1ec None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:39.130385 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba820e-9b1b-4cef-9abb-df774711e1ec None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:39.131311 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba820e-9b1b-4cef-9abb-df774711e1ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:39.133253 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba820e-9b1b-4cef-9abb-df774711e1ec None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:39.144569 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 397/782] 10.222.0.52 () {56 vars in 1087 bytes} [Tue Mar 8 13:00:38 2022] GET /identity/v3/services => generated 772 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:39.214925 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce88523-ae40-48e6-a951-aa922466f087 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:39.252441 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7319030-a1ed-4b2f-9ecb-b6427ed861be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:39.253690 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7319030-a1ed-4b2f-9ecb-b6427ed861be None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:39.254176 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7319030-a1ed-4b2f-9ecb-b6427ed861be None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:39.254670 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7319030-a1ed-4b2f-9ecb-b6427ed861be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:39.266992 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7319030-a1ed-4b2f-9ecb-b6427ed861be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:39.275067 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-c7319030-a1ed-4b2f-9ecb-b6427ed861be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:00:39.277297 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 386/783] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:00:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:39.283731 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba820e-9b1b-4cef-9abb-df774711e1ec None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:39.422985 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba820e-9b1b-4cef-9abb-df774711e1ec None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:39.459612 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a9191-1320-4c19-bf7d-096a13ebeb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:39.460285 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a9191-1320-4c19-bf7d-096a13ebeb66 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:39.460758 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a9191-1320-4c19-bf7d-096a13ebeb66 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:39.461270 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a9191-1320-4c19-bf7d-096a13ebeb66 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:39.462055 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a9191-1320-4c19-bf7d-096a13ebeb66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:39.462368 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a9191-1320-4c19-bf7d-096a13ebeb66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:39.463756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a9191-1320-4c19-bf7d-096a13ebeb66 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:39.472555 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 398/784] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:00:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:39.479079 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7319030-a1ed-4b2f-9ecb-b6427ed861be None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:39.604615 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7319030-a1ed-4b2f-9ecb-b6427ed861be None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:39.620289 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504bc19-cb45-4d73-924f-98510d27f645 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:39.625156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504bc19-cb45-4d73-924f-98510d27f645 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:39.625482 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504bc19-cb45-4d73-924f-98510d27f645 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:39.627446 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 399/785] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:39.634760 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38404a69-80ad-4da3-82fb-f14be48d12e2 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:39.635206 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38404a69-80ad-4da3-82fb-f14be48d12e2 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:39.635538 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38404a69-80ad-4da3-82fb-f14be48d12e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:39.639464 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca8184-4655-4fb5-8a45-9137f44d43f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:39.640498 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca8184-4655-4fb5-8a45-9137f44d43f6 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:39.640962 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca8184-4655-4fb5-8a45-9137f44d43f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:39.641468 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca8184-4655-4fb5-8a45-9137f44d43f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:39.653080 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca8184-4655-4fb5-8a45-9137f44d43f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:39.654733 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca8184-4655-4fb5-8a45-9137f44d43f6 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:39.671332 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-38ca8184-4655-4fb5-8a45-9137f44d43f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:39.672798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-38404a69-80ad-4da3-82fb-f14be48d12e2 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:39.673356 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 387/786] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:39.680679 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-38404a69-80ad-4da3-82fb-f14be48d12e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:39.681737 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca8184-4655-4fb5-8a45-9137f44d43f6 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:39.750076 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 400/787] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:00:39.789390 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38404a69-80ad-4da3-82fb-f14be48d12e2 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:39.863568 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca8184-4655-4fb5-8a45-9137f44d43f6 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:39.926674 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dfb23-e168-4e9b-87f8-4e10fe9f062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:39.927427 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dfb23-e168-4e9b-87f8-4e10fe9f062c None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:39.927594 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dfb23-e168-4e9b-87f8-4e10fe9f062c None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:39.927866 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dfb23-e168-4e9b-87f8-4e10fe9f062c None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:39.928583 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84dfb23-e168-4e9b-87f8-4e10fe9f062c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:39.928907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84dfb23-e168-4e9b-87f8-4e10fe9f062c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:39.931727 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84dfb23-e168-4e9b-87f8-4e10fe9f062c None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:39.950918 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 388/788] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:39.952926 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38404a69-80ad-4da3-82fb-f14be48d12e2 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:39.961889 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dfb23-e168-4e9b-87f8-4e10fe9f062c None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:40.013220 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278662ff-1caa-42cf-abf9-3502257c4913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:40.014010 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278662ff-1caa-42cf-abf9-3502257c4913 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:40.014287 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278662ff-1caa-42cf-abf9-3502257c4913 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:40.014553 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278662ff-1caa-42cf-abf9-3502257c4913 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:40.035053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278662ff-1caa-42cf-abf9-3502257c4913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:40.042360 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-278662ff-1caa-42cf-abf9-3502257c4913 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:00:40.050306 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 401/789] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:00:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:40.054209 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278662ff-1caa-42cf-abf9-3502257c4913 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:40.133131 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dfb23-e168-4e9b-87f8-4e10fe9f062c None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:40.216522 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278662ff-1caa-42cf-abf9-3502257c4913 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:40.229392 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8700374-f394-4c16-881b-ae40847bcdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:40.230209 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8700374-f394-4c16-881b-ae40847bcdd4 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:40.230489 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8700374-f394-4c16-881b-ae40847bcdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:40.230760 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8700374-f394-4c16-881b-ae40847bcdd4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:40.249216 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8700374-f394-4c16-881b-ae40847bcdd4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:40.250683 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8700374-f394-4c16-881b-ae40847bcdd4 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:40.251499 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b0650-c1be-438d-8a68-6686cb394ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:40.252164 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b0650-c1be-438d-8a68-6686cb394ffb None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:40.252443 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b0650-c1be-438d-8a68-6686cb394ffb None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:40.252745 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b0650-c1be-438d-8a68-6686cb394ffb None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:40.253554 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b0650-c1be-438d-8a68-6686cb394ffb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:40.253853 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b0650-c1be-438d-8a68-6686cb394ffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:40.255309 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b0650-c1be-438d-8a68-6686cb394ffb None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:40.270367 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 402/790] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:00:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:40.271925 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b0650-c1be-438d-8a68-6686cb394ffb None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:40.281533 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-b8700374-f394-4c16-881b-ae40847bcdd4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 13:00:40.289161 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 389/791] 10.222.0.52 () {56 vars in 1093 bytes} [Tue Mar 8 13:00:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:40.294629 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8700374-f394-4c16-881b-ae40847bcdd4 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:40.425411 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b0650-c1be-438d-8a68-6686cb394ffb None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:40.488511 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8700374-f394-4c16-881b-ae40847bcdd4 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:40.492597 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa6de9-9943-4c8b-8c28-4df297e4b3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:40.493837 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa6de9-9943-4c8b-8c28-4df297e4b3d7 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:40.494263 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa6de9-9943-4c8b-8c28-4df297e4b3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:40.494589 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa6de9-9943-4c8b-8c28-4df297e4b3d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:40.519079 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa6de9-9943-4c8b-8c28-4df297e4b3d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:40.520643 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa6de9-9943-4c8b-8c28-4df297e4b3d7 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:40.535766 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88669a5-9263-4a87-acec-057573123575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:40.536431 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88669a5-9263-4a87-acec-057573123575 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:40.536734 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88669a5-9263-4a87-acec-057573123575 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:40.537013 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88669a5-9263-4a87-acec-057573123575 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:40.537854 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88669a5-9263-4a87-acec-057573123575 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:40.538159 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88669a5-9263-4a87-acec-057573123575 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:40.539720 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88669a5-9263-4a87-acec-057573123575 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:40.546380 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-ccaa6de9-9943-4c8b-8c28-4df297e4b3d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:40.547617 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 403/792] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:40.563019 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 390/793] 10.222.0.52 () {56 vars in 1133 bytes} [Tue Mar 8 13:00:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:40.563815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa6de9-9943-4c8b-8c28-4df297e4b3d7 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:40.568485 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88669a5-9263-4a87-acec-057573123575 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:40.727735 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88669a5-9263-4a87-acec-057573123575 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:40.734300 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa6de9-9943-4c8b-8c28-4df297e4b3d7 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:40.771870 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1490c-f21d-4cc9-a043-df5a963788ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:40.772520 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1490c-f21d-4cc9-a043-df5a963788ba None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:40.772930 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1490c-f21d-4cc9-a043-df5a963788ba None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:40.773788 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1490c-f21d-4cc9-a043-df5a963788ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:40.775346 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db47d7-e077-4323-943d-8e06acfb5e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:40.776483 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db47d7-e077-4323-943d-8e06acfb5e2f None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:40.778209 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db47d7-e077-4323-943d-8e06acfb5e2f None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:40.778912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db47d7-e077-4323-943d-8e06acfb5e2f None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:40.780344 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db47d7-e077-4323-943d-8e06acfb5e2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:40.780958 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db47d7-e077-4323-943d-8e06acfb5e2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:40.782506 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db47d7-e077-4323-943d-8e06acfb5e2f None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:40.800292 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 404/794] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:40.800637 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9d139-efee-4b3e-9499-73529b48883b None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:40.800976 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9d139-efee-4b3e-9499-73529b48883b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:40.801255 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9d139-efee-4b3e-9499-73529b48883b None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:40.805827 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 405/795] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:40.807505 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9d139-efee-4b3e-9499-73529b48883b None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:40.859616 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1490c-f21d-4cc9-a043-df5a963788ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:40.861122 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1490c-f21d-4cc9-a043-df5a963788ba None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:40.915603 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9d139-efee-4b3e-9499-73529b48883b None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:40.949840 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ec1de-e019-4721-b138-f5d6033c24e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:40.950982 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ec1de-e019-4721-b138-f5d6033c24e6 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:40.951480 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ec1de-e019-4721-b138-f5d6033c24e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:40.951958 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ec1de-e019-4721-b138-f5d6033c24e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:40.959369 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ec1de-e019-4721-b138-f5d6033c24e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:40.961620 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ec1de-e019-4721-b138-f5d6033c24e6 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:40.963568 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 391/796] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:00:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:00:40.964829 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1ebd4-fd99-4c56-b1c1-a5d7032b9cb9 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:40.965500 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1ebd4-fd99-4c56-b1c1-a5d7032b9cb9 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:40.965500 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1ebd4-fd99-4c56-b1c1-a5d7032b9cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:40.979111 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-8f3ec1de-e019-4721-b138-f5d6033c24e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 13:00:40.985231 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 406/797] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:00:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:40.985639 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ec1de-e019-4721-b138-f5d6033c24e6 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:40.986796 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-55c1ebd4-fd99-4c56-b1c1-a5d7032b9cb9 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:40.987999 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-55c1ebd4-fd99-4c56-b1c1-a5d7032b9cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:41.060746 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 392/798] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:00:41.061619 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1ebd4-fd99-4c56-b1c1-a5d7032b9cb9 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:41.094179 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ec1de-e019-4721-b138-f5d6033c24e6 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:41.131153 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cd315-fae7-40b7-a2ae-921289d2c848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:41.131972 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cd315-fae7-40b7-a2ae-921289d2c848 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:41.133129 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cd315-fae7-40b7-a2ae-921289d2c848 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:41.133129 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cd315-fae7-40b7-a2ae-921289d2c848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:41.142748 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cd315-fae7-40b7-a2ae-921289d2c848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:41.144331 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cd315-fae7-40b7-a2ae-921289d2c848 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:41.161788 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-916cd315-fae7-40b7-a2ae-921289d2c848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:41.163652 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 407/799] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:41.164623 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cd315-fae7-40b7-a2ae-921289d2c848 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:41.189379 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1ebd4-fd99-4c56-b1c1-a5d7032b9cb9 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:41.223013 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca3880-f2d8-4b4f-a549-03c14cb8e331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:41.223685 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca3880-f2d8-4b4f-a549-03c14cb8e331 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:41.223966 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca3880-f2d8-4b4f-a549-03c14cb8e331 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:41.224246 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca3880-f2d8-4b4f-a549-03c14cb8e331 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:41.225109 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca3880-f2d8-4b4f-a549-03c14cb8e331 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:41.225419 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca3880-f2d8-4b4f-a549-03c14cb8e331 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:41.227491 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca3880-f2d8-4b4f-a549-03c14cb8e331 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:41.249057 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 393/800] 10.222.0.52 () {56 vars in 1135 bytes} [Tue Mar 8 13:00:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:41.249057 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca3880-f2d8-4b4f-a549-03c14cb8e331 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:41.275715 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cd315-fae7-40b7-a2ae-921289d2c848 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:41.312101 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd605b37-d9cb-49e2-acc5-72e4a9121297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:41.312933 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd605b37-d9cb-49e2-acc5-72e4a9121297 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:41.313218 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd605b37-d9cb-49e2-acc5-72e4a9121297 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:41.313498 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd605b37-d9cb-49e2-acc5-72e4a9121297 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:41.323609 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd605b37-d9cb-49e2-acc5-72e4a9121297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:41.330580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-fd605b37-d9cb-49e2-acc5-72e4a9121297 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:00:41.331943 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 408/801] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:41.334273 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cc4ac-f60c-4fbc-a09a-12f676d43038 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:41.334936 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cc4ac-f60c-4fbc-a09a-12f676d43038 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:41.336862 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cc4ac-f60c-4fbc-a09a-12f676d43038 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:41.338828 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 409/802] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:41.340196 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cc4ac-f60c-4fbc-a09a-12f676d43038 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:41.356974 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca3880-f2d8-4b4f-a549-03c14cb8e331 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:41.392081 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871cd97-a914-4fb2-ba96-0ac252fc8def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:41.392871 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871cd97-a914-4fb2-ba96-0ac252fc8def None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:41.393186 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871cd97-a914-4fb2-ba96-0ac252fc8def None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:41.393605 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871cd97-a914-4fb2-ba96-0ac252fc8def None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:41.394335 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871cd97-a914-4fb2-ba96-0ac252fc8def None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:41.394642 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871cd97-a914-4fb2-ba96-0ac252fc8def None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:41.396036 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871cd97-a914-4fb2-ba96-0ac252fc8def None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:41.408069 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 394/803] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:41.408921 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871cd97-a914-4fb2-ba96-0ac252fc8def None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:41.450588 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cc4ac-f60c-4fbc-a09a-12f676d43038 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:41.485209 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91420d1a-323d-46f8-9797-1c00b595be6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:41.485994 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91420d1a-323d-46f8-9797-1c00b595be6a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:41.486269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91420d1a-323d-46f8-9797-1c00b595be6a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:41.486537 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91420d1a-323d-46f8-9797-1c00b595be6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:41.497974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91420d1a-323d-46f8-9797-1c00b595be6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:41.499476 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91420d1a-323d-46f8-9797-1c00b595be6a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:41.515924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-91420d1a-323d-46f8-9797-1c00b595be6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:41.516580 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871cd97-a914-4fb2-ba96-0ac252fc8def None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:41.517162 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 410/804] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:41.518399 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cdc8f-f839-4667-bbf6-7c26f097566b None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:41.518681 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cdc8f-f839-4667-bbf6-7c26f097566b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:41.518952 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cdc8f-f839-4667-bbf6-7c26f097566b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:41.536828 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-041cdc8f-f839-4667-bbf6-7c26f097566b None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:41.538015 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-041cdc8f-f839-4667-bbf6-7c26f097566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:41.559822 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4402b1c-e726-4d49-86a1-afbf43fe9451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:41.560486 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4402b1c-e726-4d49-86a1-afbf43fe9451 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:41.560798 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4402b1c-e726-4d49-86a1-afbf43fe9451 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:41.561072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4402b1c-e726-4d49-86a1-afbf43fe9451 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:41.561811 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4402b1c-e726-4d49-86a1-afbf43fe9451 None admin] RBAC: Adding query filter params (name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:41.562113 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4402b1c-e726-4d49-86a1-afbf43fe9451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:41.563500 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4402b1c-e726-4d49-86a1-afbf43fe9451 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:41.576446 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 395/805] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:00:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:41.576446 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4402b1c-e726-4d49-86a1-afbf43fe9451 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:41.626021 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 411/806] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:00:41.627811 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cdc8f-f839-4667-bbf6-7c26f097566b None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:41.680784 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4402b1c-e726-4d49-86a1-afbf43fe9451 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:41.713758 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481d60b-3635-482e-bc54-72be48a31428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:41.714550 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481d60b-3635-482e-bc54-72be48a31428 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:41.714828 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481d60b-3635-482e-bc54-72be48a31428 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:41.715098 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481d60b-3635-482e-bc54-72be48a31428 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:41.721757 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481d60b-3635-482e-bc54-72be48a31428 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:41.723214 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481d60b-3635-482e-bc54-72be48a31428 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:41.735597 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cdc8f-f839-4667-bbf6-7c26f097566b None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:41.736726 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-b481d60b-3635-482e-bc54-72be48a31428 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:41.737897 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 396/807] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:41.738718 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481d60b-3635-482e-bc54-72be48a31428 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:41.772510 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972d90b-aa97-4e39-b61c-4244b3826e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:41.773469 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972d90b-aa97-4e39-b61c-4244b3826e93 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:41.773900 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972d90b-aa97-4e39-b61c-4244b3826e93 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:41.774320 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972d90b-aa97-4e39-b61c-4244b3826e93 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:41.775206 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972d90b-aa97-4e39-b61c-4244b3826e93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:41.775670 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972d90b-aa97-4e39-b61c-4244b3826e93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:41.777502 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972d90b-aa97-4e39-b61c-4244b3826e93 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:41.789200 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 412/808] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:41.790183 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972d90b-aa97-4e39-b61c-4244b3826e93 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:41.834771 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481d60b-3635-482e-bc54-72be48a31428 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:41.869226 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2af31-b264-4ab5-843d-ae80b162e260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:41.870253 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2af31-b264-4ab5-843d-ae80b162e260 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:41.870761 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2af31-b264-4ab5-843d-ae80b162e260 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:41.871040 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2af31-b264-4ab5-843d-ae80b162e260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:41.881191 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2af31-b264-4ab5-843d-ae80b162e260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:41.882871 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2af31-b264-4ab5-843d-ae80b162e260 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:41.887645 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972d90b-aa97-4e39-b61c-4244b3826e93 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:41.900518 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-7ea2af31-b264-4ab5-843d-ae80b162e260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:41.902342 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 397/809] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:41.903150 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2af31-b264-4ab5-843d-ae80b162e260 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:41.925977 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5feab-15d8-4815-90ed-56b4caa15fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:41.926785 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5feab-15d8-4815-90ed-56b4caa15fda None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:41.927061 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5feab-15d8-4815-90ed-56b4caa15fda None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:41.927326 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5feab-15d8-4815-90ed-56b4caa15fda None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:41.927976 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5feab-15d8-4815-90ed-56b4caa15fda None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:41.929992 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5feab-15d8-4815-90ed-56b4caa15fda None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:41.941184 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-04a5feab-15d8-4815-90ed-56b4caa15fda None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 08 13:00:41.947820 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 413/810] 10.222.0.52 () {56 vars in 1129 bytes} [Tue Mar 8 13:00:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:41.947820 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5feab-15d8-4815-90ed-56b4caa15fda None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:42.006006 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2af31-b264-4ab5-843d-ae80b162e260 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:42.038599 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e8257-4ce2-4703-98a4-a66b42371043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:42.039182 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e8257-4ce2-4703-98a4-a66b42371043 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:42.039460 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e8257-4ce2-4703-98a4-a66b42371043 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:42.039728 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e8257-4ce2-4703-98a4-a66b42371043 None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:42.040500 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e8257-4ce2-4703-98a4-a66b42371043 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:42.040852 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e8257-4ce2-4703-98a4-a66b42371043 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:42.042258 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e8257-4ce2-4703-98a4-a66b42371043 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:42.043528 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5feab-15d8-4815-90ed-56b4caa15fda None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:42.053160 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 398/811] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:42.054663 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e8257-4ce2-4703-98a4-a66b42371043 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:42.078226 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0f6fc-e7de-4974-b19d-3bd9f9594568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:42.079012 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0f6fc-e7de-4974-b19d-3bd9f9594568 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:42.079286 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0f6fc-e7de-4974-b19d-3bd9f9594568 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:42.079553 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0f6fc-e7de-4974-b19d-3bd9f9594568 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:42.086555 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0f6fc-e7de-4974-b19d-3bd9f9594568 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:42.087982 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0f6fc-e7de-4974-b19d-3bd9f9594568 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:42.101602 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-7dc0f6fc-e7de-4974-b19d-3bd9f9594568 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:42.102750 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 414/812] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:42.103507 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0f6fc-e7de-4974-b19d-3bd9f9594568 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:42.147186 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e8257-4ce2-4703-98a4-a66b42371043 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:42.179592 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4de357-13ae-4eda-92ad-c4a0cd51eb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:42.180248 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4de357-13ae-4eda-92ad-c4a0cd51eb04 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:42.180524 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4de357-13ae-4eda-92ad-c4a0cd51eb04 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:42.180850 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4de357-13ae-4eda-92ad-c4a0cd51eb04 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:42.181564 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4de357-13ae-4eda-92ad-c4a0cd51eb04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:42.181865 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4de357-13ae-4eda-92ad-c4a0cd51eb04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:42.183228 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4de357-13ae-4eda-92ad-c4a0cd51eb04 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:42.195771 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 399/813] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:42.197065 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e85152-4b9a-4490-8b45-ef197ae240eb None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:42.197365 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e85152-4b9a-4490-8b45-ef197ae240eb None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:42.197618 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e85152-4b9a-4490-8b45-ef197ae240eb None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:42.198800 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0f6fc-e7de-4974-b19d-3bd9f9594568 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:42.199442 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 400/814] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:42.199977 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e85152-4b9a-4490-8b45-ef197ae240eb None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:42.241978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253edfd-c3b6-4a05-bb29-08da9918a826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:42.242718 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253edfd-c3b6-4a05-bb29-08da9918a826 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:42.242995 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253edfd-c3b6-4a05-bb29-08da9918a826 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:42.243265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253edfd-c3b6-4a05-bb29-08da9918a826 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:42.243959 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253edfd-c3b6-4a05-bb29-08da9918a826 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:42.244261 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253edfd-c3b6-4a05-bb29-08da9918a826 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:42.245659 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253edfd-c3b6-4a05-bb29-08da9918a826 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:42.249922 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 415/815] 10.222.0.52 () {56 vars in 1124 bytes} [Tue Mar 8 13:00:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:42.250707 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253edfd-c3b6-4a05-bb29-08da9918a826 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:42.300094 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e85152-4b9a-4490-8b45-ef197ae240eb None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:42.332904 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9b543-657a-481c-9ffa-2efec6efacbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:42.333542 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9b543-657a-481c-9ffa-2efec6efacbb None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:42.333818 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9b543-657a-481c-9ffa-2efec6efacbb None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:42.334086 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9b543-657a-481c-9ffa-2efec6efacbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:42.334897 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9b543-657a-481c-9ffa-2efec6efacbb None admin] RBAC: Adding query filter params (role.id=f9ec85924a914e078096b38cae4e6caa, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=72d4ac44d04943a5b24c7a1d6a31b7f2) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:42.335842 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9b543-657a-481c-9ffa-2efec6efacbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:42.337304 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9b543-657a-481c-9ffa-2efec6efacbb None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:42.342937 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 401/816] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:00:42 2022] GET /identity/v3/role_assignments?user.id=72d4ac44d04943a5b24c7a1d6a31b7f2&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=f9ec85924a914e078096b38cae4e6caa => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:42.343527 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9b543-657a-481c-9ffa-2efec6efacbb None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:42.344091 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253edfd-c3b6-4a05-bb29-08da9918a826 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:42.383318 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529e343-ad3b-4b7e-934b-f0d700675ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:42.383989 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529e343-ad3b-4b7e-934b-f0d700675ce5 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:42.384266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529e343-ad3b-4b7e-934b-f0d700675ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:42.384544 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529e343-ad3b-4b7e-934b-f0d700675ce5 None admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:42.385383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529e343-ad3b-4b7e-934b-f0d700675ce5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:42.385685 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529e343-ad3b-4b7e-934b-f0d700675ce5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:42.387162 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529e343-ad3b-4b7e-934b-f0d700675ce5 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:42.399747 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 416/817] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:42.402433 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00644e78-c98d-4266-a7fd-61ecc11c249b None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:42.402723 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00644e78-c98d-4266-a7fd-61ecc11c249b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:42.403001 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00644e78-c98d-4266-a7fd-61ecc11c249b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:42.424741 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-00644e78-c98d-4266-a7fd-61ecc11c249b None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:42.426157 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-00644e78-c98d-4266-a7fd-61ecc11c249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:42.458277 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9b543-657a-481c-9ffa-2efec6efacbb None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:42.493952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152cbe2-4652-4403-ab58-df9393f7eeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:42.494793 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152cbe2-4652-4403-ab58-df9393f7eeda None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:42.495078 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152cbe2-4652-4403-ab58-df9393f7eeda None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:42.495355 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152cbe2-4652-4403-ab58-df9393f7eeda None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:42.502066 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 417/818] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:00:42.502760 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00644e78-c98d-4266-a7fd-61ecc11c249b None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:42.521150 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152cbe2-4652-4403-ab58-df9393f7eeda None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:42.521150 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152cbe2-4652-4403-ab58-df9393f7eeda None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:42.539859 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-5152cbe2-4652-4403-ab58-df9393f7eeda None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 13:00:42.542258 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 402/819] 10.222.0.52 () {56 vars in 1117 bytes} [Tue Mar 8 13:00:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:42.542397 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152cbe2-4652-4403-ab58-df9393f7eeda None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:42.624948 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00644e78-c98d-4266-a7fd-61ecc11c249b None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:42.655254 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152cbe2-4652-4403-ab58-df9393f7eeda None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:42.661742 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f69a59-5aa9-4e20-b594-16906cce40c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:42.662936 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f69a59-5aa9-4e20-b594-16906cce40c5 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:42.663416 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f69a59-5aa9-4e20-b594-16906cce40c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:42.663995 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f69a59-5aa9-4e20-b594-16906cce40c5 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:42.665230 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f69a59-5aa9-4e20-b594-16906cce40c5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:42.665648 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f69a59-5aa9-4e20-b594-16906cce40c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:42.667721 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f69a59-5aa9-4e20-b594-16906cce40c5 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:42.678472 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 418/820] 10.222.0.52 () {56 vars in 1124 bytes} [Tue Mar 8 13:00:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:42.678472 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f69a59-5aa9-4e20-b594-16906cce40c5 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:42.688599 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05079a20-ee46-4759-80b5-800b3c477051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:42.689623 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05079a20-ee46-4759-80b5-800b3c477051 None admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:42.690004 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05079a20-ee46-4759-80b5-800b3c477051 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:42.690556 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05079a20-ee46-4759-80b5-800b3c477051 None admin] PATH_INFO: `/v3/projects/2b478af53391486eb72c85c786ed4abb/users/f375d86747d248fa95f487b073d92d83/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:42.692635 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05079a20-ee46-4759-80b5-800b3c477051 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b478af53391486eb72c85c786ed4abb, user_id=f375d86747d248fa95f487b073d92d83, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:42.694189 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05079a20-ee46-4759-80b5-800b3c477051 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:42.773881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 403/821] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 13:00:42 2022] PUT /identity/v3/projects/2b478af53391486eb72c85c786ed4abb/users/f375d86747d248fa95f487b073d92d83/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:00:42.774600 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05079a20-ee46-4759-80b5-800b3c477051 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:42.779552 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f69a59-5aa9-4e20-b594-16906cce40c5 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:42.818597 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a10c3-ed2f-468a-bc05-29e7ba789ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:42.820539 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a10c3-ed2f-468a-bc05-29e7ba789ed5 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:42.821069 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a10c3-ed2f-468a-bc05-29e7ba789ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:42.821557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a10c3-ed2f-468a-bc05-29e7ba789ed5 None admin] PATH_INFO: `/v3/services/network` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:42.822419 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a10c3-ed2f-468a-bc05-29e7ba789ed5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:42.824039 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a10c3-ed2f-468a-bc05-29e7ba789ed5 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:42.836016 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-e16a10c3-ed2f-468a-bc05-29e7ba789ed5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 08 13:00:42.837947 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 419/822] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:42 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:42.838969 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a10c3-ed2f-468a-bc05-29e7ba789ed5 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:42.893231 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05079a20-ee46-4759-80b5-800b3c477051 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:42.930705 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2359c0c-d526-4761-89b2-69734d062a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:42.931242 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2359c0c-d526-4761-89b2-69734d062a0c None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:42.931523 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2359c0c-d526-4761-89b2-69734d062a0c None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:42.931800 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2359c0c-d526-4761-89b2-69734d062a0c None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:42.932679 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2359c0c-d526-4761-89b2-69734d062a0c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:42.933130 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2359c0c-d526-4761-89b2-69734d062a0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:42.934612 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2359c0c-d526-4761-89b2-69734d062a0c None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:42.953752 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 404/823] 10.222.0.52 () {56 vars in 1149 bytes} [Tue Mar 8 13:00:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:42.954720 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2359c0c-d526-4761-89b2-69734d062a0c None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:42.958598 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a10c3-ed2f-468a-bc05-29e7ba789ed5 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:42.997511 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e937b-5963-4465-932b-729961719074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:42.998464 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e937b-5963-4465-932b-729961719074 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:42.998924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e937b-5963-4465-932b-729961719074 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:42.999206 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e937b-5963-4465-932b-729961719074 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:42.999954 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e937b-5963-4465-932b-729961719074 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:43.001987 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e937b-5963-4465-932b-729961719074 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:43.055322 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2359c0c-d526-4761-89b2-69734d062a0c None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:43.072767 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 420/824] 10.222.0.52 () {60 vars in 1144 bytes} [Tue Mar 8 13:00:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:00:43.073633 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e937b-5963-4465-932b-729961719074 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:43.117541 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e1a5d-fb1e-439a-a9e9-825a5812f554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:43.118633 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e1a5d-fb1e-439a-a9e9-825a5812f554 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:43.119110 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e1a5d-fb1e-439a-a9e9-825a5812f554 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:43.119571 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e1a5d-fb1e-439a-a9e9-825a5812f554 None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:43.120495 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e1a5d-fb1e-439a-a9e9-825a5812f554 None admin] RBAC: Adding query filter params (name=network) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:43.121523 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e1a5d-fb1e-439a-a9e9-825a5812f554 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:43.123598 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e1a5d-fb1e-439a-a9e9-825a5812f554 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:43.131633 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 405/825] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 13:00:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:43.139812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e1a5d-fb1e-439a-a9e9-825a5812f554 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:43.200859 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e937b-5963-4465-932b-729961719074 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:43.279206 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f47639-7cf1-4e25-a51e-8ad751f33500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:43.280123 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f47639-7cf1-4e25-a51e-8ad751f33500 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:43.280413 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f47639-7cf1-4e25-a51e-8ad751f33500 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:43.280714 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f47639-7cf1-4e25-a51e-8ad751f33500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:43.299876 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f47639-7cf1-4e25-a51e-8ad751f33500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:43.301401 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f47639-7cf1-4e25-a51e-8ad751f33500 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:43.332219 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-55f47639-7cf1-4e25-a51e-8ad751f33500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:43.334224 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 421/826] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:43.342428 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f47639-7cf1-4e25-a51e-8ad751f33500 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:43.355173 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e1a5d-fb1e-439a-a9e9-825a5812f554 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:43.422357 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f44de-790a-4c5e-ba73-22e50a807f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:43.423279 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f44de-790a-4c5e-ba73-22e50a807f9d None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:43.423744 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f44de-790a-4c5e-ba73-22e50a807f9d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:43.424194 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f44de-790a-4c5e-ba73-22e50a807f9d None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:43.425307 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f44de-790a-4c5e-ba73-22e50a807f9d None admin] RBAC: Adding query filter params (type=network) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:43.427699 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f44de-790a-4c5e-ba73-22e50a807f9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:43.433861 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f44de-790a-4c5e-ba73-22e50a807f9d None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:43.441864 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 406/827] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 13:00:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:43.448137 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f44de-790a-4c5e-ba73-22e50a807f9d None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:43.496776 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f47639-7cf1-4e25-a51e-8ad751f33500 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:43.539777 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db67a23-881d-4151-bdfa-6ebeaed56ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:43.540458 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db67a23-881d-4151-bdfa-6ebeaed56ba4 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:43.540940 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db67a23-881d-4151-bdfa-6ebeaed56ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:43.541218 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db67a23-881d-4151-bdfa-6ebeaed56ba4 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:43.542888 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db67a23-881d-4151-bdfa-6ebeaed56ba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:43.543198 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db67a23-881d-4151-bdfa-6ebeaed56ba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:43.544600 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db67a23-881d-4151-bdfa-6ebeaed56ba4 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:43.575153 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 422/828] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:43.581578 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db67a23-881d-4151-bdfa-6ebeaed56ba4 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:43.691878 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f44de-790a-4c5e-ba73-22e50a807f9d None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:43.789317 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b428d4-2414-42de-9ca9-e69dd90b4b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:43.789905 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b428d4-2414-42de-9ca9-e69dd90b4b15 None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:43.790182 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b428d4-2414-42de-9ca9-e69dd90b4b15 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:43.790653 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b428d4-2414-42de-9ca9-e69dd90b4b15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:43.791758 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b428d4-2414-42de-9ca9-e69dd90b4b15 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:43.793713 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b428d4-2414-42de-9ca9-e69dd90b4b15 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:43.807375 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db67a23-881d-4151-bdfa-6ebeaed56ba4 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:43.853418 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64af8b-6cb2-4bb7-bb67-b3f4033df1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:43.853418 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64af8b-6cb2-4bb7-bb67-b3f4033df1d5 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:43.853726 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64af8b-6cb2-4bb7-bb67-b3f4033df1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:43.854090 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64af8b-6cb2-4bb7-bb67-b3f4033df1d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:43.862842 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64af8b-6cb2-4bb7-bb67-b3f4033df1d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:43.864326 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64af8b-6cb2-4bb7-bb67-b3f4033df1d5 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:43.884725 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-9b64af8b-6cb2-4bb7-bb67-b3f4033df1d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:43.886290 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 423/829] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:43.892612 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64af8b-6cb2-4bb7-bb67-b3f4033df1d5 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:43.898593 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 407/830] 10.222.0.52 () {60 vars in 1144 bytes} [Tue Mar 8 13:00:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:00:44.019309 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64af8b-6cb2-4bb7-bb67-b3f4033df1d5 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:44.067861 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0815e-0a61-4647-bb92-c0176dcd2c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:44.068457 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0815e-0a61-4647-bb92-c0176dcd2c2c None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:44.068760 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0815e-0a61-4647-bb92-c0176dcd2c2c None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:44.069033 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0815e-0a61-4647-bb92-c0176dcd2c2c None admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:44.070037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0815e-0a61-4647-bb92-c0176dcd2c2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:44.070393 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0815e-0a61-4647-bb92-c0176dcd2c2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:44.071798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0815e-0a61-4647-bb92-c0176dcd2c2c None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:44.084452 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 424/831] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:44.090079 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b428d4-2414-42de-9ca9-e69dd90b4b15 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:44.205173 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b428d4-2414-42de-9ca9-e69dd90b4b15 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:44.241943 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e2c86-76d2-4fbe-ad89-1bd614593d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:44.242835 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e2c86-76d2-4fbe-ad89-1bd614593d2d None admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:44.243110 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e2c86-76d2-4fbe-ad89-1bd614593d2d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:44.243405 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e2c86-76d2-4fbe-ad89-1bd614593d2d None admin] PATH_INFO: `/v3/projects/2b478af53391486eb72c85c786ed4abb/users/556058de7b9f48b8a10188ec64496e72/roles/fe0e7f0760f74b09b441426d672df700` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:44.260019 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e2c86-76d2-4fbe-ad89-1bd614593d2d None admin] RBAC: Authorizing `identity:create_grant(project_id=2b478af53391486eb72c85c786ed4abb, user_id=556058de7b9f48b8a10188ec64496e72, role_id=fe0e7f0760f74b09b441426d672df700)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:44.261546 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e2c86-76d2-4fbe-ad89-1bd614593d2d None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:44.356193 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 408/832] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 13:00:44 2022] PUT /identity/v3/projects/2b478af53391486eb72c85c786ed4abb/users/556058de7b9f48b8a10188ec64496e72/roles/fe0e7f0760f74b09b441426d672df700 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:00:45.054404 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752516cc-52e7-4556-bf46-b0624806c8be None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:45.054784 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752516cc-52e7-4556-bf46-b0624806c8be None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:45.055059 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752516cc-52e7-4556-bf46-b0624806c8be None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:45.057096 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 425/833] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:45.062568 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad82ea-39bd-4424-912b-8ae3456e9250 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:45.062857 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad82ea-39bd-4424-912b-8ae3456e9250 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:45.063130 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad82ea-39bd-4424-912b-8ae3456e9250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:45.080928 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-f0ad82ea-39bd-4424-912b-8ae3456e9250 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:45.082141 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f0ad82ea-39bd-4424-912b-8ae3456e9250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:45.152973 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 409/834] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:00:45.174924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752516cc-52e7-4556-bf46-b0624806c8be None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:45.279495 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752516cc-52e7-4556-bf46-b0624806c8be None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:45.315841 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fbc1c-2ab4-49f0-aec3-c952bc05f045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:45.316565 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fbc1c-2ab4-49f0-aec3-c952bc05f045 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:45.316870 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fbc1c-2ab4-49f0-aec3-c952bc05f045 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:45.317143 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fbc1c-2ab4-49f0-aec3-c952bc05f045 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:45.320706 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fbc1c-2ab4-49f0-aec3-c952bc05f045 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:45.320706 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fbc1c-2ab4-49f0-aec3-c952bc05f045 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:45.331033 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-e12fbc1c-2ab4-49f0-aec3-c952bc05f045 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 08 13:00:45.332518 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 426/835] 10.222.0.52 () {56 vars in 1132 bytes} [Tue Mar 8 13:00:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:45.338475 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad82ea-39bd-4424-912b-8ae3456e9250 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:45.438749 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad82ea-39bd-4424-912b-8ae3456e9250 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:45.462273 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb55621-4ca3-413b-b6c2-ecb8f59a8304 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:45.462569 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb55621-4ca3-413b-b6c2-ecb8f59a8304 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:45.462854 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb55621-4ca3-413b-b6c2-ecb8f59a8304 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:45.464904 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 427/836] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:00:45.469850 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf474062-e24d-4d88-b4eb-f74d856c7695 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:45.470137 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf474062-e24d-4d88-b4eb-f74d856c7695 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:45.470415 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf474062-e24d-4d88-b4eb-f74d856c7695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:45.485173 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844ea4e-f076-4763-b163-dc05ca9085ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:45.485834 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844ea4e-f076-4763-b163-dc05ca9085ea None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:45.486114 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844ea4e-f076-4763-b163-dc05ca9085ea None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:45.486388 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844ea4e-f076-4763-b163-dc05ca9085ea None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:45.487098 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844ea4e-f076-4763-b163-dc05ca9085ea None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:45.487770 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844ea4e-f076-4763-b163-dc05ca9085ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:45.488802 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844ea4e-f076-4763-b163-dc05ca9085ea None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:45.494354 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 410/837] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 13:00:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:45.494964 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-bf474062-e24d-4d88-b4eb-f74d856c7695 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:45.500724 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844ea4e-f076-4763-b163-dc05ca9085ea None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:45.500888 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-bf474062-e24d-4d88-b4eb-f74d856c7695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:45.596770 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 428/838] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:00:45.608884 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844ea4e-f076-4763-b163-dc05ca9085ea None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:45.616278 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf474062-e24d-4d88-b4eb-f74d856c7695 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:45.649235 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec459b-e4cc-403f-85ab-23ef17ce16b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:45.649896 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec459b-e4cc-403f-85ab-23ef17ce16b8 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:45.650176 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec459b-e4cc-403f-85ab-23ef17ce16b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:45.650449 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec459b-e4cc-403f-85ab-23ef17ce16b8 None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:45.652175 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec459b-e4cc-403f-85ab-23ef17ce16b8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:45.652483 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec459b-e4cc-403f-85ab-23ef17ce16b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:45.653915 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec459b-e4cc-403f-85ab-23ef17ce16b8 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:45.659065 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 411/839] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 13:00:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:45.726670 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf474062-e24d-4d88-b4eb-f74d856c7695 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:45.766079 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5b070-ce41-47d1-986c-7588453d4ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:45.767362 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5b070-ce41-47d1-986c-7588453d4ff2 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:45.767857 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5b070-ce41-47d1-986c-7588453d4ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:45.768377 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5b070-ce41-47d1-986c-7588453d4ff2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:45.780727 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5b070-ce41-47d1-986c-7588453d4ff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:45.788368 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-1bd5b070-ce41-47d1-986c-7588453d4ff2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:00:45.790518 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 429/840] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:00:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:45.796801 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec459b-e4cc-403f-85ab-23ef17ce16b8 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:45.902598 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec459b-e4cc-403f-85ab-23ef17ce16b8 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:45.906264 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be3a9-a9f0-4627-919f-b5a611463ede None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:45.906784 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be3a9-a9f0-4627-919f-b5a611463ede None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:45.907271 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be3a9-a9f0-4627-919f-b5a611463ede None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:45.909495 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 430/841] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:45.914982 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe5712-19e5-4910-9d93-796d8829f774 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:45.915271 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe5712-19e5-4910-9d93-796d8829f774 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:45.915552 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe5712-19e5-4910-9d93-796d8829f774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:45.933066 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-23fe5712-19e5-4910-9d93-796d8829f774 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:45.934248 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-23fe5712-19e5-4910-9d93-796d8829f774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:45.948094 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374ecf1-5aab-4f66-912f-c3945e71c5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:45.949659 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374ecf1-5aab-4f66-912f-c3945e71c5b7 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:45.950169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374ecf1-5aab-4f66-912f-c3945e71c5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:45.950889 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374ecf1-5aab-4f66-912f-c3945e71c5b7 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:45.952015 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374ecf1-5aab-4f66-912f-c3945e71c5b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:45.952839 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374ecf1-5aab-4f66-912f-c3945e71c5b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:45.954459 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374ecf1-5aab-4f66-912f-c3945e71c5b7 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:45.967756 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 412/842] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:00:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:45.973593 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374ecf1-5aab-4f66-912f-c3945e71c5b7 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:46.016765 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 431/843] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:00:46.034335 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe5712-19e5-4910-9d93-796d8829f774 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:46.083343 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374ecf1-5aab-4f66-912f-c3945e71c5b7 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:46.117971 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd6bbe-51d9-4235-86f6-52a915e51307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:46.118825 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd6bbe-51d9-4235-86f6-52a915e51307 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:46.119108 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd6bbe-51d9-4235-86f6-52a915e51307 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:46.119441 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd6bbe-51d9-4235-86f6-52a915e51307 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:46.130235 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd6bbe-51d9-4235-86f6-52a915e51307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:46.131908 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd6bbe-51d9-4235-86f6-52a915e51307 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:46.140631 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe5712-19e5-4910-9d93-796d8829f774 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:46.148406 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-63cd6bbe-51d9-4235-86f6-52a915e51307 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:46.154465 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 413/844] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:46.156638 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd6bbe-51d9-4235-86f6-52a915e51307 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:46.179328 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4f99b-32de-46ca-a707-65b9093f070f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:46.180868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4f99b-32de-46ca-a707-65b9093f070f None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:46.181372 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4f99b-32de-46ca-a707-65b9093f070f None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:46.181869 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4f99b-32de-46ca-a707-65b9093f070f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:46.182741 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4f99b-32de-46ca-a707-65b9093f070f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:46.184330 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4f99b-32de-46ca-a707-65b9093f070f None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:46.198151 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-42a4f99b-32de-46ca-a707-65b9093f070f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 08 13:00:46.204543 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 432/845] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 13:00:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:46.205787 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4f99b-32de-46ca-a707-65b9093f070f None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:46.258708 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd6bbe-51d9-4235-86f6-52a915e51307 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:46.292132 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0596c22-2f13-4f90-818f-cd37f79cc9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:46.292884 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0596c22-2f13-4f90-818f-cd37f79cc9d2 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:46.293164 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0596c22-2f13-4f90-818f-cd37f79cc9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:46.293432 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0596c22-2f13-4f90-818f-cd37f79cc9d2 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:46.294144 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0596c22-2f13-4f90-818f-cd37f79cc9d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:46.294444 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0596c22-2f13-4f90-818f-cd37f79cc9d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:46.295814 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0596c22-2f13-4f90-818f-cd37f79cc9d2 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:46.308202 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 414/846] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:46.313508 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0596c22-2f13-4f90-818f-cd37f79cc9d2 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:46.327048 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4f99b-32de-46ca-a707-65b9093f070f None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:46.372638 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8fdbf-4e28-430e-9429-e5158565880c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:46.373963 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8fdbf-4e28-430e-9429-e5158565880c None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:46.374811 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8fdbf-4e28-430e-9429-e5158565880c None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:46.375559 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8fdbf-4e28-430e-9429-e5158565880c None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:46.376735 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8fdbf-4e28-430e-9429-e5158565880c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:46.377555 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8fdbf-4e28-430e-9429-e5158565880c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:46.379402 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8fdbf-4e28-430e-9429-e5158565880c None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:46.386653 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 433/847] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 13:00:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:46.394399 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8fdbf-4e28-430e-9429-e5158565880c None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:46.421358 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0596c22-2f13-4f90-818f-cd37f79cc9d2 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:46.457271 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7608e54-d103-44ff-b8c4-3614c47b35f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:46.458066 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7608e54-d103-44ff-b8c4-3614c47b35f4 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:46.458355 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7608e54-d103-44ff-b8c4-3614c47b35f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:46.458628 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7608e54-d103-44ff-b8c4-3614c47b35f4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:46.466902 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7608e54-d103-44ff-b8c4-3614c47b35f4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:46.468383 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7608e54-d103-44ff-b8c4-3614c47b35f4 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:46.482772 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-f7608e54-d103-44ff-b8c4-3614c47b35f4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 13:00:46.488650 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 415/848] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:00:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:46.489947 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7608e54-d103-44ff-b8c4-3614c47b35f4 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:46.503336 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8fdbf-4e28-430e-9429-e5158565880c None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:46.537803 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb04a1-7f23-4e45-90b3-61337f0f1118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:46.546406 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb04a1-7f23-4e45-90b3-61337f0f1118 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:46.546406 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb04a1-7f23-4e45-90b3-61337f0f1118 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:46.546406 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb04a1-7f23-4e45-90b3-61337f0f1118 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:46.546406 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb04a1-7f23-4e45-90b3-61337f0f1118 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:46.546406 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb04a1-7f23-4e45-90b3-61337f0f1118 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:46.546406 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb04a1-7f23-4e45-90b3-61337f0f1118 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:46.546892 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 434/849] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 13:00:46 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:46.605106 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7608e54-d103-44ff-b8c4-3614c47b35f4 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:46.645265 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cb7a4-ca64-418d-bb5d-593f355e21b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:46.645985 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cb7a4-ca64-418d-bb5d-593f355e21b3 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:46.646263 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cb7a4-ca64-418d-bb5d-593f355e21b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:46.646581 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cb7a4-ca64-418d-bb5d-593f355e21b3 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:46.647959 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cb7a4-ca64-418d-bb5d-593f355e21b3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:46.648263 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cb7a4-ca64-418d-bb5d-593f355e21b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:46.649922 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cb7a4-ca64-418d-bb5d-593f355e21b3 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:46.670909 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 416/850] 10.222.0.52 () {56 vars in 1135 bytes} [Tue Mar 8 13:00:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:46.678239 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb04a1-7f23-4e45-90b3-61337f0f1118 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:46.788131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb04a1-7f23-4e45-90b3-61337f0f1118 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:46.800602 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac182f7-f25f-4508-b3b4-60e2fe6b3bf9 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:46.800929 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac182f7-f25f-4508-b3b4-60e2fe6b3bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:46.801180 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac182f7-f25f-4508-b3b4-60e2fe6b3bf9 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:46.803429 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 417/851] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:00:46.808392 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cad557-64dc-4153-9a4d-109902fe0edb None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:46.808714 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cad557-64dc-4153-9a4d-109902fe0edb None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:46.808976 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cad557-64dc-4153-9a4d-109902fe0edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:46.825753 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b3874-4819-4f83-bfd3-f702a4758397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:46.826406 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b3874-4819-4f83-bfd3-f702a4758397 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:46.826690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b3874-4819-4f83-bfd3-f702a4758397 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:46.826966 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b3874-4819-4f83-bfd3-f702a4758397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:46.827125 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-08cad557-64dc-4153-9a4d-109902fe0edb None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:46.828526 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-08cad557-64dc-4153-9a4d-109902fe0edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:46.909249 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 418/852] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:00:46.918516 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b3874-4819-4f83-bfd3-f702a4758397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:46.918516 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b3874-4819-4f83-bfd3-f702a4758397 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:46.937544 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cad557-64dc-4153-9a4d-109902fe0edb None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:47.046463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 435/853] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:00:46 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:00:47.047066 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cad557-64dc-4153-9a4d-109902fe0edb None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:47.051729 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b3874-4819-4f83-bfd3-f702a4758397 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:47.083234 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692574b-6c6c-4710-8733-2343c4a72e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:47.084159 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692574b-6c6c-4710-8733-2343c4a72e55 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:47.084514 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692574b-6c6c-4710-8733-2343c4a72e55 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:47.085451 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692574b-6c6c-4710-8733-2343c4a72e55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:47.095631 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692574b-6c6c-4710-8733-2343c4a72e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:47.103409 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-f692574b-6c6c-4710-8733-2343c4a72e55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:00:47.104990 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 419/854] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:00:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:47.110647 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692574b-6c6c-4710-8733-2343c4a72e55 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:47.164903 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b3874-4819-4f83-bfd3-f702a4758397 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:47.212645 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5820450-e507-4f67-a7e0-a3c77a19eb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:47.214795 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5820450-e507-4f67-a7e0-a3c77a19eb74 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:47.215283 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5820450-e507-4f67-a7e0-a3c77a19eb74 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:47.215894 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5820450-e507-4f67-a7e0-a3c77a19eb74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:47.218923 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692574b-6c6c-4710-8733-2343c4a72e55 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:47.231153 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5820450-e507-4f67-a7e0-a3c77a19eb74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:47.233605 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5820450-e507-4f67-a7e0-a3c77a19eb74 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:47.252392 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6eba5-e2b7-49c5-afc5-f8c64321c700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:47.253088 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6eba5-e2b7-49c5-afc5-f8c64321c700 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:47.253368 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6eba5-e2b7-49c5-afc5-f8c64321c700 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:47.253641 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6eba5-e2b7-49c5-afc5-f8c64321c700 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:47.254380 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6eba5-e2b7-49c5-afc5-f8c64321c700 None admin] RBAC: Adding query filter params (name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:47.254682 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6eba5-e2b7-49c5-afc5-f8c64321c700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:47.256048 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6eba5-e2b7-49c5-afc5-f8c64321c700 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:47.256773 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-b5820450-e507-4f67-a7e0-a3c77a19eb74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:47.259238 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 436/855] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:47.265828 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5820450-e507-4f67-a7e0-a3c77a19eb74 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:47.271146 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 420/856] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:00:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:47.272627 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6eba5-e2b7-49c5-afc5-f8c64321c700 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:47.376359 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6eba5-e2b7-49c5-afc5-f8c64321c700 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:47.390156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5820450-e507-4f67-a7e0-a3c77a19eb74 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:47.412940 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78886ce-d78c-4ac7-b969-3411e123d938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:47.414097 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78886ce-d78c-4ac7-b969-3411e123d938 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:47.414556 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78886ce-d78c-4ac7-b969-3411e123d938 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:47.415027 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78886ce-d78c-4ac7-b969-3411e123d938 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:47.426424 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78886ce-d78c-4ac7-b969-3411e123d938 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:47.428155 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78886ce-d78c-4ac7-b969-3411e123d938 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:47.431363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85ba60-d5d8-4a24-bc51-1869752c9f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:47.432124 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85ba60-d5d8-4a24-bc51-1869752c9f82 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:47.432469 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85ba60-d5d8-4a24-bc51-1869752c9f82 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:47.432841 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85ba60-d5d8-4a24-bc51-1869752c9f82 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:47.433634 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85ba60-d5d8-4a24-bc51-1869752c9f82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:47.434006 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85ba60-d5d8-4a24-bc51-1869752c9f82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:47.435440 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85ba60-d5d8-4a24-bc51-1869752c9f82 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:47.452790 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-b78886ce-d78c-4ac7-b969-3411e123d938 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:47.453002 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 437/857] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:47.453091 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 421/858] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:47.454531 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85ba60-d5d8-4a24-bc51-1869752c9f82 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:47.455719 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78886ce-d78c-4ac7-b969-3411e123d938 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:47.560135 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85ba60-d5d8-4a24-bc51-1869752c9f82 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:47.580220 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78886ce-d78c-4ac7-b969-3411e123d938 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:47.594843 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ab3a3-4edd-446b-8504-f6a3173c43a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:47.595865 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ab3a3-4edd-446b-8504-f6a3173c43a0 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:47.596289 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ab3a3-4edd-446b-8504-f6a3173c43a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:47.596778 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ab3a3-4edd-446b-8504-f6a3173c43a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:47.605123 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ab3a3-4edd-446b-8504-f6a3173c43a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:47.606758 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ab3a3-4edd-446b-8504-f6a3173c43a0 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:47.613988 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235d3d4-4fa3-486f-9852-a9e90024a5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:47.614621 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235d3d4-4fa3-486f-9852-a9e90024a5f0 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:47.614902 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235d3d4-4fa3-486f-9852-a9e90024a5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:47.615175 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235d3d4-4fa3-486f-9852-a9e90024a5f0 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:47.616019 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235d3d4-4fa3-486f-9852-a9e90024a5f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:47.616329 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235d3d4-4fa3-486f-9852-a9e90024a5f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:47.617753 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235d3d4-4fa3-486f-9852-a9e90024a5f0 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:47.623002 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-625ab3a3-4edd-446b-8504-f6a3173c43a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:47.624844 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 438/859] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:47.636705 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 422/860] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:47.636868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ab3a3-4edd-446b-8504-f6a3173c43a0 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:47.636947 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235d3d4-4fa3-486f-9852-a9e90024a5f0 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:47.748253 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235d3d4-4fa3-486f-9852-a9e90024a5f0 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:47.755422 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ab3a3-4edd-446b-8504-f6a3173c43a0 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:47.784717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6db108-9336-4b16-94cd-9095563a0b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:47.785912 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6db108-9336-4b16-94cd-9095563a0b21 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:47.786406 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6db108-9336-4b16-94cd-9095563a0b21 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:47.786921 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6db108-9336-4b16-94cd-9095563a0b21 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:47.796558 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6db108-9336-4b16-94cd-9095563a0b21 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:47.798615 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6db108-9336-4b16-94cd-9095563a0b21 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:47.799604 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237e6c7-5f5a-4a43-842e-ae35f2fac11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:47.800262 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237e6c7-5f5a-4a43-842e-ae35f2fac11c None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:47.800541 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237e6c7-5f5a-4a43-842e-ae35f2fac11c None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:47.801041 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237e6c7-5f5a-4a43-842e-ae35f2fac11c None admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:47.801823 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237e6c7-5f5a-4a43-842e-ae35f2fac11c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:47.802131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237e6c7-5f5a-4a43-842e-ae35f2fac11c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:47.803742 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237e6c7-5f5a-4a43-842e-ae35f2fac11c None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:47.819795 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-3c6db108-9336-4b16-94cd-9095563a0b21 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 13:00:47.821089 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 439/861] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:47.822019 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 423/862] 10.222.0.52 () {56 vars in 1117 bytes} [Tue Mar 8 13:00:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:47.824780 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237e6c7-5f5a-4a43-842e-ae35f2fac11c None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:47.827744 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6db108-9336-4b16-94cd-9095563a0b21 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:47.926842 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6db108-9336-4b16-94cd-9095563a0b21 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:47.934068 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237e6c7-5f5a-4a43-842e-ae35f2fac11c None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:47.962076 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af620c3f-ea08-400f-b02a-ab63f7bf1c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:47.962902 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af620c3f-ea08-400f-b02a-ab63f7bf1c2e None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:47.963321 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af620c3f-ea08-400f-b02a-ab63f7bf1c2e None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:47.963690 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af620c3f-ea08-400f-b02a-ab63f7bf1c2e None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:47.964733 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af620c3f-ea08-400f-b02a-ab63f7bf1c2e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:47.965182 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af620c3f-ea08-400f-b02a-ab63f7bf1c2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:47.966801 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af620c3f-ea08-400f-b02a-ab63f7bf1c2e None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:47.969777 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c90b6c-5177-458c-848a-8c825262874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:47.970683 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c90b6c-5177-458c-848a-8c825262874f None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:47.971188 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c90b6c-5177-458c-848a-8c825262874f None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:47.971658 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c90b6c-5177-458c-848a-8c825262874f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:47.972732 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c90b6c-5177-458c-848a-8c825262874f None admin] RBAC: Adding query filter params (role.id=f9ec85924a914e078096b38cae4e6caa, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=f375d86747d248fa95f487b073d92d83) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:47.973259 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c90b6c-5177-458c-848a-8c825262874f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:47.974914 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c90b6c-5177-458c-848a-8c825262874f None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:47.986456 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 440/864] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:00:47 2022] GET /identity/v3/role_assignments?user.id=f375d86747d248fa95f487b073d92d83&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=f9ec85924a914e078096b38cae4e6caa => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:47.989612 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 424/864] 10.222.0.52 () {56 vars in 1149 bytes} [Tue Mar 8 13:00:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:47.991325 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c90b6c-5177-458c-848a-8c825262874f None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:48.084337 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0769c-a3ef-44fc-bc57-f1b8d69efde5 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:48.085141 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0769c-a3ef-44fc-bc57-f1b8d69efde5 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:48.089906 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0769c-a3ef-44fc-bc57-f1b8d69efde5 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:48.089906 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 425/865] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:00:48.093288 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a22b71-ed86-4649-90ab-07031926a7af None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:48.093573 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a22b71-ed86-4649-90ab-07031926a7af None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:48.093852 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a22b71-ed86-4649-90ab-07031926a7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:48.103543 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c90b6c-5177-458c-848a-8c825262874f None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:48.114793 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-52a22b71-ed86-4649-90ab-07031926a7af None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:48.117105 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-52a22b71-ed86-4649-90ab-07031926a7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:48.142118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fb7ec-475a-4191-9a41-2e6d44f0af1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:48.143192 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fb7ec-475a-4191-9a41-2e6d44f0af1a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:48.143694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fb7ec-475a-4191-9a41-2e6d44f0af1a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:48.144177 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fb7ec-475a-4191-9a41-2e6d44f0af1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:48.211689 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 426/866] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:00:48.224388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fb7ec-475a-4191-9a41-2e6d44f0af1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:48.226562 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fb7ec-475a-4191-9a41-2e6d44f0af1a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:48.236851 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a22b71-ed86-4649-90ab-07031926a7af None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:48.353140 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a22b71-ed86-4649-90ab-07031926a7af None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:48.365382 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 441/867] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:00:47 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:00:48.370530 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fb7ec-475a-4191-9a41-2e6d44f0af1a None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:48.395488 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360015ec-c974-461e-b311-d59839ad48f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:48.396589 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360015ec-c974-461e-b311-d59839ad48f3 None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:48.398104 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360015ec-c974-461e-b311-d59839ad48f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:48.398899 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360015ec-c974-461e-b311-d59839ad48f3 None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:48.399975 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360015ec-c974-461e-b311-d59839ad48f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:48.402369 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360015ec-c974-461e-b311-d59839ad48f3 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:48.468992 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fb7ec-475a-4191-9a41-2e6d44f0af1a None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:48.481840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 427/868] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 13:00:48 2022] POST /identity/v3/services => generated 269 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:00:48.518026 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1d276-9411-4a24-b9e8-14fbb7a9c09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:48.518893 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1d276-9411-4a24-b9e8-14fbb7a9c09a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:48.519182 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1d276-9411-4a24-b9e8-14fbb7a9c09a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:48.519519 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1d276-9411-4a24-b9e8-14fbb7a9c09a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:48.533087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1d276-9411-4a24-b9e8-14fbb7a9c09a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:48.534698 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1d276-9411-4a24-b9e8-14fbb7a9c09a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:48.562743 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-e3b1d276-9411-4a24-b9e8-14fbb7a9c09a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:48.564565 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 442/869] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:48.575144 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360015ec-c974-461e-b311-d59839ad48f3 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:48.703684 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360015ec-c974-461e-b311-d59839ad48f3 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:48.740596 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a27a5d-22aa-454d-9af7-9e589d4590b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:48.741850 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a27a5d-22aa-454d-9af7-9e589d4590b5 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:48.742286 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a27a5d-22aa-454d-9af7-9e589d4590b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:48.742566 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a27a5d-22aa-454d-9af7-9e589d4590b5 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:48.743305 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a27a5d-22aa-454d-9af7-9e589d4590b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:48.743610 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a27a5d-22aa-454d-9af7-9e589d4590b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:48.745035 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a27a5d-22aa-454d-9af7-9e589d4590b5 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:48.758124 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 428/870] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:48.763581 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1d276-9411-4a24-b9e8-14fbb7a9c09a None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:48.865466 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1d276-9411-4a24-b9e8-14fbb7a9c09a None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:48.902357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0555b9-20e1-43dc-bd38-c79f61327f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:48.903160 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0555b9-20e1-43dc-bd38-c79f61327f7e None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:48.903441 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0555b9-20e1-43dc-bd38-c79f61327f7e None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:48.903717 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0555b9-20e1-43dc-bd38-c79f61327f7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:48.910837 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0555b9-20e1-43dc-bd38-c79f61327f7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:48.912306 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0555b9-20e1-43dc-bd38-c79f61327f7e None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:48.925695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-fc0555b9-20e1-43dc-bd38-c79f61327f7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:48.927186 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 443/871] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:48.933568 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a27a5d-22aa-454d-9af7-9e589d4590b5 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:49.033016 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a27a5d-22aa-454d-9af7-9e589d4590b5 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:49.054262 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b230be-d054-4f5b-bebe-a96b08199ae6 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:49.054557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b230be-d054-4f5b-bebe-a96b08199ae6 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:49.054816 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b230be-d054-4f5b-bebe-a96b08199ae6 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:49.060289 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 444/872] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:49.061678 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd0190-d1b4-44c9-8cca-1454aa8df0bf None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:49.061963 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd0190-d1b4-44c9-8cca-1454aa8df0bf None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:49.062233 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd0190-d1b4-44c9-8cca-1454aa8df0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:49.066916 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a0f2a-7dd4-4fd1-98fa-8a685979aea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:49.067572 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a0f2a-7dd4-4fd1-98fa-8a685979aea9 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:49.067903 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a0f2a-7dd4-4fd1-98fa-8a685979aea9 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:49.068185 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a0f2a-7dd4-4fd1-98fa-8a685979aea9 None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:49.069617 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a0f2a-7dd4-4fd1-98fa-8a685979aea9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:49.069926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a0f2a-7dd4-4fd1-98fa-8a685979aea9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:49.071369 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a0f2a-7dd4-4fd1-98fa-8a685979aea9 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:49.080197 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-8efd0190-d1b4-44c9-8cca-1454aa8df0bf None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:49.081721 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-8efd0190-d1b4-44c9-8cca-1454aa8df0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:49.083405 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 429/873] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:49.089515 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a0f2a-7dd4-4fd1-98fa-8a685979aea9 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:49.164768 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 445/874] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:49 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:00:49.183559 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd0190-d1b4-44c9-8cca-1454aa8df0bf None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:49.198182 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a0f2a-7dd4-4fd1-98fa-8a685979aea9 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:49.232556 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33036d3-3a5d-41eb-8455-7be153770dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:49.233253 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33036d3-3a5d-41eb-8455-7be153770dda None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:49.233523 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33036d3-3a5d-41eb-8455-7be153770dda None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:49.233795 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33036d3-3a5d-41eb-8455-7be153770dda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:49.234806 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33036d3-3a5d-41eb-8455-7be153770dda None admin] RBAC: Adding query filter params (role.id=fe0e7f0760f74b09b441426d672df700, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=556058de7b9f48b8a10188ec64496e72) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:49.235119 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33036d3-3a5d-41eb-8455-7be153770dda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:49.236561 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33036d3-3a5d-41eb-8455-7be153770dda None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:49.252703 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 430/875] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:00:49 2022] GET /identity/v3/role_assignments?user.id=556058de7b9f48b8a10188ec64496e72&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=fe0e7f0760f74b09b441426d672df700 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:49.313646 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd0190-d1b4-44c9-8cca-1454aa8df0bf None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:49.401579 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a407a-ac49-439c-aaa0-f5a239e1444d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:49.402264 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a407a-ac49-439c-aaa0-f5a239e1444d None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:49.402540 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a407a-ac49-439c-aaa0-f5a239e1444d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:49.402811 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a407a-ac49-439c-aaa0-f5a239e1444d None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:49.403556 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a407a-ac49-439c-aaa0-f5a239e1444d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:49.404992 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a407a-ac49-439c-aaa0-f5a239e1444d None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:49.532868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 446/876] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 13:00:49 2022] POST /identity/v3/services => generated 251 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:00:50.488254 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b3bed-dd8b-4f2f-984e-7a193c527adc None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:50.488254 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b3bed-dd8b-4f2f-984e-7a193c527adc None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:50.488254 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b3bed-dd8b-4f2f-984e-7a193c527adc None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:50.489232 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 431/877] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:50.494976 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31899f-066b-4714-bae1-99b2e1f6bcc4 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:50.495803 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31899f-066b-4714-bae1-99b2e1f6bcc4 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:50.496301 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31899f-066b-4714-bae1-99b2e1f6bcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:50.514351 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-3d31899f-066b-4714-bae1-99b2e1f6bcc4 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:50.515873 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-3d31899f-066b-4714-bae1-99b2e1f6bcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:50.589264 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 447/878] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:00:50.612812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b3bed-dd8b-4f2f-984e-7a193c527adc None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:50.718242 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b3bed-dd8b-4f2f-984e-7a193c527adc None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:50.753849 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcb23c-562d-404a-a3a3-c1e519b7d2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:50.755060 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcb23c-562d-404a-a3a3-c1e519b7d2d2 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:50.755556 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcb23c-562d-404a-a3a3-c1e519b7d2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:50.756028 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcb23c-562d-404a-a3a3-c1e519b7d2d2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:50.757440 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcb23c-562d-404a-a3a3-c1e519b7d2d2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:50.759037 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcb23c-562d-404a-a3a3-c1e519b7d2d2 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:50.771277 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-6fbcb23c-562d-404a-a3a3-c1e519b7d2d2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 13:00:50.774002 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 432/879] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 13:00:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:50.780423 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31899f-066b-4714-bae1-99b2e1f6bcc4 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:50.880763 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31899f-066b-4714-bae1-99b2e1f6bcc4 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:50.915604 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390b49b-31a3-42f7-b511-47e007ca2a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:50.916618 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390b49b-31a3-42f7-b511-47e007ca2a95 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:50.917129 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390b49b-31a3-42f7-b511-47e007ca2a95 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:50.917599 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390b49b-31a3-42f7-b511-47e007ca2a95 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:50.918509 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390b49b-31a3-42f7-b511-47e007ca2a95 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:50.919010 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390b49b-31a3-42f7-b511-47e007ca2a95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:50.920597 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390b49b-31a3-42f7-b511-47e007ca2a95 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:50.925801 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 448/880] 10.222.0.52 () {56 vars in 1122 bytes} [Tue Mar 8 13:00:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:50.932225 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcb23c-562d-404a-a3a3-c1e519b7d2d2 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:50.968963 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c6f26-a529-44e9-b9bb-e8094fb977cc None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:50.969276 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c6f26-a529-44e9-b9bb-e8094fb977cc None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:50.969521 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c6f26-a529-44e9-b9bb-e8094fb977cc None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:50.972471 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 449/881] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:00:50.976571 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc8763-c8e8-4a41-9a55-cc5760a825ce None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:50.976887 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc8763-c8e8-4a41-9a55-cc5760a825ce None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:50.977161 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc8763-c8e8-4a41-9a55-cc5760a825ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:50.994814 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-d0dc8763-c8e8-4a41-9a55-cc5760a825ce None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:50.996844 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-d0dc8763-c8e8-4a41-9a55-cc5760a825ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:51.044441 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcb23c-562d-404a-a3a3-c1e519b7d2d2 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:51.072788 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 450/882] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:00:51.081861 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bae06-77f3-4ec3-9637-1835e418abe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:51.082712 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bae06-77f3-4ec3-9637-1835e418abe3 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:51.083139 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bae06-77f3-4ec3-9637-1835e418abe3 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:51.083557 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bae06-77f3-4ec3-9637-1835e418abe3 None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:51.084987 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71bae06-77f3-4ec3-9637-1835e418abe3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:51.085445 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71bae06-77f3-4ec3-9637-1835e418abe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:51.086994 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71bae06-77f3-4ec3-9637-1835e418abe3 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:51.088993 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc8763-c8e8-4a41-9a55-cc5760a825ce None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:51.093346 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 433/883] 10.222.0.52 () {56 vars in 1122 bytes} [Tue Mar 8 13:00:50 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:51.213766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc8763-c8e8-4a41-9a55-cc5760a825ce None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:51.255478 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af7e35-d79e-4b32-bff2-c6e7bc1d5bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:51.256934 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7e35-d79e-4b32-bff2-c6e7bc1d5bda None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:51.257218 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7e35-d79e-4b32-bff2-c6e7bc1d5bda None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:51.257517 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7e35-d79e-4b32-bff2-c6e7bc1d5bda None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:51.258163 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af7e35-d79e-4b32-bff2-c6e7bc1d5bda None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:51.259575 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af7e35-d79e-4b32-bff2-c6e7bc1d5bda None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:51.272414 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-18af7e35-d79e-4b32-bff2-c6e7bc1d5bda None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 08 13:00:51.274037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 451/884] 10.222.0.52 () {56 vars in 1132 bytes} [Tue Mar 8 13:00:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:51.282207 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bae06-77f3-4ec3-9637-1835e418abe3 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:51.390038 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bae06-77f3-4ec3-9637-1835e418abe3 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:51.424692 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35262ed0-fd09-4cbc-b84e-a37914b2c34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:51.425416 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35262ed0-fd09-4cbc-b84e-a37914b2c34f None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:51.425702 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35262ed0-fd09-4cbc-b84e-a37914b2c34f None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:51.425973 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35262ed0-fd09-4cbc-b84e-a37914b2c34f None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:51.426685 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35262ed0-fd09-4cbc-b84e-a37914b2c34f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:51.426989 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35262ed0-fd09-4cbc-b84e-a37914b2c34f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:51.428684 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35262ed0-fd09-4cbc-b84e-a37914b2c34f None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:51.433774 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 434/885] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 13:00:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:51.442034 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af7e35-d79e-4b32-bff2-c6e7bc1d5bda None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:51.546372 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af7e35-d79e-4b32-bff2-c6e7bc1d5bda None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:51.579688 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1656f2-f497-4e52-8f37-1753e8f64f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:51.580356 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1656f2-f497-4e52-8f37-1753e8f64f27 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:51.580637 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1656f2-f497-4e52-8f37-1753e8f64f27 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:51.580939 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1656f2-f497-4e52-8f37-1753e8f64f27 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:51.581645 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1656f2-f497-4e52-8f37-1753e8f64f27 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:51.581949 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1656f2-f497-4e52-8f37-1753e8f64f27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:51.583326 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1656f2-f497-4e52-8f37-1753e8f64f27 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:51.588748 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 452/886] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 13:00:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:51.594647 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35262ed0-fd09-4cbc-b84e-a37914b2c34f None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:51.706066 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35262ed0-fd09-4cbc-b84e-a37914b2c34f None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:51.739383 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9746f0-2ef3-4c4f-a34a-7b35b978392c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:51.740044 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9746f0-2ef3-4c4f-a34a-7b35b978392c None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:51.740333 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9746f0-2ef3-4c4f-a34a-7b35b978392c None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:51.741251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9746f0-2ef3-4c4f-a34a-7b35b978392c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:51.742179 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9746f0-2ef3-4c4f-a34a-7b35b978392c None admin] RBAC: Adding query filter params (interface=public, service_id=c4566db717df47298679451899af5b3f, region_id=RegionOne) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:51.742523 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9746f0-2ef3-4c4f-a34a-7b35b978392c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:51.743919 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9746f0-2ef3-4c4f-a34a-7b35b978392c None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:51.749436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 435/887] 10.222.0.52 () {56 vars in 1251 bytes} [Tue Mar 8 13:00:51 2022] GET /identity/v3/endpoints?service_id=c4566db717df47298679451899af5b3f&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:51.754961 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1656f2-f497-4e52-8f37-1753e8f64f27 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:51.871764 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1656f2-f497-4e52-8f37-1753e8f64f27 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:51.905924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b85003-f9b6-4ae0-887f-3a76c5d1e7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:51.906586 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b85003-f9b6-4ae0-887f-3a76c5d1e7ea None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:51.906861 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b85003-f9b6-4ae0-887f-3a76c5d1e7ea None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:51.907127 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b85003-f9b6-4ae0-887f-3a76c5d1e7ea None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:51.907803 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b85003-f9b6-4ae0-887f-3a76c5d1e7ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:51.909216 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b85003-f9b6-4ae0-887f-3a76c5d1e7ea None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:51.915297 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 453/888] 10.222.0.52 () {56 vars in 1087 bytes} [Tue Mar 8 13:00:51 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:00:51.986306 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f072596-5650-4106-8555-f4a6ee93e299 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:51.986941 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f072596-5650-4106-8555-f4a6ee93e299 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:51.987420 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f072596-5650-4106-8555-f4a6ee93e299 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:51.989350 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5eae0-1837-49cc-8a30-07590d02cfe0 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:51.989636 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5eae0-1837-49cc-8a30-07590d02cfe0 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:51.989919 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5eae0-1837-49cc-8a30-07590d02cfe0 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:51.990493 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 436/889] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:51.992285 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 454/890] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:00:51.996740 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277c3e8-1be5-4934-a0ad-f69909e6643e None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:51.997355 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277c3e8-1be5-4934-a0ad-f69909e6643e None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:51.997836 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277c3e8-1be5-4934-a0ad-f69909e6643e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:51.998191 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f0d80-7c40-4792-8b6c-be86a227ec90 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:51.998714 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f0d80-7c40-4792-8b6c-be86a227ec90 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:51.999217 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f0d80-7c40-4792-8b6c-be86a227ec90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:52.016287 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-5277c3e8-1be5-4934-a0ad-f69909e6643e None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:52.017989 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-5277c3e8-1be5-4934-a0ad-f69909e6643e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:52.020713 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-e39f0d80-7c40-4792-8b6c-be86a227ec90 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:52.022529 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e39f0d80-7c40-4792-8b6c-be86a227ec90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:52.100752 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 455/891] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:00:52.111555 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 437/892] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:00:52.121021 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f0d80-7c40-4792-8b6c-be86a227ec90 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:52.136027 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277c3e8-1be5-4934-a0ad-f69909e6643e None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:52.233662 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f0d80-7c40-4792-8b6c-be86a227ec90 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:52.265303 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277c3e8-1be5-4934-a0ad-f69909e6643e None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:52.268880 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3fa87-042b-4aa0-8969-797bb6fe00d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:52.269790 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3fa87-042b-4aa0-8969-797bb6fe00d4 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:52.270168 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3fa87-042b-4aa0-8969-797bb6fe00d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:52.270536 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3fa87-042b-4aa0-8969-797bb6fe00d4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:52.271294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3fa87-042b-4aa0-8969-797bb6fe00d4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:52.273252 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3fa87-042b-4aa0-8969-797bb6fe00d4 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:52.284737 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-36f3fa87-042b-4aa0-8969-797bb6fe00d4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 08 13:00:52.286361 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 456/893] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 13:00:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:52.292850 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3fa87-042b-4aa0-8969-797bb6fe00d4 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:52.305818 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee7993-2fb7-4272-828f-309ef7b09069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:52.307208 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee7993-2fb7-4272-828f-309ef7b09069 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:52.307495 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee7993-2fb7-4272-828f-309ef7b09069 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:52.307770 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee7993-2fb7-4272-828f-309ef7b09069 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:52.321566 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee7993-2fb7-4272-828f-309ef7b09069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:52.331502 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-ffee7993-2fb7-4272-828f-309ef7b09069 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 13:00:52.338390 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 438/894] 10.222.0.52 () {56 vars in 1120 bytes} [Tue Mar 8 13:00:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:52.339277 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee7993-2fb7-4272-828f-309ef7b09069 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:52.404853 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3fa87-042b-4aa0-8969-797bb6fe00d4 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:52.449156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0225b-356e-4ea6-99be-133769adf056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:52.450323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0225b-356e-4ea6-99be-133769adf056 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:52.450779 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0225b-356e-4ea6-99be-133769adf056 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:52.451197 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0225b-356e-4ea6-99be-133769adf056 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:52.452038 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee7993-2fb7-4272-828f-309ef7b09069 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:52.452187 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0225b-356e-4ea6-99be-133769adf056 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:52.452408 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0225b-356e-4ea6-99be-133769adf056 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:52.453917 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0225b-356e-4ea6-99be-133769adf056 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:52.464358 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 457/895] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 13:00:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:52.465398 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0225b-356e-4ea6-99be-133769adf056 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:52.491683 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c177081-b897-4635-99c6-de1bbcae1658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:52.492746 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c177081-b897-4635-99c6-de1bbcae1658 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:52.493307 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c177081-b897-4635-99c6-de1bbcae1658 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:52.493777 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c177081-b897-4635-99c6-de1bbcae1658 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:52.494759 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c177081-b897-4635-99c6-de1bbcae1658 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:52.495297 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c177081-b897-4635-99c6-de1bbcae1658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:52.496898 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c177081-b897-4635-99c6-de1bbcae1658 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:52.509781 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 439/896] 10.222.0.52 () {56 vars in 1115 bytes} [Tue Mar 8 13:00:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:52.510909 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c177081-b897-4635-99c6-de1bbcae1658 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:52.585830 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0225b-356e-4ea6-99be-133769adf056 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:52.610427 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c177081-b897-4635-99c6-de1bbcae1658 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:52.628558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d8654-9a09-47c3-b5e8-e5151fb0cb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:52.629258 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d8654-9a09-47c3-b5e8-e5151fb0cb80 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:52.629547 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d8654-9a09-47c3-b5e8-e5151fb0cb80 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:52.630092 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d8654-9a09-47c3-b5e8-e5151fb0cb80 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:52.630813 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d8654-9a09-47c3-b5e8-e5151fb0cb80 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:52.631176 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d8654-9a09-47c3-b5e8-e5151fb0cb80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:52.632550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d8654-9a09-47c3-b5e8-e5151fb0cb80 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:52.640695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 458/897] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 13:00:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:52.645314 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d8654-9a09-47c3-b5e8-e5151fb0cb80 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:52.653013 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce2f7e-259c-4961-8675-1be0fae7c38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:52.654010 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce2f7e-259c-4961-8675-1be0fae7c38c None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:52.654603 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce2f7e-259c-4961-8675-1be0fae7c38c None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:52.655071 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce2f7e-259c-4961-8675-1be0fae7c38c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:52.666364 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce2f7e-259c-4961-8675-1be0fae7c38c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:52.668079 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce2f7e-259c-4961-8675-1be0fae7c38c None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:52.684890 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-c4ce2f7e-259c-4961-8675-1be0fae7c38c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:52.690903 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 440/898] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:52.691958 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce2f7e-259c-4961-8675-1be0fae7c38c None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:52.758064 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d8654-9a09-47c3-b5e8-e5151fb0cb80 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:52.793007 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b331a-43a9-455a-8a7a-fb0510ce3ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:52.794079 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b331a-43a9-455a-8a7a-fb0510ce3ede None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:52.794575 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b331a-43a9-455a-8a7a-fb0510ce3ede None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:52.795080 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b331a-43a9-455a-8a7a-fb0510ce3ede None admin] PATH_INFO: `/v3/endpoints` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:52.796106 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b331a-43a9-455a-8a7a-fb0510ce3ede None admin] RBAC: Adding query filter params (interface=public, service_id=f6816b844d034048b3b3cfbd88358f77, region_id=RegionOne) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:52.796636 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b331a-43a9-455a-8a7a-fb0510ce3ede None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:52.798324 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b331a-43a9-455a-8a7a-fb0510ce3ede None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:52.808690 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce2f7e-259c-4961-8675-1be0fae7c38c None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:52.809258 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 459/899] 10.222.0.52 () {56 vars in 1251 bytes} [Tue Mar 8 13:00:52 2022] GET /identity/v3/endpoints?service_id=f6816b844d034048b3b3cfbd88358f77&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:52.811007 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b331a-43a9-455a-8a7a-fb0510ce3ede None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:52.847659 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74445f2-efaf-4c17-ab2e-045dba20e0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:52.848330 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74445f2-efaf-4c17-ab2e-045dba20e0bf None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:52.848609 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74445f2-efaf-4c17-ab2e-045dba20e0bf None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:52.848940 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74445f2-efaf-4c17-ab2e-045dba20e0bf None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:52.849653 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74445f2-efaf-4c17-ab2e-045dba20e0bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:52.850536 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74445f2-efaf-4c17-ab2e-045dba20e0bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:52.852126 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74445f2-efaf-4c17-ab2e-045dba20e0bf None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:52.871756 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 441/900] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:52.873061 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74445f2-efaf-4c17-ab2e-045dba20e0bf None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:52.924640 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b331a-43a9-455a-8a7a-fb0510ce3ede None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:52.962024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dfc62-1d52-4187-94be-369ebdbc0321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:52.962712 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dfc62-1d52-4187-94be-369ebdbc0321 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:52.962981 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dfc62-1d52-4187-94be-369ebdbc0321 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:52.963256 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dfc62-1d52-4187-94be-369ebdbc0321 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:52.963943 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dfc62-1d52-4187-94be-369ebdbc0321 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:52.965353 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dfc62-1d52-4187-94be-369ebdbc0321 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:52.981171 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 460/901] 10.222.0.52 () {56 vars in 1087 bytes} [Tue Mar 8 13:00:52 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:00:53.006554 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74445f2-efaf-4c17-ab2e-045dba20e0bf None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:53.046129 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b376c1-0c88-4d6e-8f8d-6616b200cad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:53.047334 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b376c1-0c88-4d6e-8f8d-6616b200cad6 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:53.047811 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b376c1-0c88-4d6e-8f8d-6616b200cad6 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:53.048274 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b376c1-0c88-4d6e-8f8d-6616b200cad6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:53.057059 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b376c1-0c88-4d6e-8f8d-6616b200cad6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:53.058942 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b376c1-0c88-4d6e-8f8d-6616b200cad6 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:53.075665 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-16b376c1-0c88-4d6e-8f8d-6616b200cad6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 13:00:53.077679 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 442/902] 10.222.0.52 () {56 vars in 1117 bytes} [Tue Mar 8 13:00:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:53.084392 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dfc62-1d52-4187-94be-369ebdbc0321 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:53.193920 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dfc62-1d52-4187-94be-369ebdbc0321 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:53.228117 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffd05e-cade-4d6a-b138-b2a4a98b96c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:53.229235 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffd05e-cade-4d6a-b138-b2a4a98b96c1 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:53.229757 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffd05e-cade-4d6a-b138-b2a4a98b96c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:53.230240 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffd05e-cade-4d6a-b138-b2a4a98b96c1 None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:53.231261 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffd05e-cade-4d6a-b138-b2a4a98b96c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:53.231777 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffd05e-cade-4d6a-b138-b2a4a98b96c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:53.233453 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffd05e-cade-4d6a-b138-b2a4a98b96c1 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:53.254731 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 461/903] 10.222.0.52 () {56 vars in 1149 bytes} [Tue Mar 8 13:00:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:53.261173 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b376c1-0c88-4d6e-8f8d-6616b200cad6 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:53.363178 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b376c1-0c88-4d6e-8f8d-6616b200cad6 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:53.398202 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffe470-8fdd-4a0c-b302-079ec9302c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:53.398854 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffe470-8fdd-4a0c-b302-079ec9302c9f None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:53.399131 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffe470-8fdd-4a0c-b302-079ec9302c9f None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:53.399407 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffe470-8fdd-4a0c-b302-079ec9302c9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:53.465860 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffe470-8fdd-4a0c-b302-079ec9302c9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:53.467223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffe470-8fdd-4a0c-b302-079ec9302c9f None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:53.564559 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 443/904] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:00:53 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:00:53.570571 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffd05e-cade-4d6a-b138-b2a4a98b96c1 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:53.656170 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbad15f-e659-4762-a3d7-79ff00b85b44 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:53.656691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbad15f-e659-4762-a3d7-79ff00b85b44 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:53.656773 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbad15f-e659-4762-a3d7-79ff00b85b44 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:53.658786 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 444/905] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:00:53.664474 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f68ef1-ba0b-40f6-ad1c-d024a37eb9f4 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:53.664787 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f68ef1-ba0b-40f6-ad1c-d024a37eb9f4 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:53.665072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f68ef1-ba0b-40f6-ad1c-d024a37eb9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:53.670032 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffd05e-cade-4d6a-b138-b2a4a98b96c1 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:53.684700 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-74f68ef1-ba0b-40f6-ad1c-d024a37eb9f4 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:53.686207 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-74f68ef1-ba0b-40f6-ad1c-d024a37eb9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:53.711156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc61173-c3c0-4e5a-8ed8-b6341d9950ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:53.712377 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc61173-c3c0-4e5a-8ed8-b6341d9950ff None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:53.712896 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc61173-c3c0-4e5a-8ed8-b6341d9950ff None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:53.713383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc61173-c3c0-4e5a-8ed8-b6341d9950ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:53.724223 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc61173-c3c0-4e5a-8ed8-b6341d9950ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:53.726667 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc61173-c3c0-4e5a-8ed8-b6341d9950ff None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:53.744301 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-bbc61173-c3c0-4e5a-8ed8-b6341d9950ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:53.746160 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 462/906] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:53.751634 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc61173-c3c0-4e5a-8ed8-b6341d9950ff None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:53.760851 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 445/907] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:00:53.788250 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f68ef1-ba0b-40f6-ad1c-d024a37eb9f4 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:53.877675 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc61173-c3c0-4e5a-8ed8-b6341d9950ff None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:53.890811 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f68ef1-ba0b-40f6-ad1c-d024a37eb9f4 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:53.928965 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973e7c9-60aa-4d0f-a99a-e694593e06c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:53.929723 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973e7c9-60aa-4d0f-a99a-e694593e06c4 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:53.930001 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973e7c9-60aa-4d0f-a99a-e694593e06c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:53.930270 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973e7c9-60aa-4d0f-a99a-e694593e06c4 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:53.930989 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973e7c9-60aa-4d0f-a99a-e694593e06c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:53.931292 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973e7c9-60aa-4d0f-a99a-e694593e06c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:53.932687 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973e7c9-60aa-4d0f-a99a-e694593e06c4 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:53.934662 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11078fc-e3e0-4680-8694-3986ff0b96a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:53.935340 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11078fc-e3e0-4680-8694-3986ff0b96a9 None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:53.935617 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11078fc-e3e0-4680-8694-3986ff0b96a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:53.935885 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11078fc-e3e0-4680-8694-3986ff0b96a9 None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:53.936609 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11078fc-e3e0-4680-8694-3986ff0b96a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:53.937999 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11078fc-e3e0-4680-8694-3986ff0b96a9 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:53.952701 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 463/908] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:53.957217 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973e7c9-60aa-4d0f-a99a-e694593e06c4 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:54.016928 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 446/909] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 13:00:53 2022] POST /identity/v3/services => generated 241 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:00:54.071633 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973e7c9-60aa-4d0f-a99a-e694593e06c4 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:54.114134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7e9bc-17ab-4b84-a30f-4136db2db005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:54.115852 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7e9bc-17ab-4b84-a30f-4136db2db005 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:54.116395 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7e9bc-17ab-4b84-a30f-4136db2db005 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:54.116988 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7e9bc-17ab-4b84-a30f-4136db2db005 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:54.124843 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7e9bc-17ab-4b84-a30f-4136db2db005 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:54.126696 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7e9bc-17ab-4b84-a30f-4136db2db005 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:54.143435 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-55f7e9bc-17ab-4b84-a30f-4136db2db005 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:54.145402 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 464/910] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:54.152688 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11078fc-e3e0-4680-8694-3986ff0b96a9 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:54.262734 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11078fc-e3e0-4680-8694-3986ff0b96a9 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:54.295844 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d48d16-d8cc-47dd-824e-c5df019c8807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:54.296423 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d48d16-d8cc-47dd-824e-c5df019c8807 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:54.296774 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d48d16-d8cc-47dd-824e-c5df019c8807 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:54.297045 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d48d16-d8cc-47dd-824e-c5df019c8807 None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:54.297832 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d48d16-d8cc-47dd-824e-c5df019c8807 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:54.298137 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d48d16-d8cc-47dd-824e-c5df019c8807 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:54.299562 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d48d16-d8cc-47dd-824e-c5df019c8807 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:54.312368 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 447/911] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:54.318984 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7e9bc-17ab-4b84-a30f-4136db2db005 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:54.339699 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a438e-ef90-4417-ad55-dd2f01883eb3 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:54.340033 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a438e-ef90-4417-ad55-dd2f01883eb3 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:54.340243 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a438e-ef90-4417-ad55-dd2f01883eb3 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:54.342331 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 448/912] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:00:54.347741 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a51d3a-8d9c-4f59-b225-9ee88459b805 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:54.348022 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a51d3a-8d9c-4f59-b225-9ee88459b805 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:54.348617 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a51d3a-8d9c-4f59-b225-9ee88459b805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:54.365789 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-08a51d3a-8d9c-4f59-b225-9ee88459b805 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:54.366999 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-08a51d3a-8d9c-4f59-b225-9ee88459b805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:54.433494 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 449/913] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:00:54.446742 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7e9bc-17ab-4b84-a30f-4136db2db005 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:54.456778 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a51d3a-8d9c-4f59-b225-9ee88459b805 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:54.487340 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf32d6f-965e-4646-92a5-159029bb7e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:54.488439 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf32d6f-965e-4646-92a5-159029bb7e62 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:54.488785 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf32d6f-965e-4646-92a5-159029bb7e62 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:54.489067 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf32d6f-965e-4646-92a5-159029bb7e62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:54.490220 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf32d6f-965e-4646-92a5-159029bb7e62 None admin] RBAC: Adding query filter params (role.id=f0c236d58c10498686f59d63c5bcaa3e, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=556058de7b9f48b8a10188ec64496e72) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:54.490589 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf32d6f-965e-4646-92a5-159029bb7e62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:54.492763 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf32d6f-965e-4646-92a5-159029bb7e62 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:54.499827 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 465/914] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:00:54 2022] GET /identity/v3/role_assignments?user.id=556058de7b9f48b8a10188ec64496e72&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=f0c236d58c10498686f59d63c5bcaa3e => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:54.573106 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a51d3a-8d9c-4f59-b225-9ee88459b805 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:54.609961 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdc283-7395-4d9d-9e5b-372feb770d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:54.610783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdc283-7395-4d9d-9e5b-372feb770d40 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:54.611060 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdc283-7395-4d9d-9e5b-372feb770d40 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:54.611385 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdc283-7395-4d9d-9e5b-372feb770d40 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:54.612048 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdc283-7395-4d9d-9e5b-372feb770d40 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:54.613475 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdc283-7395-4d9d-9e5b-372feb770d40 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:54.625901 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-f0bdc283-7395-4d9d-9e5b-372feb770d40 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 08 13:00:54.627544 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 450/915] 10.222.0.52 () {56 vars in 1132 bytes} [Tue Mar 8 13:00:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:54.633626 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf32d6f-965e-4646-92a5-159029bb7e62 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:54.739929 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf32d6f-965e-4646-92a5-159029bb7e62 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:54.781271 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003196d-fb83-49b3-adda-cf53d8d434a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:54.781933 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003196d-fb83-49b3-adda-cf53d8d434a7 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:54.782209 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003196d-fb83-49b3-adda-cf53d8d434a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:54.782475 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003196d-fb83-49b3-adda-cf53d8d434a7 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:54.783171 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003196d-fb83-49b3-adda-cf53d8d434a7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:54.783471 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003196d-fb83-49b3-adda-cf53d8d434a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:54.784852 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003196d-fb83-49b3-adda-cf53d8d434a7 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:54.790034 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 466/916] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 13:00:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:54.795509 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdc283-7395-4d9d-9e5b-372feb770d40 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:54.897777 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdc283-7395-4d9d-9e5b-372feb770d40 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:54.940418 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bf620-3212-467d-a5d1-ac1967413152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:54.940418 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bf620-3212-467d-a5d1-ac1967413152 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:54.940418 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bf620-3212-467d-a5d1-ac1967413152 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:54.940418 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bf620-3212-467d-a5d1-ac1967413152 None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:54.941024 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bf620-3212-467d-a5d1-ac1967413152 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:54.941024 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bf620-3212-467d-a5d1-ac1967413152 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:54.941024 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bf620-3212-467d-a5d1-ac1967413152 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:54.946342 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 451/917] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 13:00:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:54.951796 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003196d-fb83-49b3-adda-cf53d8d434a7 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:55.057074 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003196d-fb83-49b3-adda-cf53d8d434a7 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:55.091052 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e84c8-61bc-4ff7-90a5-b48dc9bbee88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:55.091716 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e84c8-61bc-4ff7-90a5-b48dc9bbee88 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:55.091992 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e84c8-61bc-4ff7-90a5-b48dc9bbee88 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:55.092265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e84c8-61bc-4ff7-90a5-b48dc9bbee88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:55.093036 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e84c8-61bc-4ff7-90a5-b48dc9bbee88 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:55.094392 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e84c8-61bc-4ff7-90a5-b48dc9bbee88 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:55.226049 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 467/918] 10.222.0.52 () {60 vars in 1144 bytes} [Tue Mar 8 13:00:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:00:55.392780 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0edd95-6fe0-4d13-8db7-1ab7ca8b6d79 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:55.393111 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0edd95-6fe0-4d13-8db7-1ab7ca8b6d79 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:55.393338 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0edd95-6fe0-4d13-8db7-1ab7ca8b6d79 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:55.395416 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 452/919] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:55.402094 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4552084-704d-4777-9ea3-7ff3b976fe65 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:55.402377 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4552084-704d-4777-9ea3-7ff3b976fe65 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:55.402655 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4552084-704d-4777-9ea3-7ff3b976fe65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:55.421623 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-f4552084-704d-4777-9ea3-7ff3b976fe65 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:55.422789 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f4552084-704d-4777-9ea3-7ff3b976fe65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:55.501558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 468/920] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:00:55.525041 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0edd95-6fe0-4d13-8db7-1ab7ca8b6d79 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:55.632155 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0edd95-6fe0-4d13-8db7-1ab7ca8b6d79 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:55.665056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3801f41-ec0c-4a7c-bc8e-d5484c39e8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:55.665877 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3801f41-ec0c-4a7c-bc8e-d5484c39e8aa None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:55.666158 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3801f41-ec0c-4a7c-bc8e-d5484c39e8aa None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:55.666429 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3801f41-ec0c-4a7c-bc8e-d5484c39e8aa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:55.667078 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3801f41-ec0c-4a7c-bc8e-d5484c39e8aa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:55.668455 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3801f41-ec0c-4a7c-bc8e-d5484c39e8aa None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:55.680216 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-b3801f41-ec0c-4a7c-bc8e-d5484c39e8aa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 08 13:00:55.681684 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 453/921] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 13:00:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:55.687562 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4552084-704d-4777-9ea3-7ff3b976fe65 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:55.795365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4552084-704d-4777-9ea3-7ff3b976fe65 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:55.830074 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853220e-3f84-4606-86e1-52045cc4a2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:55.830741 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853220e-3f84-4606-86e1-52045cc4a2c5 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:55.831023 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853220e-3f84-4606-86e1-52045cc4a2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:55.831295 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853220e-3f84-4606-86e1-52045cc4a2c5 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:55.831997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853220e-3f84-4606-86e1-52045cc4a2c5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:55.832298 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853220e-3f84-4606-86e1-52045cc4a2c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:55.833692 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853220e-3f84-4606-86e1-52045cc4a2c5 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:55.838862 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 469/922] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 13:00:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:55.844422 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3801f41-ec0c-4a7c-bc8e-d5484c39e8aa None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:55.954805 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3801f41-ec0c-4a7c-bc8e-d5484c39e8aa None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:55.988397 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e17af-5ca7-49f1-b04d-1516f08db190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:55.989088 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e17af-5ca7-49f1-b04d-1516f08db190 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:55.989372 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e17af-5ca7-49f1-b04d-1516f08db190 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:55.989651 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e17af-5ca7-49f1-b04d-1516f08db190 None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:55.991021 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e17af-5ca7-49f1-b04d-1516f08db190 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:55.991349 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e17af-5ca7-49f1-b04d-1516f08db190 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:55.992751 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e17af-5ca7-49f1-b04d-1516f08db190 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:55.998029 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 454/923] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 13:00:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:56.003652 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853220e-3f84-4606-86e1-52045cc4a2c5 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:56.106827 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853220e-3f84-4606-86e1-52045cc4a2c5 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:56.141427 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65def843-1932-4dda-9a69-1a32f2c48ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:56.142092 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65def843-1932-4dda-9a69-1a32f2c48ef3 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:56.142431 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65def843-1932-4dda-9a69-1a32f2c48ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:56.142709 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65def843-1932-4dda-9a69-1a32f2c48ef3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:56.143514 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65def843-1932-4dda-9a69-1a32f2c48ef3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:56.144909 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65def843-1932-4dda-9a69-1a32f2c48ef3 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:56.254550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 470/924] 10.222.0.52 () {60 vars in 1144 bytes} [Tue Mar 8 13:00:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:00:56.582932 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff1fee-140f-4b5d-9f95-5a6e4fc079bc None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:56.583282 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff1fee-140f-4b5d-9f95-5a6e4fc079bc None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:56.583500 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff1fee-140f-4b5d-9f95-5a6e4fc079bc None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:56.585872 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 455/925] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:56.591359 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850d8bb-634d-45c5-8270-492e69d06627 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:56.591653 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850d8bb-634d-45c5-8270-492e69d06627 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:56.591941 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850d8bb-634d-45c5-8270-492e69d06627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:56.611334 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-0850d8bb-634d-45c5-8270-492e69d06627 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:56.612591 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0850d8bb-634d-45c5-8270-492e69d06627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:56.687765 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 471/926] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:00:56.711080 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff1fee-140f-4b5d-9f95-5a6e4fc079bc None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:56.811850 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff1fee-140f-4b5d-9f95-5a6e4fc079bc None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:56.845330 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3002f4-ec8d-480f-b45d-658b849b9dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:56.846043 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3002f4-ec8d-480f-b45d-658b849b9dce None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:56.846317 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3002f4-ec8d-480f-b45d-658b849b9dce None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:56.846593 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3002f4-ec8d-480f-b45d-658b849b9dce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:56.847253 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3002f4-ec8d-480f-b45d-658b849b9dce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:56.848634 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3002f4-ec8d-480f-b45d-658b849b9dce None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:56.860453 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-8e3002f4-ec8d-480f-b45d-658b849b9dce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 13:00:56.861967 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 456/927] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 13:00:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:56.868123 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850d8bb-634d-45c5-8270-492e69d06627 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:56.979835 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850d8bb-634d-45c5-8270-492e69d06627 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:57.007455 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a84df-3c4e-416a-8a40-b404017eaee3 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:57.007765 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a84df-3c4e-416a-8a40-b404017eaee3 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:57.008020 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a84df-3c4e-416a-8a40-b404017eaee3 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:57.010123 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 457/928] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:57.013873 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ebd53-2b72-4993-bda2-3dbd499e36bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:57.014539 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ebd53-2b72-4993-bda2-3dbd499e36bb None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:57.014815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ebd53-2b72-4993-bda2-3dbd499e36bb None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:57.015087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ebd53-2b72-4993-bda2-3dbd499e36bb None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:57.015793 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ebd53-2b72-4993-bda2-3dbd499e36bb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:57.016096 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ebd53-2b72-4993-bda2-3dbd499e36bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:57.020088 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ebd53-2b72-4993-bda2-3dbd499e36bb None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:57.020214 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02651e39-55be-415a-9bd6-63404a462a6d None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:57.020214 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02651e39-55be-415a-9bd6-63404a462a6d None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:57.020214 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02651e39-55be-415a-9bd6-63404a462a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:57.023294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 472/929] 10.222.0.52 () {56 vars in 1122 bytes} [Tue Mar 8 13:00:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:57.028987 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ebd53-2b72-4993-bda2-3dbd499e36bb None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:57.038488 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-02651e39-55be-415a-9bd6-63404a462a6d None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:57.040055 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-02651e39-55be-415a-9bd6-63404a462a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:57.128761 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 458/930] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:00:57.148480 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ebd53-2b72-4993-bda2-3dbd499e36bb None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:57.153231 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02651e39-55be-415a-9bd6-63404a462a6d None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:57.184524 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a44523-4ead-40a8-8cfa-cda2448469fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:57.185269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44523-4ead-40a8-8cfa-cda2448469fe None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:57.185557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44523-4ead-40a8-8cfa-cda2448469fe None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:57.185835 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44523-4ead-40a8-8cfa-cda2448469fe None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:57.186547 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a44523-4ead-40a8-8cfa-cda2448469fe None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:57.186854 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a44523-4ead-40a8-8cfa-cda2448469fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:57.188295 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a44523-4ead-40a8-8cfa-cda2448469fe None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:57.197787 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 473/931] 10.222.0.52 () {56 vars in 1122 bytes} [Tue Mar 8 13:00:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:57.200574 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a44523-4ead-40a8-8cfa-cda2448469fe None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:57.272976 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02651e39-55be-415a-9bd6-63404a462a6d None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:57.315394 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a44523-4ead-40a8-8cfa-cda2448469fe None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:57.325440 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aea932-12dc-4a23-90af-068a2ae936a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:57.326529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aea932-12dc-4a23-90af-068a2ae936a9 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:57.326955 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aea932-12dc-4a23-90af-068a2ae936a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:57.327369 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aea932-12dc-4a23-90af-068a2ae936a9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:57.341535 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aea932-12dc-4a23-90af-068a2ae936a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:00:57.353244 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-c1aea932-12dc-4a23-90af-068a2ae936a9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 13:00:57.355529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 459/932] 10.222.0.52 () {56 vars in 1120 bytes} [Tue Mar 8 13:00:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:57.360951 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aea932-12dc-4a23-90af-068a2ae936a9 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:57.362107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460bb22-791f-4db6-97a9-c5a9f646d5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:57.362780 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460bb22-791f-4db6-97a9-c5a9f646d5f7 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:57.363118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460bb22-791f-4db6-97a9-c5a9f646d5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:57.363395 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460bb22-791f-4db6-97a9-c5a9f646d5f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:57.364251 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460bb22-791f-4db6-97a9-c5a9f646d5f7 None admin] RBAC: Adding query filter params (interface=public, service_id=7b918366233a44aa846b62f02e033818, region_id=RegionOne) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:57.364567 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460bb22-791f-4db6-97a9-c5a9f646d5f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:57.367236 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460bb22-791f-4db6-97a9-c5a9f646d5f7 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:57.372692 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 474/933] 10.222.0.52 () {56 vars in 1251 bytes} [Tue Mar 8 13:00:57 2022] GET /identity/v3/endpoints?service_id=7b918366233a44aa846b62f02e033818&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:57.377455 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460bb22-791f-4db6-97a9-c5a9f646d5f7 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:57.478350 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460bb22-791f-4db6-97a9-c5a9f646d5f7 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:57.488893 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aea932-12dc-4a23-90af-068a2ae936a9 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:57.515800 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9244b4-fd22-4974-8a9b-af4ebddcd9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:57.516815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9244b4-fd22-4974-8a9b-af4ebddcd9ae None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:57.517278 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9244b4-fd22-4974-8a9b-af4ebddcd9ae None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:57.517727 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9244b4-fd22-4974-8a9b-af4ebddcd9ae None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:57.518587 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9244b4-fd22-4974-8a9b-af4ebddcd9ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:57.520152 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9244b4-fd22-4974-8a9b-af4ebddcd9ae None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:57.527574 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 475/934] 10.222.0.52 () {56 vars in 1087 bytes} [Tue Mar 8 13:00:57 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:00:57.532261 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7d0a3-746d-4246-95fd-db9ab8474d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:57.533230 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7d0a3-746d-4246-95fd-db9ab8474d6a None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:57.533698 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7d0a3-746d-4246-95fd-db9ab8474d6a None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:57.534180 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7d0a3-746d-4246-95fd-db9ab8474d6a None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:57.535300 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7d0a3-746d-4246-95fd-db9ab8474d6a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:57.535801 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7d0a3-746d-4246-95fd-db9ab8474d6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:57.538097 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7d0a3-746d-4246-95fd-db9ab8474d6a None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:57.547929 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 460/935] 10.222.0.52 () {56 vars in 1115 bytes} [Tue Mar 8 13:00:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:57.554404 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9244b4-fd22-4974-8a9b-af4ebddcd9ae None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:57.670593 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327dbb7-b67e-4ac6-8d46-cacf2c0f675d None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:57.670926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327dbb7-b67e-4ac6-8d46-cacf2c0f675d None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:57.671157 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327dbb7-b67e-4ac6-8d46-cacf2c0f675d None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:57.677252 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 461/936] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:00:57.679830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3b4ea-3cee-4f76-8d0f-1b95ea143f67 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:57.680119 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3b4ea-3cee-4f76-8d0f-1b95ea143f67 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:57.680396 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3b4ea-3cee-4f76-8d0f-1b95ea143f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:57.687529 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9244b4-fd22-4974-8a9b-af4ebddcd9ae None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:57.698941 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-b1a3b4ea-3cee-4f76-8d0f-1b95ea143f67 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:57.700160 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b1a3b4ea-3cee-4f76-8d0f-1b95ea143f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:57.734154 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4d9c9-8ccd-444e-b6d4-eb33d2a576cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:57.734874 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4d9c9-8ccd-444e-b6d4-eb33d2a576cd None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:57.735155 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4d9c9-8ccd-444e-b6d4-eb33d2a576cd None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:57.736097 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4d9c9-8ccd-444e-b6d4-eb33d2a576cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:57.747864 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4d9c9-8ccd-444e-b6d4-eb33d2a576cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:57.749347 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4d9c9-8ccd-444e-b6d4-eb33d2a576cd None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:57.768826 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-20c4d9c9-8ccd-444e-b6d4-eb33d2a576cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:57.771178 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 476/937] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:57.777924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4d9c9-8ccd-444e-b6d4-eb33d2a576cd None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:57.784756 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 462/938] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:00:57.806874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3b4ea-3cee-4f76-8d0f-1b95ea143f67 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:57.906493 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4d9c9-8ccd-444e-b6d4-eb33d2a576cd None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:57.924629 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3b4ea-3cee-4f76-8d0f-1b95ea143f67 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:57.942485 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b7abe-9e86-46ed-b047-5a7c61e00203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:57.943765 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b7abe-9e86-46ed-b047-5a7c61e00203 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:57.944251 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b7abe-9e86-46ed-b047-5a7c61e00203 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:57.944677 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b7abe-9e86-46ed-b047-5a7c61e00203 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:57.945443 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b7abe-9e86-46ed-b047-5a7c61e00203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:57.945745 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b7abe-9e86-46ed-b047-5a7c61e00203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:57.947141 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b7abe-9e86-46ed-b047-5a7c61e00203 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:57.960985 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 477/939] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:57.965808 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b7abe-9e86-46ed-b047-5a7c61e00203 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:57.967627 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea8c80-1fc2-43b5-80e5-9602066930aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:57.968703 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea8c80-1fc2-43b5-80e5-9602066930aa None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:57.969206 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea8c80-1fc2-43b5-80e5-9602066930aa None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:57.969677 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea8c80-1fc2-43b5-80e5-9602066930aa None admin] PATH_INFO: `/v3/services/compute` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:57.970836 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea8c80-1fc2-43b5-80e5-9602066930aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:57.973643 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea8c80-1fc2-43b5-80e5-9602066930aa None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:57.987175 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-68ea8c80-1fc2-43b5-80e5-9602066930aa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 08 13:00:57.994390 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 463/940] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:57.995919 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea8c80-1fc2-43b5-80e5-9602066930aa None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:58.075362 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b7abe-9e86-46ed-b047-5a7c61e00203 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:58.097130 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea8c80-1fc2-43b5-80e5-9602066930aa None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:58.109442 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145da40-b642-4207-bde3-1a990048f4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:58.110312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145da40-b642-4207-bde3-1a990048f4b9 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:58.110652 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145da40-b642-4207-bde3-1a990048f4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:58.110868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145da40-b642-4207-bde3-1a990048f4b9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:58.118808 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145da40-b642-4207-bde3-1a990048f4b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:58.120275 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145da40-b642-4207-bde3-1a990048f4b9 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:58.135712 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22eea6-d040-4762-8b91-f991c456ed39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:58.136014 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-c145da40-b642-4207-bde3-1a990048f4b9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 13:00:58.136890 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22eea6-d040-4762-8b91-f991c456ed39 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:58.137386 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22eea6-d040-4762-8b91-f991c456ed39 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:58.137878 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22eea6-d040-4762-8b91-f991c456ed39 None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:58.138918 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22eea6-d040-4762-8b91-f991c456ed39 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:58.139438 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22eea6-d040-4762-8b91-f991c456ed39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:58.141048 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22eea6-d040-4762-8b91-f991c456ed39 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:58.141972 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 478/941] 10.222.0.52 () {56 vars in 1117 bytes} [Tue Mar 8 13:00:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:58.142820 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145da40-b642-4207-bde3-1a990048f4b9 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:58.152507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 464/942] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 13:00:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:58.154152 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22eea6-d040-4762-8b91-f991c456ed39 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:58.243761 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145da40-b642-4207-bde3-1a990048f4b9 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:58.254479 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22eea6-d040-4762-8b91-f991c456ed39 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:58.287532 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff48edd-f0ec-4e9d-ae88-fea8433489dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:58.288265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff48edd-f0ec-4e9d-ae88-fea8433489dc None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:58.288508 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff48edd-f0ec-4e9d-ae88-fea8433489dc None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:58.289100 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff48edd-f0ec-4e9d-ae88-fea8433489dc None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:58.290002 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff48edd-f0ec-4e9d-ae88-fea8433489dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:58.290317 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff48edd-f0ec-4e9d-ae88-fea8433489dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:58.292882 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff48edd-f0ec-4e9d-ae88-fea8433489dc None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:58.296234 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b304870-52b6-4135-86b7-963f76d4eaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:58.297174 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b304870-52b6-4135-86b7-963f76d4eaba None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:58.297712 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b304870-52b6-4135-86b7-963f76d4eaba None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:58.298186 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b304870-52b6-4135-86b7-963f76d4eaba None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:58.299156 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b304870-52b6-4135-86b7-963f76d4eaba None admin] RBAC: Adding query filter params (type=compute) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:58.299658 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b304870-52b6-4135-86b7-963f76d4eaba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:58.301272 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b304870-52b6-4135-86b7-963f76d4eaba None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:58.311476 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 465/943] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 13:00:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:58.321946 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 479/944] 10.222.0.52 () {56 vars in 1149 bytes} [Tue Mar 8 13:00:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:00:58.329820 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b304870-52b6-4135-86b7-963f76d4eaba None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:58.452929 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b304870-52b6-4135-86b7-963f76d4eaba None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:58.490993 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40601512-3387-408f-8109-d0f0a6c05a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:58.492202 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40601512-3387-408f-8109-d0f0a6c05a6f None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:58.492743 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40601512-3387-408f-8109-d0f0a6c05a6f None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:58.493221 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40601512-3387-408f-8109-d0f0a6c05a6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:58.504964 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40601512-3387-408f-8109-d0f0a6c05a6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:58.506840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40601512-3387-408f-8109-d0f0a6c05a6f None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:58.524461 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-40601512-3387-408f-8109-d0f0a6c05a6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:00:58.526599 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 466/945] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:00:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:58.531865 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff48edd-f0ec-4e9d-ae88-fea8433489dc None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:58.633851 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff48edd-f0ec-4e9d-ae88-fea8433489dc None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:58.669064 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900ce71-575e-41d2-b54c-9ff213266c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:58.670146 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900ce71-575e-41d2-b54c-9ff213266c7b None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:58.670694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900ce71-575e-41d2-b54c-9ff213266c7b None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:58.671168 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900ce71-575e-41d2-b54c-9ff213266c7b None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:58.672076 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900ce71-575e-41d2-b54c-9ff213266c7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:58.672578 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900ce71-575e-41d2-b54c-9ff213266c7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:58.674172 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900ce71-575e-41d2-b54c-9ff213266c7b None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:58.690145 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 480/946] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:58.695709 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40601512-3387-408f-8109-d0f0a6c05a6f None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:58.751232 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbda7f-24df-4a6e-8308-5eacf6949a76 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:58.751548 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbda7f-24df-4a6e-8308-5eacf6949a76 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:58.751790 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbda7f-24df-4a6e-8308-5eacf6949a76 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:58.753845 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 481/947] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:58.759674 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf1b3a-0a7f-4925-98ee-a2dc57b26a7d None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:58.759891 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf1b3a-0a7f-4925-98ee-a2dc57b26a7d None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:58.760174 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf1b3a-0a7f-4925-98ee-a2dc57b26a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:58.780847 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-2bdf1b3a-0a7f-4925-98ee-a2dc57b26a7d None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:58.782497 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-2bdf1b3a-0a7f-4925-98ee-a2dc57b26a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:00:58.807489 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40601512-3387-408f-8109-d0f0a6c05a6f None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:58.843126 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da64dc-de95-4509-9090-537c9f3c2d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:58.844274 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da64dc-de95-4509-9090-537c9f3c2d81 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:58.844791 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da64dc-de95-4509-9090-537c9f3c2d81 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:58.845283 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da64dc-de95-4509-9090-537c9f3c2d81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:58.852915 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da64dc-de95-4509-9090-537c9f3c2d81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:58.854681 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da64dc-de95-4509-9090-537c9f3c2d81 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:58.856965 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 482/948] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:00:58.868851 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-46da64dc-de95-4509-9090-537c9f3c2d81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:58.871105 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 467/949] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:58.876455 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf1b3a-0a7f-4925-98ee-a2dc57b26a7d None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:58.878022 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da64dc-de95-4509-9090-537c9f3c2d81 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:58.994428 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf1b3a-0a7f-4925-98ee-a2dc57b26a7d None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:59.001334 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da64dc-de95-4509-9090-537c9f3c2d81 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:59.032194 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476caf9f-5a15-45b3-ab39-d4e5efc7d6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:59.033363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476caf9f-5a15-45b3-ab39-d4e5efc7d6eb None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:59.033789 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476caf9f-5a15-45b3-ab39-d4e5efc7d6eb None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:59.034351 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476caf9f-5a15-45b3-ab39-d4e5efc7d6eb None admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:59.035827 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476caf9f-5a15-45b3-ab39-d4e5efc7d6eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:59.036301 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476caf9f-5a15-45b3-ab39-d4e5efc7d6eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:59.039044 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476caf9f-5a15-45b3-ab39-d4e5efc7d6eb None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:59.043975 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb1963-d977-4b81-9c90-e4415866ed2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:59.044783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb1963-d977-4b81-9c90-e4415866ed2c None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:59.045168 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb1963-d977-4b81-9c90-e4415866ed2c None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:59.045542 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb1963-d977-4b81-9c90-e4415866ed2c None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:59.046343 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb1963-d977-4b81-9c90-e4415866ed2c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:59.048381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb1963-d977-4b81-9c90-e4415866ed2c None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:59.050606 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.common [None req-edbb1963-d977-4b81-9c90-e4415866ed2c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 08 13:00:59.052957 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 483/950] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:00:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:59.061596 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476caf9f-5a15-45b3-ab39-d4e5efc7d6eb None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:59.097223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.sql.core [None req-edbb1963-d977-4b81-9c90-e4415866ed2c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Mar 08 13:00:59.097223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Mar 08 13:00:59.097223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [parameters: {'id': '39825dd9c08b4b21986cff2cfa159879', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Mar 08 13:00:59.097223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79792) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 08 13:00:59.112678 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-edbb1963-d977-4b81-9c90-e4415866ed2c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 39825dd9c08b4b21986cff2cfa159879.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 39825dd9c08b4b21986cff2cfa159879. Mar 08 13:00:59.119514 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 468/951] 10.222.0.52 () {60 vars in 1140 bytes} [Tue Mar 8 13:00:58 2022] POST /identity/v3/projects => generated 262 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:00:59.120924 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb1963-d977-4b81-9c90-e4415866ed2c None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:59.188723 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476caf9f-5a15-45b3-ab39-d4e5efc7d6eb None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:59.225565 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb1963-d977-4b81-9c90-e4415866ed2c None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:59.234274 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370c9db-d2d6-4279-92ae-988da204aa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:59.236123 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370c9db-d2d6-4279-92ae-988da204aa56 None admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:59.236564 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370c9db-d2d6-4279-92ae-988da204aa56 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:59.237264 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370c9db-d2d6-4279-92ae-988da204aa56 None admin] PATH_INFO: `/v3/projects/2b478af53391486eb72c85c786ed4abb/users/556058de7b9f48b8a10188ec64496e72/roles/f0c236d58c10498686f59d63c5bcaa3e` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:59.240229 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370c9db-d2d6-4279-92ae-988da204aa56 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b478af53391486eb72c85c786ed4abb, user_id=556058de7b9f48b8a10188ec64496e72, role_id=f0c236d58c10498686f59d63c5bcaa3e)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:59.242297 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370c9db-d2d6-4279-92ae-988da204aa56 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:59.259347 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7f137-4677-4991-a2bb-a7bd5bfd5c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:59.260201 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7f137-4677-4991-a2bb-a7bd5bfd5c4f None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:59.260483 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7f137-4677-4991-a2bb-a7bd5bfd5c4f None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:59.260783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7f137-4677-4991-a2bb-a7bd5bfd5c4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:59.267650 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7f137-4677-4991-a2bb-a7bd5bfd5c4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:59.269427 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7f137-4677-4991-a2bb-a7bd5bfd5c4f None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:59.283644 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-0ff7f137-4677-4991-a2bb-a7bd5bfd5c4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:00:59.290218 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 469/952] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:00:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:00:59.291203 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7f137-4677-4991-a2bb-a7bd5bfd5c4f None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:00:59.306493 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 484/953] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 13:00:59 2022] PUT /identity/v3/projects/2b478af53391486eb72c85c786ed4abb/users/556058de7b9f48b8a10188ec64496e72/roles/f0c236d58c10498686f59d63c5bcaa3e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:00:59.408384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7f137-4677-4991-a2bb-a7bd5bfd5c4f None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:00:59.446000 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156f12c-2764-4264-8da7-44f8b368d2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:00:59.446677 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156f12c-2764-4264-8da7-44f8b368d2c7 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:59.446954 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156f12c-2764-4264-8da7-44f8b368d2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:59.447224 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156f12c-2764-4264-8da7-44f8b368d2c7 None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:59.448073 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156f12c-2764-4264-8da7-44f8b368d2c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:00:59.448388 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156f12c-2764-4264-8da7-44f8b368d2c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:00:59.449906 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156f12c-2764-4264-8da7-44f8b368d2c7 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:00:59.473120 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 470/954] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 13:00:59 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:00:59.953477 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708ee4e-14cd-46fa-bcbd-220ac1b7ccc3 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:59.954140 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708ee4e-14cd-46fa-bcbd-220ac1b7ccc3 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:59.954625 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708ee4e-14cd-46fa-bcbd-220ac1b7ccc3 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:59.956974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 485/955] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:00:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:00:59.963568 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87811888-8994-4237-bba9-9828ffe9ce08 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:00:59.963863 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87811888-8994-4237-bba9-9828ffe9ce08 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:00:59.964147 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87811888-8994-4237-bba9-9828ffe9ce08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:00:59.982995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-87811888-8994-4237-bba9-9828ffe9ce08 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:00:59.984506 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-87811888-8994-4237-bba9-9828ffe9ce08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:00.053726 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 471/956] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:00:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:01:00.076473 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708ee4e-14cd-46fa-bcbd-220ac1b7ccc3 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:00.188814 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708ee4e-14cd-46fa-bcbd-220ac1b7ccc3 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:00.223389 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6729b1d-cf64-4bc1-b593-2d696b72b183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:00.224186 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6729b1d-cf64-4bc1-b593-2d696b72b183 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:00.224549 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6729b1d-cf64-4bc1-b593-2d696b72b183 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:00.224852 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6729b1d-cf64-4bc1-b593-2d696b72b183 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:00.225521 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6729b1d-cf64-4bc1-b593-2d696b72b183 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:00.226904 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6729b1d-cf64-4bc1-b593-2d696b72b183 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:00.238545 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-e6729b1d-cf64-4bc1-b593-2d696b72b183 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 13:01:00.240105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 486/957] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 13:01:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:00.246123 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87811888-8994-4237-bba9-9828ffe9ce08 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:00.347893 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87811888-8994-4237-bba9-9828ffe9ce08 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:00.385968 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709533c0-5fbd-4276-bbf7-ccd39288235e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:00.386653 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709533c0-5fbd-4276-bbf7-ccd39288235e None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:00.386933 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709533c0-5fbd-4276-bbf7-ccd39288235e None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:00.387208 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709533c0-5fbd-4276-bbf7-ccd39288235e None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:00.387940 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709533c0-5fbd-4276-bbf7-ccd39288235e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:00.388243 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709533c0-5fbd-4276-bbf7-ccd39288235e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:00.389707 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709533c0-5fbd-4276-bbf7-ccd39288235e None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:00.395675 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 472/958] 10.222.0.52 () {56 vars in 1122 bytes} [Tue Mar 8 13:01:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:00.401705 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6729b1d-cf64-4bc1-b593-2d696b72b183 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:00.502414 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6729b1d-cf64-4bc1-b593-2d696b72b183 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:00.538177 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f32c6-3ab8-49a7-bf95-9e49205902d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:00.538880 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f32c6-3ab8-49a7-bf95-9e49205902d1 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:00.546977 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f32c6-3ab8-49a7-bf95-9e49205902d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:00.546977 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f32c6-3ab8-49a7-bf95-9e49205902d1 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:00.546977 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f32c6-3ab8-49a7-bf95-9e49205902d1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:00.546977 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f32c6-3ab8-49a7-bf95-9e49205902d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:00.546977 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f32c6-3ab8-49a7-bf95-9e49205902d1 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:00.547334 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 487/959] 10.222.0.52 () {56 vars in 1122 bytes} [Tue Mar 8 13:01:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:00.553211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709533c0-5fbd-4276-bbf7-ccd39288235e None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:00.652564 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709533c0-5fbd-4276-bbf7-ccd39288235e None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:00.688125 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1aaa2-f4cb-4c33-8774-7578ece42eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:00.688815 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1aaa2-f4cb-4c33-8774-7578ece42eb5 None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:00.689094 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1aaa2-f4cb-4c33-8774-7578ece42eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:00.689363 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1aaa2-f4cb-4c33-8774-7578ece42eb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:00.690113 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1aaa2-f4cb-4c33-8774-7578ece42eb5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:00.691476 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1aaa2-f4cb-4c33-8774-7578ece42eb5 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:00.742308 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291d135-00ac-459b-81f4-90ca8a5aaeb0 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:00.742592 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291d135-00ac-459b-81f4-90ca8a5aaeb0 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:00.742866 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291d135-00ac-459b-81f4-90ca8a5aaeb0 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:00.744815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 488/960] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:01:00.749477 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d08813-6926-4a02-902b-0ec358f679a5 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:00.749761 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d08813-6926-4a02-902b-0ec358f679a5 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:00.750036 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d08813-6926-4a02-902b-0ec358f679a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:00.767105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-13d08813-6926-4a02-902b-0ec358f679a5 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:00.768226 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-13d08813-6926-4a02-902b-0ec358f679a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:00.773214 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 473/961] 10.222.0.52 () {60 vars in 1144 bytes} [Tue Mar 8 13:01:00 2022] POST /identity/v3/endpoints => generated 349 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:01:00.858707 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 489/962] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:01:00.878947 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1aaa2-f4cb-4c33-8774-7578ece42eb5 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:01.009251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1aaa2-f4cb-4c33-8774-7578ece42eb5 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:01.069103 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28eff52-e428-47e5-9a40-8e73cd2b8f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:01.071170 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28eff52-e428-47e5-9a40-8e73cd2b8f76 None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:01.071837 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28eff52-e428-47e5-9a40-8e73cd2b8f76 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:01.072499 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28eff52-e428-47e5-9a40-8e73cd2b8f76 None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:01.074001 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28eff52-e428-47e5-9a40-8e73cd2b8f76 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:01.076753 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28eff52-e428-47e5-9a40-8e73cd2b8f76 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:01.152351 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 474/963] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 13:01:00 2022] POST /identity/v3/services => generated 242 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:01:01.768545 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172bb27-b8d1-4891-85f3-e1190f6bc41a None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:01.769606 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172bb27-b8d1-4891-85f3-e1190f6bc41a None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:01.770119 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172bb27-b8d1-4891-85f3-e1190f6bc41a None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:01.772461 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 490/964] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:01.778094 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38190cae-ecd1-4fbc-b3c0-12c1948af862 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:01.778601 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38190cae-ecd1-4fbc-b3c0-12c1948af862 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:01.779097 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38190cae-ecd1-4fbc-b3c0-12c1948af862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:01.797238 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-38190cae-ecd1-4fbc-b3c0-12c1948af862 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:01.798722 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-38190cae-ecd1-4fbc-b3c0-12c1948af862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:01.865999 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d4c13-a145-471e-a5ca-016a0de1e88a None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:01.866311 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d4c13-a145-471e-a5ca-016a0de1e88a None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:01.866541 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d4c13-a145-471e-a5ca-016a0de1e88a None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:01.868531 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 491/965] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:01.873800 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf730e-a1c4-4d1c-8b71-06c8b48df0d6 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:01.874082 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf730e-a1c4-4d1c-8b71-06c8b48df0d6 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:01.874358 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf730e-a1c4-4d1c-8b71-06c8b48df0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:01.897601 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 475/966] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:01:01.897958 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-facf730e-a1c4-4d1c-8b71-06c8b48df0d6 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:01.899218 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-facf730e-a1c4-4d1c-8b71-06c8b48df0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:01.922177 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38190cae-ecd1-4fbc-b3c0-12c1948af862 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:01.979126 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 492/967] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:01:02.011165 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf730e-a1c4-4d1c-8b71-06c8b48df0d6 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:02.028264 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38190cae-ecd1-4fbc-b3c0-12c1948af862 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:02.067494 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763c18f-1295-4cbf-be46-33c2df741fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:02.069200 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763c18f-1295-4cbf-be46-33c2df741fe9 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:02.070284 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763c18f-1295-4cbf-be46-33c2df741fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:02.071008 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763c18f-1295-4cbf-be46-33c2df741fe9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:02.083906 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763c18f-1295-4cbf-be46-33c2df741fe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:01:02.094110 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-e763c18f-1295-4cbf-be46-33c2df741fe9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 13:01:02.095780 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 476/968] 10.222.0.52 () {56 vars in 1120 bytes} [Tue Mar 8 13:01:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:01:02.102665 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763c18f-1295-4cbf-be46-33c2df741fe9 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:02.124444 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf730e-a1c4-4d1c-8b71-06c8b48df0d6 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:02.159021 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f6e0f-faa9-41f1-a86c-ac7b8cc2a706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:02.159905 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f6e0f-faa9-41f1-a86c-ac7b8cc2a706 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:02.160323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f6e0f-faa9-41f1-a86c-ac7b8cc2a706 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:02.160781 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f6e0f-faa9-41f1-a86c-ac7b8cc2a706 None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:02.161999 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f6e0f-faa9-41f1-a86c-ac7b8cc2a706 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:02.163702 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f6e0f-faa9-41f1-a86c-ac7b8cc2a706 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:02.165184 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.common [None req-e10f6e0f-faa9-41f1-a86c-ac7b8cc2a706 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 08 13:01:02.203223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763c18f-1295-4cbf-be46-33c2df741fe9 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:02.226556 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.sql.core [None req-e10f6e0f-faa9-41f1-a86c-ac7b8cc2a706 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Mar 08 13:01:02.226556 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Mar 08 13:01:02.226556 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [parameters: {'user_id': 'bd681bed5fad42639c7980f2d58d0a9e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Mar 08 13:01:02.226556 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79793) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 08 13:01:02.234664 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-e10f6e0f-faa9-41f1-a86c-ac7b8cc2a706 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Mar 08 13:01:02.236365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 493/969] 10.222.0.52 () {60 vars in 1131 bytes} [Tue Mar 8 13:01:02 2022] POST /identity/v3/users => generated 160 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:01:02.237895 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a184e7-1b0d-405b-8198-b90abe867e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:02.238818 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a184e7-1b0d-405b-8198-b90abe867e47 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:02.239316 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a184e7-1b0d-405b-8198-b90abe867e47 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:02.240298 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a184e7-1b0d-405b-8198-b90abe867e47 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:02.241877 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a184e7-1b0d-405b-8198-b90abe867e47 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:02.242154 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f6e0f-faa9-41f1-a86c-ac7b8cc2a706 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:02.242972 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a184e7-1b0d-405b-8198-b90abe867e47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:02.245512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a184e7-1b0d-405b-8198-b90abe867e47 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:02.261333 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 477/970] 10.222.0.52 () {56 vars in 1115 bytes} [Tue Mar 8 13:01:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:02.262921 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a184e7-1b0d-405b-8198-b90abe867e47 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:02.365333 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f6e0f-faa9-41f1-a86c-ac7b8cc2a706 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:02.373080 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a184e7-1b0d-405b-8198-b90abe867e47 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:02.400335 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56865042-f955-453d-9332-3ca1e279a96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:02.401148 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56865042-f955-453d-9332-3ca1e279a96b None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:02.401433 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56865042-f955-453d-9332-3ca1e279a96b None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:02.401711 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56865042-f955-453d-9332-3ca1e279a96b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:02.408207 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f861d9-89a0-435d-9a7d-0b5353b13ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:02.409396 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f861d9-89a0-435d-9a7d-0b5353b13ebf None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:02.410040 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56865042-f955-453d-9332-3ca1e279a96b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:02.410287 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f861d9-89a0-435d-9a7d-0b5353b13ebf None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:02.410787 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f861d9-89a0-435d-9a7d-0b5353b13ebf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:02.412750 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56865042-f955-453d-9332-3ca1e279a96b None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:02.422844 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f861d9-89a0-435d-9a7d-0b5353b13ebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:02.424298 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f861d9-89a0-435d-9a7d-0b5353b13ebf None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:02.426610 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-56865042-f955-453d-9332-3ca1e279a96b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 08 13:01:02.428557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 494/971] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:01:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:02.434349 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56865042-f955-453d-9332-3ca1e279a96b None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:02.448106 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-59f861d9-89a0-435d-9a7d-0b5353b13ebf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:01:02.452847 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 478/972] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:02.455316 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f861d9-89a0-435d-9a7d-0b5353b13ebf None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:02.563568 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56865042-f955-453d-9332-3ca1e279a96b None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:02.563937 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f861d9-89a0-435d-9a7d-0b5353b13ebf None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:02.600754 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3b457-d73e-4251-8cc9-3d77510cb65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:02.602359 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3b457-d73e-4251-8cc9-3d77510cb65a None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:02.603111 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3b457-d73e-4251-8cc9-3d77510cb65a None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:02.603597 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3b457-d73e-4251-8cc9-3d77510cb65a None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:02.604540 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3b457-d73e-4251-8cc9-3d77510cb65a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:02.605074 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3b457-d73e-4251-8cc9-3d77510cb65a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:02.606667 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99260560-fc87-4418-abf0-ab74ebb019e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:02.606847 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3b457-d73e-4251-8cc9-3d77510cb65a None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:02.607522 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99260560-fc87-4418-abf0-ab74ebb019e6 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:02.607805 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99260560-fc87-4418-abf0-ab74ebb019e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:02.608079 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99260560-fc87-4418-abf0-ab74ebb019e6 None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:02.608918 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99260560-fc87-4418-abf0-ab74ebb019e6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:02.609291 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99260560-fc87-4418-abf0-ab74ebb019e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:02.610763 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99260560-fc87-4418-abf0-ab74ebb019e6 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:02.626925 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 479/973] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:02.628495 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3b457-d73e-4251-8cc9-3d77510cb65a None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:02.664770 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 495/974] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 13:01:02 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:02.747479 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3b457-d73e-4251-8cc9-3d77510cb65a None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:02.787027 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476cbb0-3ede-4984-bcd6-79df866f3993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:02.788302 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476cbb0-3ede-4984-bcd6-79df866f3993 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:02.788842 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476cbb0-3ede-4984-bcd6-79df866f3993 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:02.789350 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476cbb0-3ede-4984-bcd6-79df866f3993 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:02.801289 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476cbb0-3ede-4984-bcd6-79df866f3993 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:02.803397 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476cbb0-3ede-4984-bcd6-79df866f3993 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:02.821417 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-6476cbb0-3ede-4984-bcd6-79df866f3993 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 13:01:02.823434 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 480/975] 10.222.0.52 () {56 vars in 1117 bytes} [Tue Mar 8 13:01:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:02.829573 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99260560-fc87-4418-abf0-ab74ebb019e6 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:02.938138 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99260560-fc87-4418-abf0-ab74ebb019e6 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:02.976013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3453b-1fda-4c22-aa50-64ce68b44b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:02.977100 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3453b-1fda-4c22-aa50-64ce68b44b2a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:02.977621 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3453b-1fda-4c22-aa50-64ce68b44b2a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:02.978120 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3453b-1fda-4c22-aa50-64ce68b44b2a None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:02.979209 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3453b-1fda-4c22-aa50-64ce68b44b2a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:02.979737 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3453b-1fda-4c22-aa50-64ce68b44b2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:02.981421 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3453b-1fda-4c22-aa50-64ce68b44b2a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:02.999011 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 496/976] 10.222.0.52 () {56 vars in 1149 bytes} [Tue Mar 8 13:01:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:03.004962 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476cbb0-3ede-4984-bcd6-79df866f3993 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:03.102239 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476cbb0-3ede-4984-bcd6-79df866f3993 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:03.134871 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5596c61-5235-4900-8cfc-e72da8b05690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:03.135520 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5596c61-5235-4900-8cfc-e72da8b05690 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:03.135805 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5596c61-5235-4900-8cfc-e72da8b05690 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:03.136084 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5596c61-5235-4900-8cfc-e72da8b05690 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:03.201999 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527356f-e4cb-442b-85b3-34b0cd7b17cb None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:03.202294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527356f-e4cb-442b-85b3-34b0cd7b17cb None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:03.202510 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527356f-e4cb-442b-85b3-34b0cd7b17cb None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:03.204469 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 497/977] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:03.205955 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5596c61-5235-4900-8cfc-e72da8b05690 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:03.207436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5596c61-5235-4900-8cfc-e72da8b05690 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:03.210006 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06139c70-cd75-48db-8086-070d3b9cef36 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:03.210512 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06139c70-cd75-48db-8086-070d3b9cef36 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:03.210786 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06139c70-cd75-48db-8086-070d3b9cef36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:03.227528 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-06139c70-cd75-48db-8086-070d3b9cef36 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:03.229056 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-06139c70-cd75-48db-8086-070d3b9cef36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:03.294325 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 498/978] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:01:03.308508 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 481/979] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:01:03 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:01:03.314302 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06139c70-cd75-48db-8086-070d3b9cef36 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:03.317018 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5596c61-5235-4900-8cfc-e72da8b05690 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:03.416905 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06139c70-cd75-48db-8086-070d3b9cef36 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:03.420785 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5596c61-5235-4900-8cfc-e72da8b05690 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:03.450362 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3666278-a9cb-4f18-a473-7fba0ba553f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:03.451156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3666278-a9cb-4f18-a473-7fba0ba553f7 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:03.451431 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3666278-a9cb-4f18-a473-7fba0ba553f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:03.451706 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3666278-a9cb-4f18-a473-7fba0ba553f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:03.454763 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076aaf5-63bf-433b-ad1d-817e1fbb5f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:03.455628 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076aaf5-63bf-433b-ad1d-817e1fbb5f04 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:03.455910 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076aaf5-63bf-433b-ad1d-817e1fbb5f04 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:03.456181 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076aaf5-63bf-433b-ad1d-817e1fbb5f04 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:03.456864 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076aaf5-63bf-433b-ad1d-817e1fbb5f04 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:03.458448 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076aaf5-63bf-433b-ad1d-817e1fbb5f04 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:03.462054 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3666278-a9cb-4f18-a473-7fba0ba553f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:03.463496 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3666278-a9cb-4f18-a473-7fba0ba553f7 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:03.469389 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-f076aaf5-63bf-433b-ad1d-817e1fbb5f04 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 13:01:03.470721 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 482/980] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 13:01:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:01:03.476922 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076aaf5-63bf-433b-ad1d-817e1fbb5f04 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:03.480380 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-b3666278-a9cb-4f18-a473-7fba0ba553f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:01:03.485868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 499/981] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:03.486922 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3666278-a9cb-4f18-a473-7fba0ba553f7 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:03.573852 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076aaf5-63bf-433b-ad1d-817e1fbb5f04 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:03.583474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3666278-a9cb-4f18-a473-7fba0ba553f7 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:03.605771 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011501b-404d-488c-842c-04d09a913db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:03.606425 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011501b-404d-488c-842c-04d09a913db2 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:03.606715 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011501b-404d-488c-842c-04d09a913db2 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:03.606991 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011501b-404d-488c-842c-04d09a913db2 None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:03.607693 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011501b-404d-488c-842c-04d09a913db2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:03.607999 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011501b-404d-488c-842c-04d09a913db2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:03.609404 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011501b-404d-488c-842c-04d09a913db2 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:03.614029 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 483/982] 10.222.0.52 () {56 vars in 1122 bytes} [Tue Mar 8 13:01:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:03.615870 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9c182-3a05-484f-811f-fccad60c71c4 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:03.616160 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9c182-3a05-484f-811f-fccad60c71c4 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:03.616437 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9c182-3a05-484f-811f-fccad60c71c4 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:03.616720 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd77a97-4dd2-4846-b231-896ef27de60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:03.617382 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd77a97-4dd2-4846-b231-896ef27de60c None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:03.617669 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd77a97-4dd2-4846-b231-896ef27de60c None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:03.617946 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd77a97-4dd2-4846-b231-896ef27de60c None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:03.620622 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 484/983] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:03.626153 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd77a97-4dd2-4846-b231-896ef27de60c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:03.626153 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd77a97-4dd2-4846-b231-896ef27de60c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:03.626373 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9c182-3a05-484f-811f-fccad60c71c4 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:03.626511 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd77a97-4dd2-4846-b231-896ef27de60c None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:03.636592 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 500/984] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:03.636592 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5cd2b-4906-479b-b572-d1c9437c0d73 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:03.636592 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5cd2b-4906-479b-b572-d1c9437c0d73 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:03.636592 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5cd2b-4906-479b-b572-d1c9437c0d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:03.651102 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-bac5cd2b-4906-479b-b572-d1c9437c0d73 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:03.652302 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-bac5cd2b-4906-479b-b572-d1c9437c0d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:03.718298 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 501/985] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:01:03.719045 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5cd2b-4906-479b-b572-d1c9437c0d73 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:03.729146 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9c182-3a05-484f-811f-fccad60c71c4 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:03.762154 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d93458-09d1-4857-85f1-a66342273000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:03.762808 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d93458-09d1-4857-85f1-a66342273000 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:03.763091 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d93458-09d1-4857-85f1-a66342273000 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:03.763367 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d93458-09d1-4857-85f1-a66342273000 None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:03.764068 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d93458-09d1-4857-85f1-a66342273000 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:03.764376 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d93458-09d1-4857-85f1-a66342273000 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:03.765794 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d93458-09d1-4857-85f1-a66342273000 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:03.770399 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 485/986] 10.222.0.52 () {56 vars in 1122 bytes} [Tue Mar 8 13:01:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:03.771501 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d93458-09d1-4857-85f1-a66342273000 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:03.822623 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5cd2b-4906-479b-b572-d1c9437c0d73 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:03.865767 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf3cee-57c2-4c27-937c-1cc564938042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:03.866552 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf3cee-57c2-4c27-937c-1cc564938042 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:03.866824 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf3cee-57c2-4c27-937c-1cc564938042 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:03.867090 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf3cee-57c2-4c27-937c-1cc564938042 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:03.867996 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d93458-09d1-4857-85f1-a66342273000 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:03.873513 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf3cee-57c2-4c27-937c-1cc564938042 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:03.874964 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf3cee-57c2-4c27-937c-1cc564938042 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:03.887516 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-19bf3cee-57c2-4c27-937c-1cc564938042 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:01:03.888892 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 502/987] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:01:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:03.889442 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf3cee-57c2-4c27-937c-1cc564938042 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:03.901399 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9129f-3633-4dc2-b4f1-b11179982d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:03.902186 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9129f-3633-4dc2-b4f1-b11179982d01 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:03.902465 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9129f-3633-4dc2-b4f1-b11179982d01 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:03.902735 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9129f-3633-4dc2-b4f1-b11179982d01 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:03.903377 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9129f-3633-4dc2-b4f1-b11179982d01 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:03.904773 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9129f-3633-4dc2-b4f1-b11179982d01 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:03.915975 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-c1b9129f-3633-4dc2-b4f1-b11179982d01 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 08 13:01:03.917144 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 486/988] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:01:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:03.917896 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9129f-3633-4dc2-b4f1-b11179982d01 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:03.988862 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf3cee-57c2-4c27-937c-1cc564938042 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:04.013351 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9129f-3633-4dc2-b4f1-b11179982d01 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:04.036399 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e741f6-5cb0-4503-9167-a31887840e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:04.037083 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e741f6-5cb0-4503-9167-a31887840e2f None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:04.037363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e741f6-5cb0-4503-9167-a31887840e2f None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:04.037639 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e741f6-5cb0-4503-9167-a31887840e2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:04.038432 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e741f6-5cb0-4503-9167-a31887840e2f None admin] RBAC: Adding query filter params (interface=admin, service_id=7b918366233a44aa846b62f02e033818, region_id=RegionOne) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:04.038748 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e741f6-5cb0-4503-9167-a31887840e2f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:04.040117 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e741f6-5cb0-4503-9167-a31887840e2f None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:04.045217 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 503/989] 10.222.0.52 () {56 vars in 1249 bytes} [Tue Mar 8 13:01:03 2022] GET /identity/v3/endpoints?service_id=7b918366233a44aa846b62f02e033818&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:04.045990 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e741f6-5cb0-4503-9167-a31887840e2f None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:04.046161 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4d3df-6acf-45a4-9cfb-e302b7498e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:04.046780 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4d3df-6acf-45a4-9cfb-e302b7498e54 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:04.047072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4d3df-6acf-45a4-9cfb-e302b7498e54 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:04.047330 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4d3df-6acf-45a4-9cfb-e302b7498e54 None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:04.048101 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4d3df-6acf-45a4-9cfb-e302b7498e54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:04.048405 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4d3df-6acf-45a4-9cfb-e302b7498e54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:04.049901 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4d3df-6acf-45a4-9cfb-e302b7498e54 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:04.062939 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 487/990] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:01:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:04.063751 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4d3df-6acf-45a4-9cfb-e302b7498e54 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:04.147061 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e741f6-5cb0-4503-9167-a31887840e2f None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:04.157334 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4d3df-6acf-45a4-9cfb-e302b7498e54 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:04.178798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e9f54-0308-4073-b40f-16b3091490fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:04.179453 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e9f54-0308-4073-b40f-16b3091490fd None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:04.179732 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e9f54-0308-4073-b40f-16b3091490fd None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:04.180003 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e9f54-0308-4073-b40f-16b3091490fd None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:04.180735 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e9f54-0308-4073-b40f-16b3091490fd None admin] RBAC: Adding query filter params (name=compute) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:04.181041 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e9f54-0308-4073-b40f-16b3091490fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:04.182402 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e9f54-0308-4073-b40f-16b3091490fd None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:04.186971 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 504/991] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 13:01:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:04.187727 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e9f54-0308-4073-b40f-16b3091490fd None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:04.189180 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec80fbc-7eb0-4ee1-9dc0-9349b06c064e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:04.189828 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec80fbc-7eb0-4ee1-9dc0-9349b06c064e None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:04.190117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec80fbc-7eb0-4ee1-9dc0-9349b06c064e None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:04.190392 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec80fbc-7eb0-4ee1-9dc0-9349b06c064e None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:04.191075 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec80fbc-7eb0-4ee1-9dc0-9349b06c064e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:04.193150 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec80fbc-7eb0-4ee1-9dc0-9349b06c064e None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:04.199456 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 488/992] 10.222.0.52 () {56 vars in 1087 bytes} [Tue Mar 8 13:01:04 2022] GET /identity/v3/services => generated 1727 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:01:04.200229 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec80fbc-7eb0-4ee1-9dc0-9349b06c064e None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:04.301201 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e9f54-0308-4073-b40f-16b3091490fd None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:04.306732 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec80fbc-7eb0-4ee1-9dc0-9349b06c064e None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:04.342011 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96fd1c-aa98-4e2b-a2f9-0cdf3286e462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:04.342691 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96fd1c-aa98-4e2b-a2f9-0cdf3286e462 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:04.342983 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96fd1c-aa98-4e2b-a2f9-0cdf3286e462 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:04.343264 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96fd1c-aa98-4e2b-a2f9-0cdf3286e462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:04.344120 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96fd1c-aa98-4e2b-a2f9-0cdf3286e462 None admin] RBAC: Adding query filter params (role.id=f0c236d58c10498686f59d63c5bcaa3e, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=556058de7b9f48b8a10188ec64496e72) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:04.344436 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96fd1c-aa98-4e2b-a2f9-0cdf3286e462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:04.345959 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96fd1c-aa98-4e2b-a2f9-0cdf3286e462 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:04.348143 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21fb6c-68bb-4013-ac07-d8d3ad3bc298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:04.348951 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21fb6c-68bb-4013-ac07-d8d3ad3bc298 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:04.349696 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21fb6c-68bb-4013-ac07-d8d3ad3bc298 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:04.349696 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21fb6c-68bb-4013-ac07-d8d3ad3bc298 None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:04.350223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21fb6c-68bb-4013-ac07-d8d3ad3bc298 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:04.350721 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21fb6c-68bb-4013-ac07-d8d3ad3bc298 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:04.352096 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21fb6c-68bb-4013-ac07-d8d3ad3bc298 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:04.362946 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 505/993] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:01:04 2022] GET /identity/v3/role_assignments?user.id=556058de7b9f48b8a10188ec64496e72&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=f0c236d58c10498686f59d63c5bcaa3e => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:04.363150 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 489/994] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 13:01:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:04.363924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96fd1c-aa98-4e2b-a2f9-0cdf3286e462 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:04.475327 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96fd1c-aa98-4e2b-a2f9-0cdf3286e462 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:04.509469 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd76ee-9ccf-448a-ab13-ae7e0117f355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:04.510143 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd76ee-9ccf-448a-ab13-ae7e0117f355 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:04.510421 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd76ee-9ccf-448a-ab13-ae7e0117f355 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:04.510690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd76ee-9ccf-448a-ab13-ae7e0117f355 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:04.511521 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd76ee-9ccf-448a-ab13-ae7e0117f355 None admin] RBAC: Adding query filter params (interface=public, service_id=93b3989a8add41f991a2b6b42a84e33a, region_id=RegionOne) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:04.511835 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd76ee-9ccf-448a-ab13-ae7e0117f355 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:04.513294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd76ee-9ccf-448a-ab13-ae7e0117f355 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:04.524088 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 506/995] 10.222.0.52 () {56 vars in 1251 bytes} [Tue Mar 8 13:01:04 2022] GET /identity/v3/endpoints?service_id=93b3989a8add41f991a2b6b42a84e33a&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:04.526084 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21fb6c-68bb-4013-ac07-d8d3ad3bc298 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:04.626967 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21fb6c-68bb-4013-ac07-d8d3ad3bc298 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:04.659968 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbee3f-1284-4d57-b222-6df28fe858e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:04.660631 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbee3f-1284-4d57-b222-6df28fe858e9 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:04.660936 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbee3f-1284-4d57-b222-6df28fe858e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:04.661288 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbee3f-1284-4d57-b222-6df28fe858e9 None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:04.661968 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afbee3f-1284-4d57-b222-6df28fe858e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:04.663404 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afbee3f-1284-4d57-b222-6df28fe858e9 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:04.669622 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 490/996] 10.222.0.52 () {56 vars in 1087 bytes} [Tue Mar 8 13:01:04 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:01:06.517001 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd63738-b749-4a82-b896-fb22d3379bb4 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:06.517532 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd63738-b749-4a82-b896-fb22d3379bb4 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:06.517532 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd63738-b749-4a82-b896-fb22d3379bb4 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:06.519372 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 507/997] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:06.525060 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9702214-b351-4374-988e-d0b9bc21e22d None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:06.525488 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9702214-b351-4374-988e-d0b9bc21e22d None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:06.525678 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9702214-b351-4374-988e-d0b9bc21e22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:06.542755 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-a9702214-b351-4374-988e-d0b9bc21e22d None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:06.543931 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-a9702214-b351-4374-988e-d0b9bc21e22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:06.608965 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 491/998] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:01:06.632379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd63738-b749-4a82-b896-fb22d3379bb4 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:06.710213 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699e705-24b4-4886-b837-ff93d28eedcc None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:06.710520 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699e705-24b4-4886-b837-ff93d28eedcc None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:06.710774 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699e705-24b4-4886-b837-ff93d28eedcc None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:06.712682 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 492/999] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:01:06.717556 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da5c13-1846-45ee-9e12-8cf28ce2672e None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:06.717840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da5c13-1846-45ee-9e12-8cf28ce2672e None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:06.718119 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da5c13-1846-45ee-9e12-8cf28ce2672e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:06.732961 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd63738-b749-4a82-b896-fb22d3379bb4 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:06.735447 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-22da5c13-1846-45ee-9e12-8cf28ce2672e None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:06.736609 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-22da5c13-1846-45ee-9e12-8cf28ce2672e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:06.771004 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa9f92-1721-4da3-b116-f5830bffeb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:06.771938 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa9f92-1721-4da3-b116-f5830bffeb57 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:06.772225 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa9f92-1721-4da3-b116-f5830bffeb57 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:06.772503 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa9f92-1721-4da3-b116-f5830bffeb57 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:06.773182 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa9f92-1721-4da3-b116-f5830bffeb57 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:06.774811 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa9f92-1721-4da3-b116-f5830bffeb57 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:06.785657 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-7dfa9f92-1721-4da3-b116-f5830bffeb57 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 13:01:06.787133 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 508/1000] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 13:01:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:06.792744 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa9f92-1721-4da3-b116-f5830bffeb57 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:06.800069 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 493/1001] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:01:06.823213 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da5c13-1846-45ee-9e12-8cf28ce2672e None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:06.890544 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa9f92-1721-4da3-b116-f5830bffeb57 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:06.918192 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da5c13-1846-45ee-9e12-8cf28ce2672e None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:06.924817 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631a8d5-905a-4004-95ca-f989539e7d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:06.925483 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631a8d5-905a-4004-95ca-f989539e7d7c None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:06.925765 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631a8d5-905a-4004-95ca-f989539e7d7c None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:06.926037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631a8d5-905a-4004-95ca-f989539e7d7c None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:06.927338 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631a8d5-905a-4004-95ca-f989539e7d7c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:06.927642 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631a8d5-905a-4004-95ca-f989539e7d7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:06.929063 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631a8d5-905a-4004-95ca-f989539e7d7c None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:06.938305 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 509/1002] 10.222.0.52 () {56 vars in 1122 bytes} [Tue Mar 8 13:01:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:06.939379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631a8d5-905a-4004-95ca-f989539e7d7c None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:06.953062 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35615960-4cf3-4479-a9bd-2af2c4fc7d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:06.953847 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35615960-4cf3-4479-a9bd-2af2c4fc7d26 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:06.954125 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35615960-4cf3-4479-a9bd-2af2c4fc7d26 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:06.954448 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35615960-4cf3-4479-a9bd-2af2c4fc7d26 None admin] PATH_INFO: `/v3/services/image` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:06.955041 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35615960-4cf3-4479-a9bd-2af2c4fc7d26 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:06.956431 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35615960-4cf3-4479-a9bd-2af2c4fc7d26 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:06.966888 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-35615960-4cf3-4479-a9bd-2af2c4fc7d26 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 08 13:01:06.968039 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 494/1003] 10.222.0.52 () {56 vars in 1105 bytes} [Tue Mar 8 13:01:06 2022] GET /identity/v3/services/image => generated 86 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:01:06.974139 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35615960-4cf3-4479-a9bd-2af2c4fc7d26 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:07.040061 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631a8d5-905a-4004-95ca-f989539e7d7c None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:07.067830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35615960-4cf3-4479-a9bd-2af2c4fc7d26 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:07.071579 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892175d-33f5-48b2-83dc-e8497b79def6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:07.072236 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892175d-33f5-48b2-83dc-e8497b79def6 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:07.072516 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892175d-33f5-48b2-83dc-e8497b79def6 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:07.072820 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892175d-33f5-48b2-83dc-e8497b79def6 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:07.073524 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892175d-33f5-48b2-83dc-e8497b79def6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:07.073830 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892175d-33f5-48b2-83dc-e8497b79def6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:07.075206 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892175d-33f5-48b2-83dc-e8497b79def6 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:07.079818 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 510/1004] 10.222.0.52 () {56 vars in 1122 bytes} [Tue Mar 8 13:01:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:07.085410 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636154c-0a53-4c83-b6ee-767254d8d7a4 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:07.085410 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636154c-0a53-4c83-b6ee-767254d8d7a4 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:07.085410 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636154c-0a53-4c83-b6ee-767254d8d7a4 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:07.085410 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 511/1005] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:07.086588 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636154c-0a53-4c83-b6ee-767254d8d7a4 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:07.100288 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb43a9-6956-4115-9458-43ec1c6a86b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:07.100978 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb43a9-6956-4115-9458-43ec1c6a86b0 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:07.101553 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb43a9-6956-4115-9458-43ec1c6a86b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:07.101553 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb43a9-6956-4115-9458-43ec1c6a86b0 None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:07.102204 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb43a9-6956-4115-9458-43ec1c6a86b0 None admin] RBAC: Adding query filter params (name=image) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:07.102502 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb43a9-6956-4115-9458-43ec1c6a86b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:07.103867 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb43a9-6956-4115-9458-43ec1c6a86b0 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:07.108509 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 495/1006] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:01:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:07.109591 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5d71d-7146-4d95-9d19-acc4af0cf1e8 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:07.109876 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5d71d-7146-4d95-9d19-acc4af0cf1e8 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:07.110152 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5d71d-7146-4d95-9d19-acc4af0cf1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:07.127218 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-0af5d71d-7146-4d95-9d19-acc4af0cf1e8 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:07.128384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-0af5d71d-7146-4d95-9d19-acc4af0cf1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:07.183694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636154c-0a53-4c83-b6ee-767254d8d7a4 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:07.190376 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 496/1007] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:01:07.191193 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5d71d-7146-4d95-9d19-acc4af0cf1e8 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:07.219363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367cbe8-df1e-43eb-938e-0867aef7651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:07.220017 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367cbe8-df1e-43eb-938e-0867aef7651f None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:07.220295 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367cbe8-df1e-43eb-938e-0867aef7651f None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:07.220567 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367cbe8-df1e-43eb-938e-0867aef7651f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:07.221318 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367cbe8-df1e-43eb-938e-0867aef7651f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:07.222677 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367cbe8-df1e-43eb-938e-0867aef7651f None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:07.284267 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5d71d-7146-4d95-9d19-acc4af0cf1e8 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:07.306977 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 512/1008] 10.222.0.52 () {60 vars in 1144 bytes} [Tue Mar 8 13:01:07 2022] POST /identity/v3/endpoints => generated 325 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:01:07.307785 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367cbe8-df1e-43eb-938e-0867aef7651f None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:07.324579 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6b831-20aa-4ed5-82b9-ae43adb2e218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:07.325300 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6b831-20aa-4ed5-82b9-ae43adb2e218 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:07.325579 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6b831-20aa-4ed5-82b9-ae43adb2e218 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:07.325853 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6b831-20aa-4ed5-82b9-ae43adb2e218 None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:07.326636 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6b831-20aa-4ed5-82b9-ae43adb2e218 None admin] RBAC: Adding query filter params (type=image) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:07.326939 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6b831-20aa-4ed5-82b9-ae43adb2e218 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:07.328499 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6b831-20aa-4ed5-82b9-ae43adb2e218 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:07.344947 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 497/1009] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:01:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:07.447649 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367cbe8-df1e-43eb-938e-0867aef7651f None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:07.486343 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba0649-758a-43d8-ba09-7b318abbe31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:07.487460 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba0649-758a-43d8-ba09-7b318abbe31e None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:07.487889 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba0649-758a-43d8-ba09-7b318abbe31e None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:07.488306 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba0649-758a-43d8-ba09-7b318abbe31e None admin] PATH_INFO: `/v3/services/compute` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:07.489737 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba0649-758a-43d8-ba09-7b318abbe31e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:07.491489 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba0649-758a-43d8-ba09-7b318abbe31e None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:07.508022 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-03ba0649-758a-43d8-ba09-7b318abbe31e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 08 13:01:07.512711 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 513/1010] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:01:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:07.515799 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6b831-20aa-4ed5-82b9-ae43adb2e218 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:07.619741 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6b831-20aa-4ed5-82b9-ae43adb2e218 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:07.652494 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a4fe9-8487-4adb-a571-a563f6f20af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:07.653237 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a4fe9-8487-4adb-a571-a563f6f20af2 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:07.653523 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a4fe9-8487-4adb-a571-a563f6f20af2 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:07.653794 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a4fe9-8487-4adb-a571-a563f6f20af2 None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:07.654552 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a4fe9-8487-4adb-a571-a563f6f20af2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:07.654860 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a4fe9-8487-4adb-a571-a563f6f20af2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:07.656293 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a4fe9-8487-4adb-a571-a563f6f20af2 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:07.664689 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 498/1011] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 13:01:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:07.666932 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba0649-758a-43d8-ba09-7b318abbe31e None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:07.763350 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba0649-758a-43d8-ba09-7b318abbe31e None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:07.796062 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044adfa-1262-4219-bbce-cb9c066f68da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:07.797060 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044adfa-1262-4219-bbce-cb9c066f68da None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:07.797537 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044adfa-1262-4219-bbce-cb9c066f68da None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:07.797997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044adfa-1262-4219-bbce-cb9c066f68da None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:07.798932 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044adfa-1262-4219-bbce-cb9c066f68da None admin] RBAC: Adding query filter params (type=compute) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:07.799453 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044adfa-1262-4219-bbce-cb9c066f68da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:07.801029 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044adfa-1262-4219-bbce-cb9c066f68da None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:07.806160 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 514/1012] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 13:01:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:07.811675 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a4fe9-8487-4adb-a571-a563f6f20af2 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:07.909455 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a4fe9-8487-4adb-a571-a563f6f20af2 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:07.941385 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50972338-1c5a-42e3-8466-ef526e0daabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:07.942735 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50972338-1c5a-42e3-8466-ef526e0daabb None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:07.943032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50972338-1c5a-42e3-8466-ef526e0daabb None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:07.943359 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50972338-1c5a-42e3-8466-ef526e0daabb None admin] PATH_INFO: `/v3/endpoints` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:07.944087 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50972338-1c5a-42e3-8466-ef526e0daabb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:07.945540 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50972338-1c5a-42e3-8466-ef526e0daabb None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:08.040765 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 499/1013] 10.222.0.52 () {60 vars in 1144 bytes} [Tue Mar 8 13:01:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:01:09.746287 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5670b9-fc9a-467f-8e98-984c4efee42a None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:09.746873 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5670b9-fc9a-467f-8e98-984c4efee42a None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:09.746873 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5670b9-fc9a-467f-8e98-984c4efee42a None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:09.748902 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 515/1014] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:09.754350 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56700e4-0f50-4295-80d8-c0ddce828fdd None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:09.754863 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56700e4-0f50-4295-80d8-c0ddce828fdd None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:09.755092 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56700e4-0f50-4295-80d8-c0ddce828fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:09.771933 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-f56700e4-0f50-4295-80d8-c0ddce828fdd None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:09.773134 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f56700e4-0f50-4295-80d8-c0ddce828fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:09.844640 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 500/1015] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:09 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:01:09.870678 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5670b9-fc9a-467f-8e98-984c4efee42a None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:09.972710 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5670b9-fc9a-467f-8e98-984c4efee42a None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:10.006441 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2a8c3-6d7c-491a-aeb3-4e2107052237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:10.007032 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2a8c3-6d7c-491a-aeb3-4e2107052237 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:10.007315 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2a8c3-6d7c-491a-aeb3-4e2107052237 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:10.007592 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2a8c3-6d7c-491a-aeb3-4e2107052237 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:10.008321 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2a8c3-6d7c-491a-aeb3-4e2107052237 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:10.009792 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2a8c3-6d7c-491a-aeb3-4e2107052237 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:10.102943 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c658aae-ab77-4f99-982a-3f7d0c6674f4 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:10.103234 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c658aae-ab77-4f99-982a-3f7d0c6674f4 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:10.103513 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c658aae-ab77-4f99-982a-3f7d0c6674f4 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:10.105635 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 501/1016] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:01:10.110573 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed7085-cf95-446b-b8ae-84d562fb9e94 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:10.110860 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed7085-cf95-446b-b8ae-84d562fb9e94 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:10.111211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed7085-cf95-446b-b8ae-84d562fb9e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:10.116573 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 516/1017] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 13:01:09 2022] POST /identity/v3/services => generated 242 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:01:10.134881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-96ed7085-cf95-446b-b8ae-84d562fb9e94 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:10.136134 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-96ed7085-cf95-446b-b8ae-84d562fb9e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:10.215923 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 502/1018] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:01:10.242384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2a8c3-6d7c-491a-aeb3-4e2107052237 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:10.351081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2a8c3-6d7c-491a-aeb3-4e2107052237 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:10.384319 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571748ff-dfa6-4566-82cd-e546b07a7143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:10.385144 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571748ff-dfa6-4566-82cd-e546b07a7143 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:10.385477 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571748ff-dfa6-4566-82cd-e546b07a7143 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:10.385755 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571748ff-dfa6-4566-82cd-e546b07a7143 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:10.386903 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571748ff-dfa6-4566-82cd-e546b07a7143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:10.388409 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571748ff-dfa6-4566-82cd-e546b07a7143 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:10.392351 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 517/1019] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:01:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:10.397010 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed7085-cf95-446b-b8ae-84d562fb9e94 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:10.500710 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed7085-cf95-446b-b8ae-84d562fb9e94 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:10.537277 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d77362-108c-4200-b159-00354cd971ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:10.537939 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d77362-108c-4200-b159-00354cd971ef None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:10.538483 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d77362-108c-4200-b159-00354cd971ef None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:10.538483 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d77362-108c-4200-b159-00354cd971ef None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:10.539190 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d77362-108c-4200-b159-00354cd971ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:10.540634 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d77362-108c-4200-b159-00354cd971ef None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:10.651544 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 503/1020] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 13:01:10 2022] POST /identity/v3/projects => generated 311 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:01:10.851819 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066af24-1ad7-4410-bd26-02c359125cbe None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:10.852322 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066af24-1ad7-4410-bd26-02c359125cbe None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:10.852595 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066af24-1ad7-4410-bd26-02c359125cbe None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:10.854399 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 518/1021] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:10.859813 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1331571-b00b-4b18-b5df-a628187f1ab6 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:10.860264 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1331571-b00b-4b18-b5df-a628187f1ab6 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:10.860380 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1331571-b00b-4b18-b5df-a628187f1ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:10.878463 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-c1331571-b00b-4b18-b5df-a628187f1ab6 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:10.879668 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c1331571-b00b-4b18-b5df-a628187f1ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:10.950030 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 504/1022] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:01:10.973616 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066af24-1ad7-4410-bd26-02c359125cbe None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:11.073675 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066af24-1ad7-4410-bd26-02c359125cbe None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:11.105823 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6df19-3f6a-4bca-a40e-b1610a289392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:11.106621 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6df19-3f6a-4bca-a40e-b1610a289392 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:11.106900 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6df19-3f6a-4bca-a40e-b1610a289392 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:11.107171 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6df19-3f6a-4bca-a40e-b1610a289392 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:11.118134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6df19-3f6a-4bca-a40e-b1610a289392 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:01:11.125451 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-3df6df19-3f6a-4bca-a40e-b1610a289392 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 13:01:11.126801 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 519/1023] 10.222.0.52 () {56 vars in 1120 bytes} [Tue Mar 8 13:01:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:11.133365 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1331571-b00b-4b18-b5df-a628187f1ab6 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:11.227889 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1331571-b00b-4b18-b5df-a628187f1ab6 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:11.259950 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7269bc-c9f6-4ce5-b2ea-91ec14a2cbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:11.260643 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7269bc-c9f6-4ce5-b2ea-91ec14a2cbaf None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:11.260928 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7269bc-c9f6-4ce5-b2ea-91ec14a2cbaf None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:11.261204 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7269bc-c9f6-4ce5-b2ea-91ec14a2cbaf None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:11.261946 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7269bc-c9f6-4ce5-b2ea-91ec14a2cbaf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:11.262251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7269bc-c9f6-4ce5-b2ea-91ec14a2cbaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:11.263620 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7269bc-c9f6-4ce5-b2ea-91ec14a2cbaf None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:11.276903 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 505/1024] 10.222.0.52 () {56 vars in 1115 bytes} [Tue Mar 8 13:01:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:11.278436 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6df19-3f6a-4bca-a40e-b1610a289392 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:11.383746 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6df19-3f6a-4bca-a40e-b1610a289392 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:11.417152 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67c40e-6d3f-4af0-bd4b-6762f2ae59a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:11.417938 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67c40e-6d3f-4af0-bd4b-6762f2ae59a8 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:11.418217 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67c40e-6d3f-4af0-bd4b-6762f2ae59a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:11.418486 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67c40e-6d3f-4af0-bd4b-6762f2ae59a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:11.428730 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67c40e-6d3f-4af0-bd4b-6762f2ae59a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:11.430284 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67c40e-6d3f-4af0-bd4b-6762f2ae59a8 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:11.446438 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-1d67c40e-6d3f-4af0-bd4b-6762f2ae59a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:01:11.447780 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 520/1025] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:01:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:01:11.453363 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7269bc-c9f6-4ce5-b2ea-91ec14a2cbaf None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:11.548475 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7269bc-c9f6-4ce5-b2ea-91ec14a2cbaf None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:11.580393 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f828d-1460-40ba-a15d-1925a42dff3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:11.581076 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f828d-1460-40ba-a15d-1925a42dff3c None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:11.581358 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f828d-1460-40ba-a15d-1925a42dff3c None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:11.581630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f828d-1460-40ba-a15d-1925a42dff3c None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:11.582892 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f828d-1460-40ba-a15d-1925a42dff3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:11.583375 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f828d-1460-40ba-a15d-1925a42dff3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:11.584792 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f828d-1460-40ba-a15d-1925a42dff3c None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:11.600986 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 506/1026] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:11.602279 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67c40e-6d3f-4af0-bd4b-6762f2ae59a8 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:11.701365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67c40e-6d3f-4af0-bd4b-6762f2ae59a8 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:11.734009 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31480ac1-7c24-43d4-a453-6a562cf503fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:11.734794 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31480ac1-7c24-43d4-a453-6a562cf503fe None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:11.735074 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31480ac1-7c24-43d4-a453-6a562cf503fe None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:11.735343 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31480ac1-7c24-43d4-a453-6a562cf503fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:11.742885 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31480ac1-7c24-43d4-a453-6a562cf503fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:11.744348 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31480ac1-7c24-43d4-a453-6a562cf503fe None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:11.757838 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-31480ac1-7c24-43d4-a453-6a562cf503fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 13:01:11.759200 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 521/1027] 10.222.0.52 () {56 vars in 1093 bytes} [Tue Mar 8 13:01:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:11.764715 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f828d-1460-40ba-a15d-1925a42dff3c None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:11.863113 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f828d-1460-40ba-a15d-1925a42dff3c None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:11.904809 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b875679-ffcc-4008-b478-697ff8bc08b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:11.905477 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b875679-ffcc-4008-b478-697ff8bc08b0 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:11.905758 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b875679-ffcc-4008-b478-697ff8bc08b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:11.906031 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b875679-ffcc-4008-b478-697ff8bc08b0 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:11.906860 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b875679-ffcc-4008-b478-697ff8bc08b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:11.907165 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b875679-ffcc-4008-b478-697ff8bc08b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:11.908598 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b875679-ffcc-4008-b478-697ff8bc08b0 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:11.930529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 507/1028] 10.222.0.52 () {56 vars in 1133 bytes} [Tue Mar 8 13:01:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:11.931751 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31480ac1-7c24-43d4-a453-6a562cf503fe None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:12.027014 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31480ac1-7c24-43d4-a453-6a562cf503fe None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:12.058813 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c36a39-1cd7-4584-9e53-838e8badbe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:12.059456 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c36a39-1cd7-4584-9e53-838e8badbe8f None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:12.059736 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c36a39-1cd7-4584-9e53-838e8badbe8f None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:12.060013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c36a39-1cd7-4584-9e53-838e8badbe8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:12.128992 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c36a39-1cd7-4584-9e53-838e8badbe8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:12.130960 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c36a39-1cd7-4584-9e53-838e8badbe8f None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:12.230100 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 522/1029] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:01:11 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 13:01:12.231277 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b875679-ffcc-4008-b478-697ff8bc08b0 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:12.327136 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b875679-ffcc-4008-b478-697ff8bc08b0 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:12.364300 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580622e8-ccce-42bc-a418-eff534bbde9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:12.365373 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580622e8-ccce-42bc-a418-eff534bbde9c None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:12.365658 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580622e8-ccce-42bc-a418-eff534bbde9c None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:12.365931 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580622e8-ccce-42bc-a418-eff534bbde9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:12.376927 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580622e8-ccce-42bc-a418-eff534bbde9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:12.378378 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580622e8-ccce-42bc-a418-eff534bbde9c None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:12.401777 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-580622e8-ccce-42bc-a418-eff534bbde9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:01:12.403169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 508/1030] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:12.408752 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c36a39-1cd7-4584-9e53-838e8badbe8f None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:12.460296 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8d46b-11e8-449d-8766-2c38a802caee None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:12.460579 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8d46b-11e8-449d-8766-2c38a802caee None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:12.461049 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8d46b-11e8-449d-8766-2c38a802caee None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:12.462815 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 509/1031] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:01:12.468063 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f1fe9-a6a0-4a22-a0e9-680b61510fee None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:12.468364 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f1fe9-a6a0-4a22-a0e9-680b61510fee None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:12.468619 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f1fe9-a6a0-4a22-a0e9-680b61510fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:12.485843 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-348f1fe9-a6a0-4a22-a0e9-680b61510fee None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:12.487042 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-348f1fe9-a6a0-4a22-a0e9-680b61510fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:12.507722 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c36a39-1cd7-4584-9e53-838e8badbe8f None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:12.541774 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecf2ab-7040-417a-887f-ec8b9b4f9c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:12.542428 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecf2ab-7040-417a-887f-ec8b9b4f9c03 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:12.542705 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecf2ab-7040-417a-887f-ec8b9b4f9c03 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:12.542978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecf2ab-7040-417a-887f-ec8b9b4f9c03 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:12.543688 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ecf2ab-7040-417a-887f-ec8b9b4f9c03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:12.547732 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ecf2ab-7040-417a-887f-ec8b9b4f9c03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:12.547732 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ecf2ab-7040-417a-887f-ec8b9b4f9c03 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:12.555776 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 510/1032] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:01:12.561586 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 523/1033] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:12.562695 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f1fe9-a6a0-4a22-a0e9-680b61510fee None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:12.579177 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecf2ab-7040-417a-887f-ec8b9b4f9c03 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:12.660131 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f1fe9-a6a0-4a22-a0e9-680b61510fee None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:12.680037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecf2ab-7040-417a-887f-ec8b9b4f9c03 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:12.703353 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be4867-fc85-4569-a233-d9eb65864008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:12.704394 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be4867-fc85-4569-a233-d9eb65864008 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:12.704872 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be4867-fc85-4569-a233-d9eb65864008 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:12.705285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be4867-fc85-4569-a233-d9eb65864008 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:12.712772 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be4867-fc85-4569-a233-d9eb65864008 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:12.714386 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be4867-fc85-4569-a233-d9eb65864008 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:12.718020 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1030a1-ac7d-4e1e-94dc-431dc032aa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:12.718833 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1030a1-ac7d-4e1e-94dc-431dc032aa06 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:12.719117 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1030a1-ac7d-4e1e-94dc-431dc032aa06 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:12.719392 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1030a1-ac7d-4e1e-94dc-431dc032aa06 None admin] PATH_INFO: `/v3/services/image` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:12.720050 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1030a1-ac7d-4e1e-94dc-431dc032aa06 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:12.721780 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1030a1-ac7d-4e1e-94dc-431dc032aa06 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:12.729371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-f6be4867-fc85-4569-a233-d9eb65864008 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:01:12.735304 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 511/1034] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:01:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:12.735483 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-7e1030a1-ac7d-4e1e-94dc-431dc032aa06 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 08 13:01:12.735483 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 524/1035] 10.222.0.52 () {56 vars in 1105 bytes} [Tue Mar 8 13:01:12 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:01:12.737363 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be4867-fc85-4569-a233-d9eb65864008 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:12.743041 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1030a1-ac7d-4e1e-94dc-431dc032aa06 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:12.837609 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be4867-fc85-4569-a233-d9eb65864008 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:12.840558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1030a1-ac7d-4e1e-94dc-431dc032aa06 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:12.871282 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6416f0-c652-425b-92d5-391a09fb2b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:12.872041 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6416f0-c652-425b-92d5-391a09fb2b67 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:12.872318 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6416f0-c652-425b-92d5-391a09fb2b67 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:12.872595 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6416f0-c652-425b-92d5-391a09fb2b67 None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:12.873508 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6416f0-c652-425b-92d5-391a09fb2b67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:12.873761 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb61fd-6499-4653-8563-1d6c9841f1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:12.873887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6416f0-c652-425b-92d5-391a09fb2b67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:12.874418 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb61fd-6499-4653-8563-1d6c9841f1f3 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:12.874702 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb61fd-6499-4653-8563-1d6c9841f1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:12.874978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb61fd-6499-4653-8563-1d6c9841f1f3 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:12.875275 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6416f0-c652-425b-92d5-391a09fb2b67 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:12.875799 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb61fd-6499-4653-8563-1d6c9841f1f3 None admin] RBAC: Adding query filter params (name=image) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:12.876109 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb61fd-6499-4653-8563-1d6c9841f1f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:12.877492 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb61fd-6499-4653-8563-1d6c9841f1f3 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:12.882523 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 525/1036] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:01:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:12.887791 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb61fd-6499-4653-8563-1d6c9841f1f3 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:12.893234 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 512/1037] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:01:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:12.894582 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6416f0-c652-425b-92d5-391a09fb2b67 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:12.990041 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6416f0-c652-425b-92d5-391a09fb2b67 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:12.994778 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb61fd-6499-4653-8563-1d6c9841f1f3 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:13.024283 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d10a72-3d72-44b4-8f17-6c11fae33053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:13.025300 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d10a72-3d72-44b4-8f17-6c11fae33053 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:13.025772 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d10a72-3d72-44b4-8f17-6c11fae33053 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:13.026215 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d10a72-3d72-44b4-8f17-6c11fae33053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:13.027052 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d10a72-3d72-44b4-8f17-6c11fae33053 None admin] RBAC: Adding query filter params (role.id=f0c236d58c10498686f59d63c5bcaa3e, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=72d4ac44d04943a5b24c7a1d6a31b7f2) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:13.027361 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d10a72-3d72-44b4-8f17-6c11fae33053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:13.028825 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d10a72-3d72-44b4-8f17-6c11fae33053 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:13.033463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fde42d-ed74-4980-ab0c-e32b8614001f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:13.034400 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fde42d-ed74-4980-ab0c-e32b8614001f None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:13.034691 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fde42d-ed74-4980-ab0c-e32b8614001f None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:13.048249 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fde42d-ed74-4980-ab0c-e32b8614001f None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:13.048432 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 513/1038] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:01:12 2022] GET /identity/v3/role_assignments?user.id=72d4ac44d04943a5b24c7a1d6a31b7f2&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=f0c236d58c10498686f59d63c5bcaa3e => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:13.048534 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fde42d-ed74-4980-ab0c-e32b8614001f None admin] RBAC: Adding query filter params (type=image) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:13.048534 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fde42d-ed74-4980-ab0c-e32b8614001f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:13.048534 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fde42d-ed74-4980-ab0c-e32b8614001f None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:13.053320 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 526/1039] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:01:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:13.053603 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba3523-6a64-4bc0-9776-218b5a888899 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:13.053889 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba3523-6a64-4bc0-9776-218b5a888899 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:13.054169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba3523-6a64-4bc0-9776-218b5a888899 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:13.055452 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fde42d-ed74-4980-ab0c-e32b8614001f None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:13.056770 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 514/1040] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:01:13.061857 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daed0d-5a3a-4d50-b812-285647d8f05f None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:13.062169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daed0d-5a3a-4d50-b812-285647d8f05f None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:13.062427 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daed0d-5a3a-4d50-b812-285647d8f05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:13.085222 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-d4daed0d-5a3a-4d50-b812-285647d8f05f None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:13.086418 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-d4daed0d-5a3a-4d50-b812-285647d8f05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:13.159047 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 515/1041] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:01:13.173161 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fde42d-ed74-4980-ab0c-e32b8614001f None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:13.185654 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4daed0d-5a3a-4d50-b812-285647d8f05f None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:13.209141 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65566fc-e64c-4626-8343-d31f7859af9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:13.210135 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65566fc-e64c-4626-8343-d31f7859af9e None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:13.210619 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65566fc-e64c-4626-8343-d31f7859af9e None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:13.211059 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65566fc-e64c-4626-8343-d31f7859af9e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:13.212035 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65566fc-e64c-4626-8343-d31f7859af9e None admin] RBAC: Adding query filter params (interface=public, service_id=35c98579fb6643149d7ff6236a4de327, region_id=RegionOne) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:13.212525 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65566fc-e64c-4626-8343-d31f7859af9e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:13.214163 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65566fc-e64c-4626-8343-d31f7859af9e None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:13.220087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 527/1042] 10.222.0.52 () {56 vars in 1251 bytes} [Tue Mar 8 13:01:13 2022] GET /identity/v3/endpoints?service_id=35c98579fb6643149d7ff6236a4de327&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:13.226924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65566fc-e64c-4626-8343-d31f7859af9e None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:13.289703 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4daed0d-5a3a-4d50-b812-285647d8f05f None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:13.323252 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65566fc-e64c-4626-8343-d31f7859af9e None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:13.327472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc846413-b604-47c7-88ed-34fcb191fb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:13.328264 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc846413-b604-47c7-88ed-34fcb191fb75 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:13.328541 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc846413-b604-47c7-88ed-34fcb191fb75 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:13.328857 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc846413-b604-47c7-88ed-34fcb191fb75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:13.330090 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc846413-b604-47c7-88ed-34fcb191fb75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:13.331648 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc846413-b604-47c7-88ed-34fcb191fb75 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:13.339465 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 516/1043] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:01:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:13.340296 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc846413-b604-47c7-88ed-34fcb191fb75 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:13.357838 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c8e92-a0a7-4e3c-9847-a59798ec2cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:13.358503 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c8e92-a0a7-4e3c-9847-a59798ec2cf0 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:13.358780 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c8e92-a0a7-4e3c-9847-a59798ec2cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:13.359050 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c8e92-a0a7-4e3c-9847-a59798ec2cf0 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:13.359721 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c8e92-a0a7-4e3c-9847-a59798ec2cf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:13.361120 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c8e92-a0a7-4e3c-9847-a59798ec2cf0 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:13.368019 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 528/1044] 10.222.0.52 () {56 vars in 1087 bytes} [Tue Mar 8 13:01:13 2022] GET /identity/v3/services => generated 1957 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:01:13.491085 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc846413-b604-47c7-88ed-34fcb191fb75 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:13.545330 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccb5df-3e9b-4fac-a638-ee36fa8f99e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:13.546267 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccb5df-3e9b-4fac-a638-ee36fa8f99e2 None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:13.546721 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccb5df-3e9b-4fac-a638-ee36fa8f99e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:13.547170 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccb5df-3e9b-4fac-a638-ee36fa8f99e2 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:13.548369 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccb5df-3e9b-4fac-a638-ee36fa8f99e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:13.551459 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccb5df-3e9b-4fac-a638-ee36fa8f99e2 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:13.710099 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 517/1045] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 13:01:13 2022] POST /identity/v3/users => generated 285 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:01:15.428499 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc8749-0dcc-486c-857a-aa3a9464927d None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:15.429065 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc8749-0dcc-486c-857a-aa3a9464927d None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:15.429145 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc8749-0dcc-486c-857a-aa3a9464927d None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:15.430886 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 529/1046] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:15.436323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4fa78-174b-4893-8265-51b79e39ae80 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:15.436825 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4fa78-174b-4893-8265-51b79e39ae80 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:15.436932 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4fa78-174b-4893-8265-51b79e39ae80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:15.454121 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-54c4fa78-174b-4893-8265-51b79e39ae80 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:15.455279 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-54c4fa78-174b-4893-8265-51b79e39ae80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:15.526875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 518/1047] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:01:15.549561 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc8749-0dcc-486c-857a-aa3a9464927d None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:15.649769 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc8749-0dcc-486c-857a-aa3a9464927d None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:15.682448 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1d769-3aa1-416e-a5ae-c8dbea761bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:15.683252 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1d769-3aa1-416e-a5ae-c8dbea761bd5 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:15.683532 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1d769-3aa1-416e-a5ae-c8dbea761bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:15.683805 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1d769-3aa1-416e-a5ae-c8dbea761bd5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:15.694316 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1d769-3aa1-416e-a5ae-c8dbea761bd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:01:15.701607 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-9ba1d769-3aa1-416e-a5ae-c8dbea761bd5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 13:01:15.702949 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 530/1048] 10.222.0.52 () {56 vars in 1120 bytes} [Tue Mar 8 13:01:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:15.709312 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4fa78-174b-4893-8265-51b79e39ae80 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:15.722763 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9945e60-74b2-469e-bb70-59ea9871e0e5 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:15.723125 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9945e60-74b2-469e-bb70-59ea9871e0e5 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:15.723362 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9945e60-74b2-469e-bb70-59ea9871e0e5 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:15.725193 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 531/1049] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:01:15.730257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009160a-a6fc-4baf-87ff-866480f8014e None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:15.730540 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009160a-a6fc-4baf-87ff-866480f8014e None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:15.730813 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009160a-a6fc-4baf-87ff-866480f8014e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:15.747609 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-0009160a-a6fc-4baf-87ff-866480f8014e None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:15.748851 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0009160a-a6fc-4baf-87ff-866480f8014e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:15.811516 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4fa78-174b-4893-8265-51b79e39ae80 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:15.816591 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 532/1050] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:01:15.844082 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009160a-a6fc-4baf-87ff-866480f8014e None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:15.846023 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909801f0-83ec-4113-aa05-0eacfc430aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:15.846685 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909801f0-83ec-4113-aa05-0eacfc430aff None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:15.846968 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909801f0-83ec-4113-aa05-0eacfc430aff None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:15.847244 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909801f0-83ec-4113-aa05-0eacfc430aff None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:15.848226 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909801f0-83ec-4113-aa05-0eacfc430aff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:15.848530 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909801f0-83ec-4113-aa05-0eacfc430aff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:15.849972 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909801f0-83ec-4113-aa05-0eacfc430aff None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:15.858166 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 519/1051] 10.222.0.52 () {56 vars in 1115 bytes} [Tue Mar 8 13:01:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:15.864060 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909801f0-83ec-4113-aa05-0eacfc430aff None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:15.950060 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009160a-a6fc-4baf-87ff-866480f8014e None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:15.966239 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909801f0-83ec-4113-aa05-0eacfc430aff None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:15.983019 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53941e-907e-4115-a5c9-43b6ff8ba7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:15.984054 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53941e-907e-4115-a5c9-43b6ff8ba7a2 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:15.984480 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53941e-907e-4115-a5c9-43b6ff8ba7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:15.984952 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53941e-907e-4115-a5c9-43b6ff8ba7a2 None admin] PATH_INFO: `/v3/services/image` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:15.985603 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53941e-907e-4115-a5c9-43b6ff8ba7a2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:15.987104 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53941e-907e-4115-a5c9-43b6ff8ba7a2 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:16.000287 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-8f53941e-907e-4115-a5c9-43b6ff8ba7a2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 08 13:01:16.001579 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380354a-a4c6-4149-a63b-3879813aea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:16.008601 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 533/1052] 10.222.0.52 () {56 vars in 1105 bytes} [Tue Mar 8 13:01:15 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:01:16.008833 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380354a-a4c6-4149-a63b-3879813aea0e None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:16.008833 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380354a-a4c6-4149-a63b-3879813aea0e None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:16.008833 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380354a-a4c6-4149-a63b-3879813aea0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:16.010524 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53941e-907e-4115-a5c9-43b6ff8ba7a2 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:16.017744 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380354a-a4c6-4149-a63b-3879813aea0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:16.020220 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380354a-a4c6-4149-a63b-3879813aea0e None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:16.038421 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-4380354a-a4c6-4149-a63b-3879813aea0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:01:16.039689 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 520/1053] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:01:16.045681 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380354a-a4c6-4149-a63b-3879813aea0e None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:16.113705 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53941e-907e-4115-a5c9-43b6ff8ba7a2 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:16.142365 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380354a-a4c6-4149-a63b-3879813aea0e None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:16.147241 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a62934-98d9-4e7b-b2e2-67c6b1599505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:16.147898 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a62934-98d9-4e7b-b2e2-67c6b1599505 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:16.148176 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a62934-98d9-4e7b-b2e2-67c6b1599505 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:16.148710 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a62934-98d9-4e7b-b2e2-67c6b1599505 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:16.149450 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a62934-98d9-4e7b-b2e2-67c6b1599505 None admin] RBAC: Adding query filter params (name=image) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:16.149750 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a62934-98d9-4e7b-b2e2-67c6b1599505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:16.151118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a62934-98d9-4e7b-b2e2-67c6b1599505 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:16.155777 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 534/1054] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:01:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:16.156977 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7e09a-d74e-4256-a3fd-a64911ad1028 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:16.157263 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7e09a-d74e-4256-a3fd-a64911ad1028 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:16.157534 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7e09a-d74e-4256-a3fd-a64911ad1028 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:16.159277 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 535/1055] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:16.164269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7e09a-d74e-4256-a3fd-a64911ad1028 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:16.177176 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883debe8-1b93-420b-85cf-c85e8e39cd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:16.177836 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883debe8-1b93-420b-85cf-c85e8e39cd8a None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:16.178119 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883debe8-1b93-420b-85cf-c85e8e39cd8a None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:16.178393 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883debe8-1b93-420b-85cf-c85e8e39cd8a None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:16.179117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883debe8-1b93-420b-85cf-c85e8e39cd8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:16.179420 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883debe8-1b93-420b-85cf-c85e8e39cd8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:16.180812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883debe8-1b93-420b-85cf-c85e8e39cd8a None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:16.192130 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 521/1056] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:16.193579 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb6ad5-b52a-409f-9791-b0f144a90ed8 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:16.193868 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb6ad5-b52a-409f-9791-b0f144a90ed8 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:16.194147 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb6ad5-b52a-409f-9791-b0f144a90ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:16.209415 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-30bb6ad5-b52a-409f-9791-b0f144a90ed8 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:16.210550 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-30bb6ad5-b52a-409f-9791-b0f144a90ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:16.262711 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7e09a-d74e-4256-a3fd-a64911ad1028 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:16.272832 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 522/1057] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:01:16.273911 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb6ad5-b52a-409f-9791-b0f144a90ed8 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:16.295439 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce301b-5a6c-4c99-a722-8136e059f0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:16.296200 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce301b-5a6c-4c99-a722-8136e059f0c2 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:16.296484 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce301b-5a6c-4c99-a722-8136e059f0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:16.296805 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce301b-5a6c-4c99-a722-8136e059f0c2 None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:16.297519 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce301b-5a6c-4c99-a722-8136e059f0c2 None admin] RBAC: Adding query filter params (type=image) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:16.297823 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce301b-5a6c-4c99-a722-8136e059f0c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:16.299206 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce301b-5a6c-4c99-a722-8136e059f0c2 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:16.304694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 536/1058] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:01:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:16.304886 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce301b-5a6c-4c99-a722-8136e059f0c2 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:16.368894 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb6ad5-b52a-409f-9791-b0f144a90ed8 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:16.400718 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce301b-5a6c-4c99-a722-8136e059f0c2 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:16.401454 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e06e2c-ec8e-434d-abdb-01212ef824ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:16.402243 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e06e2c-ec8e-434d-abdb-01212ef824ed None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:16.402528 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e06e2c-ec8e-434d-abdb-01212ef824ed None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:16.402807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e06e2c-ec8e-434d-abdb-01212ef824ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:16.410673 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e06e2c-ec8e-434d-abdb-01212ef824ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:16.412142 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e06e2c-ec8e-434d-abdb-01212ef824ed None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:16.425002 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-a8e06e2c-ec8e-434d-abdb-01212ef824ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 13:01:16.426633 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 523/1059] 10.222.0.52 () {56 vars in 1093 bytes} [Tue Mar 8 13:01:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:16.430727 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e06e2c-ec8e-434d-abdb-01212ef824ed None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:16.432690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8e45e-322d-4854-869f-13f170304d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:16.433487 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8e45e-322d-4854-869f-13f170304d9c None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:16.433764 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8e45e-322d-4854-869f-13f170304d9c None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:16.434033 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8e45e-322d-4854-869f-13f170304d9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:16.446288 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8e45e-322d-4854-869f-13f170304d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:01:16.453374 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-25d8e45e-322d-4854-869f-13f170304d9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:01:16.454568 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 537/1060] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:01:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:16.455510 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8e45e-322d-4854-869f-13f170304d9c None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:16.538105 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e06e2c-ec8e-434d-abdb-01212ef824ed None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:16.558207 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8e45e-322d-4854-869f-13f170304d9c None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:16.569147 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292b647-c5e9-42d6-a91b-a5e2e6a4dd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:16.569793 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292b647-c5e9-42d6-a91b-a5e2e6a4dd40 None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:16.570098 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292b647-c5e9-42d6-a91b-a5e2e6a4dd40 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:16.570373 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292b647-c5e9-42d6-a91b-a5e2e6a4dd40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:16.571089 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292b647-c5e9-42d6-a91b-a5e2e6a4dd40 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:16.572457 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292b647-c5e9-42d6-a91b-a5e2e6a4dd40 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:16.590230 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0d754-afef-434e-8a8d-80cd2f8eb13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:16.590883 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0d754-afef-434e-8a8d-80cd2f8eb13a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:16.591160 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0d754-afef-434e-8a8d-80cd2f8eb13a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:16.591427 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0d754-afef-434e-8a8d-80cd2f8eb13a None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:16.592239 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0d754-afef-434e-8a8d-80cd2f8eb13a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:16.592541 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0d754-afef-434e-8a8d-80cd2f8eb13a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:16.594024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0d754-afef-434e-8a8d-80cd2f8eb13a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:16.610780 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 538/1061] 10.222.0.52 () {56 vars in 1133 bytes} [Tue Mar 8 13:01:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:16.611753 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0d754-afef-434e-8a8d-80cd2f8eb13a None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:16.666643 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 524/1062] 10.222.0.52 () {60 vars in 1144 bytes} [Tue Mar 8 13:01:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:01:16.667479 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292b647-c5e9-42d6-a91b-a5e2e6a4dd40 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:16.708856 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0d754-afef-434e-8a8d-80cd2f8eb13a None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:16.751907 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac8eab-9105-4d73-b052-d29a190ea5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:16.752606 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac8eab-9105-4d73-b052-d29a190ea5c7 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:16.752917 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac8eab-9105-4d73-b052-d29a190ea5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:16.753188 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac8eab-9105-4d73-b052-d29a190ea5c7 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:16.754832 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac8eab-9105-4d73-b052-d29a190ea5c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:16.755268 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac8eab-9105-4d73-b052-d29a190ea5c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:16.756581 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac8eab-9105-4d73-b052-d29a190ea5c7 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:16.769097 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 539/1063] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:01:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:16.772283 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac8eab-9105-4d73-b052-d29a190ea5c7 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:16.792965 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292b647-c5e9-42d6-a91b-a5e2e6a4dd40 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:16.829159 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c85a3-6050-496c-877c-8ac463d07793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:16.829969 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c85a3-6050-496c-877c-8ac463d07793 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:16.830251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c85a3-6050-496c-877c-8ac463d07793 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:16.830527 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c85a3-6050-496c-877c-8ac463d07793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:16.842380 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c85a3-6050-496c-877c-8ac463d07793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:16.843890 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c85a3-6050-496c-877c-8ac463d07793 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:16.863469 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-af1c85a3-6050-496c-877c-8ac463d07793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:01:16.864876 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 525/1064] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:16.870327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c85a3-6050-496c-877c-8ac463d07793 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:16.881488 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac8eab-9105-4d73-b052-d29a190ea5c7 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:16.915504 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14fe97-483e-4e05-bdb6-6ff4ad976386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:16.916582 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14fe97-483e-4e05-bdb6-6ff4ad976386 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:16.916901 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14fe97-483e-4e05-bdb6-6ff4ad976386 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:16.917181 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14fe97-483e-4e05-bdb6-6ff4ad976386 None admin] PATH_INFO: `/v3/users/bedc65eef1b3466686e1ad7b52b1d91a` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:16.930370 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14fe97-483e-4e05-bdb6-6ff4ad976386 None admin] RBAC: Authorizing `identity:get_user(user_id=bedc65eef1b3466686e1ad7b52b1d91a)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:16.931842 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14fe97-483e-4e05-bdb6-6ff4ad976386 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:16.936812 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 540/1065] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 13:01:16 2022] GET /identity/v3/users/bedc65eef1b3466686e1ad7b52b1d91a => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:16.939011 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14fe97-483e-4e05-bdb6-6ff4ad976386 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:16.976512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c85a3-6050-496c-877c-8ac463d07793 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:17.008995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f99ed4-74a2-47f3-ac1a-1dae67b5e9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:17.009654 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f99ed4-74a2-47f3-ac1a-1dae67b5e9e2 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:17.009936 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f99ed4-74a2-47f3-ac1a-1dae67b5e9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:17.010211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f99ed4-74a2-47f3-ac1a-1dae67b5e9e2 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:17.010930 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f99ed4-74a2-47f3-ac1a-1dae67b5e9e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:17.011234 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f99ed4-74a2-47f3-ac1a-1dae67b5e9e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:17.012604 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f99ed4-74a2-47f3-ac1a-1dae67b5e9e2 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:17.025187 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 526/1066] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:17.030675 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f99ed4-74a2-47f3-ac1a-1dae67b5e9e2 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:17.037836 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14fe97-483e-4e05-bdb6-6ff4ad976386 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:17.071693 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd5bc2-e017-4597-ac21-583f5226c62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:17.072299 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd5bc2-e017-4597-ac21-583f5226c62c None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:17.072576 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd5bc2-e017-4597-ac21-583f5226c62c None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:17.072876 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd5bc2-e017-4597-ac21-583f5226c62c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:17.127553 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f99ed4-74a2-47f3-ac1a-1dae67b5e9e2 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:17.138685 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd5bc2-e017-4597-ac21-583f5226c62c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:17.140252 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd5bc2-e017-4597-ac21-583f5226c62c None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:17.161108 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fb7ee-c4da-4c6c-954e-5635455c4af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:17.161897 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fb7ee-c4da-4c6c-954e-5635455c4af3 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:17.162254 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fb7ee-c4da-4c6c-954e-5635455c4af3 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:17.162442 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fb7ee-c4da-4c6c-954e-5635455c4af3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:17.169490 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fb7ee-c4da-4c6c-954e-5635455c4af3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:17.170944 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fb7ee-c4da-4c6c-954e-5635455c4af3 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:17.185093 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-ed5fb7ee-c4da-4c6c-954e-5635455c4af3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:01:17.190988 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 527/1067] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:01:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:01:17.191883 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fb7ee-c4da-4c6c-954e-5635455c4af3 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:17.237716 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 541/1068] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:01:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 13:01:17.243869 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd5bc2-e017-4597-ac21-583f5226c62c None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:17.290537 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fb7ee-c4da-4c6c-954e-5635455c4af3 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:17.326579 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593f758-7cdb-4445-9c6f-72e4676eff3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:17.327175 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593f758-7cdb-4445-9c6f-72e4676eff3a None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:17.327455 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593f758-7cdb-4445-9c6f-72e4676eff3a None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:17.327726 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593f758-7cdb-4445-9c6f-72e4676eff3a None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:17.328568 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593f758-7cdb-4445-9c6f-72e4676eff3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:17.328908 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593f758-7cdb-4445-9c6f-72e4676eff3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:17.330335 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593f758-7cdb-4445-9c6f-72e4676eff3a None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:17.340470 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd5bc2-e017-4597-ac21-583f5226c62c None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:17.348212 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 528/1069] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:01:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:17.349106 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593f758-7cdb-4445-9c6f-72e4676eff3a None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:17.375832 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efb7af-a910-4172-bb10-a0509f9ceac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:17.376707 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efb7af-a910-4172-bb10-a0509f9ceac7 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:17.376989 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efb7af-a910-4172-bb10-a0509f9ceac7 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:17.377263 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efb7af-a910-4172-bb10-a0509f9ceac7 None admin] PATH_INFO: `/v3/projects/08cf7712b75b465696ded8e099b24354` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:17.378428 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50efb7af-a910-4172-bb10-a0509f9ceac7 None admin] RBAC: Authorizing `identity:get_project(project_id=08cf7712b75b465696ded8e099b24354)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:17.380523 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50efb7af-a910-4172-bb10-a0509f9ceac7 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:17.382459 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 542/1070] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 13:01:17 2022] GET /identity/v3/projects/08cf7712b75b465696ded8e099b24354 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:17.388027 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efb7af-a910-4172-bb10-a0509f9ceac7 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:17.452953 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593f758-7cdb-4445-9c6f-72e4676eff3a None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:17.486088 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efb7af-a910-4172-bb10-a0509f9ceac7 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:17.487479 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963d724-a646-4c4f-9d02-020e8b04fc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:17.489148 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963d724-a646-4c4f-9d02-020e8b04fc9e None admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:17.489148 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963d724-a646-4c4f-9d02-020e8b04fc9e None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:17.489148 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963d724-a646-4c4f-9d02-020e8b04fc9e None admin] PATH_INFO: `/v3/projects/2b478af53391486eb72c85c786ed4abb/users/72d4ac44d04943a5b24c7a1d6a31b7f2/roles/f0c236d58c10498686f59d63c5bcaa3e` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:17.491277 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963d724-a646-4c4f-9d02-020e8b04fc9e None admin] RBAC: Authorizing `identity:create_grant(project_id=2b478af53391486eb72c85c786ed4abb, user_id=72d4ac44d04943a5b24c7a1d6a31b7f2, role_id=f0c236d58c10498686f59d63c5bcaa3e)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:17.492808 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963d724-a646-4c4f-9d02-020e8b04fc9e None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:17.519518 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c6f03-c187-4ae0-9cef-e2dc785aa7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:17.520251 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c6f03-c187-4ae0-9cef-e2dc785aa7fe None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:17.520532 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c6f03-c187-4ae0-9cef-e2dc785aa7fe None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:17.520838 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c6f03-c187-4ae0-9cef-e2dc785aa7fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:17.521659 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c6f03-c187-4ae0-9cef-e2dc785aa7fe None admin] RBAC: Adding query filter params (role.id=f9ec85924a914e078096b38cae4e6caa, scope.project.id=08cf7712b75b465696ded8e099b24354, user.id=bedc65eef1b3466686e1ad7b52b1d91a) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:17.521966 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c6f03-c187-4ae0-9cef-e2dc785aa7fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:17.523645 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c6f03-c187-4ae0-9cef-e2dc785aa7fe None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:17.528889 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 543/1071] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:01:17 2022] GET /identity/v3/role_assignments?user.id=bedc65eef1b3466686e1ad7b52b1d91a&scope.project.id=08cf7712b75b465696ded8e099b24354&role.id=f9ec85924a914e078096b38cae4e6caa => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:17.589992 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 529/1072] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 13:01:17 2022] PUT /identity/v3/projects/2b478af53391486eb72c85c786ed4abb/users/72d4ac44d04943a5b24c7a1d6a31b7f2/roles/f0c236d58c10498686f59d63c5bcaa3e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:01:19.013893 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74137129-de98-438d-8aaa-0cf87eeac545 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:19.014416 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74137129-de98-438d-8aaa-0cf87eeac545 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:19.014416 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74137129-de98-438d-8aaa-0cf87eeac545 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:19.016389 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 544/1073] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:19.021750 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21060e2-8f97-4d32-9682-71339fc750ed None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:19.022136 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21060e2-8f97-4d32-9682-71339fc750ed None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:19.022294 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21060e2-8f97-4d32-9682-71339fc750ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:19.038835 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-c21060e2-8f97-4d32-9682-71339fc750ed None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:19.039997 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c21060e2-8f97-4d32-9682-71339fc750ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:19.103807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 530/1074] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:01:19.127118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74137129-de98-438d-8aaa-0cf87eeac545 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:19.231987 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74137129-de98-438d-8aaa-0cf87eeac545 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:19.265050 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e2b01-cbbb-4294-b53a-49e3fb304427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:19.265625 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e2b01-cbbb-4294-b53a-49e3fb304427 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:19.265909 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e2b01-cbbb-4294-b53a-49e3fb304427 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:19.266184 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e2b01-cbbb-4294-b53a-49e3fb304427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:19.332195 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e2b01-cbbb-4294-b53a-49e3fb304427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:19.333785 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e2b01-cbbb-4294-b53a-49e3fb304427 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:19.443228 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 545/1075] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:01:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:01:19.450073 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21060e2-8f97-4d32-9682-71339fc750ed None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:19.562475 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21060e2-8f97-4d32-9682-71339fc750ed None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:19.596900 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849699f7-ef9c-40eb-9d4a-ef5409b901bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:19.597832 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849699f7-ef9c-40eb-9d4a-ef5409b901bb None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:19.598116 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849699f7-ef9c-40eb-9d4a-ef5409b901bb None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:19.598393 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849699f7-ef9c-40eb-9d4a-ef5409b901bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:19.608995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849699f7-ef9c-40eb-9d4a-ef5409b901bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:19.610463 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849699f7-ef9c-40eb-9d4a-ef5409b901bb None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:19.627411 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-849699f7-ef9c-40eb-9d4a-ef5409b901bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:01:19.633509 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 531/1076] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:01:19.634709 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e2b01-cbbb-4294-b53a-49e3fb304427 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:19.731250 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e2b01-cbbb-4294-b53a-49e3fb304427 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:19.764438 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0e962-756f-4012-8a90-7e34c7c4c58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:19.765131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0e962-756f-4012-8a90-7e34c7c4c58a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:19.765416 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0e962-756f-4012-8a90-7e34c7c4c58a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:19.765689 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0e962-756f-4012-8a90-7e34c7c4c58a None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:19.766412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0e962-756f-4012-8a90-7e34c7c4c58a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:19.766718 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0e962-756f-4012-8a90-7e34c7c4c58a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:19.768098 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0e962-756f-4012-8a90-7e34c7c4c58a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:19.788712 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 546/1077] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:19.872870 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ebb5a-50e1-42ec-b2fd-c5c2cb0d24ed None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:19.873113 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ebb5a-50e1-42ec-b2fd-c5c2cb0d24ed None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:19.873348 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ebb5a-50e1-42ec-b2fd-c5c2cb0d24ed None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:19.876709 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 532/1078] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:19.881463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678838a0-7fec-49d5-9293-9d728e452d12 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:19.881759 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678838a0-7fec-49d5-9293-9d728e452d12 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:19.882042 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678838a0-7fec-49d5-9293-9d728e452d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:19.908349 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-678838a0-7fec-49d5-9293-9d728e452d12 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:19.909716 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-678838a0-7fec-49d5-9293-9d728e452d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:19.938191 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828b474-68a4-401e-a9bd-33d00fd05676 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:19.938549 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828b474-68a4-401e-a9bd-33d00fd05676 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:19.938754 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828b474-68a4-401e-a9bd-33d00fd05676 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:19.940726 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 533/1079] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:01:19.946788 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664579a-ccab-48c2-9e3e-0ee42c2c4735 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:19.947071 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664579a-ccab-48c2-9e3e-0ee42c2c4735 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:19.947475 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664579a-ccab-48c2-9e3e-0ee42c2c4735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:19.966827 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-6664579a-ccab-48c2-9e3e-0ee42c2c4735 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:19.968012 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6664579a-ccab-48c2-9e3e-0ee42c2c4735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:19.981050 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 547/1080] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:01:20.004355 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678838a0-7fec-49d5-9293-9d728e452d12 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:20.044689 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 534/1081] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:01:20.065642 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664579a-ccab-48c2-9e3e-0ee42c2c4735 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:20.105379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678838a0-7fec-49d5-9293-9d728e452d12 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:20.138308 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b355d63-71bb-4fd2-b843-90437231a08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:20.139021 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b355d63-71bb-4fd2-b843-90437231a08c None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:20.139300 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b355d63-71bb-4fd2-b843-90437231a08c None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:20.139567 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b355d63-71bb-4fd2-b843-90437231a08c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:20.150280 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b355d63-71bb-4fd2-b843-90437231a08c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:01:20.156968 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-5b355d63-71bb-4fd2-b843-90437231a08c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:01:20.158324 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 548/1082] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:01:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:20.164679 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b355d63-71bb-4fd2-b843-90437231a08c None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:20.167428 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664579a-ccab-48c2-9e3e-0ee42c2c4735 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:20.199498 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99bba0-890f-4a70-b432-64ba78c2a702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:20.200322 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99bba0-890f-4a70-b432-64ba78c2a702 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:20.200605 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99bba0-890f-4a70-b432-64ba78c2a702 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:20.200907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99bba0-890f-4a70-b432-64ba78c2a702 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:20.211340 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99bba0-890f-4a70-b432-64ba78c2a702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:01:20.218786 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-7e99bba0-890f-4a70-b432-64ba78c2a702 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 13:01:20.219974 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 535/1083] 10.222.0.52 () {56 vars in 1120 bytes} [Tue Mar 8 13:01:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:01:20.226677 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99bba0-890f-4a70-b432-64ba78c2a702 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:20.257888 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b355d63-71bb-4fd2-b843-90437231a08c None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:20.290153 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bccbb-665f-4fe5-8334-64b2a1e7b456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:20.290805 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bccbb-665f-4fe5-8334-64b2a1e7b456 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:20.291085 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bccbb-665f-4fe5-8334-64b2a1e7b456 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:20.291359 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bccbb-665f-4fe5-8334-64b2a1e7b456 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:20.292087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bccbb-665f-4fe5-8334-64b2a1e7b456 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:20.292388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bccbb-665f-4fe5-8334-64b2a1e7b456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:20.293791 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bccbb-665f-4fe5-8334-64b2a1e7b456 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:20.301665 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 549/1084] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:01:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:20.307282 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bccbb-665f-4fe5-8334-64b2a1e7b456 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:20.319432 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99bba0-890f-4a70-b432-64ba78c2a702 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:20.351669 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f9b09-9722-4013-91d7-785eedcef5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:20.352341 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f9b09-9722-4013-91d7-785eedcef5a2 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:20.352624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f9b09-9722-4013-91d7-785eedcef5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:20.352932 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f9b09-9722-4013-91d7-785eedcef5a2 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:20.353688 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f9b09-9722-4013-91d7-785eedcef5a2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:20.353996 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f9b09-9722-4013-91d7-785eedcef5a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:20.355381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f9b09-9722-4013-91d7-785eedcef5a2 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:20.363630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 536/1085] 10.222.0.52 () {56 vars in 1115 bytes} [Tue Mar 8 13:01:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:20.369138 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f9b09-9722-4013-91d7-785eedcef5a2 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:20.401630 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bccbb-665f-4fe5-8334-64b2a1e7b456 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:20.433323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109f11a-722d-4ee0-bec3-9e703aa20164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:20.434186 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109f11a-722d-4ee0-bec3-9e703aa20164 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:20.434461 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109f11a-722d-4ee0-bec3-9e703aa20164 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:20.434727 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109f11a-722d-4ee0-bec3-9e703aa20164 None admin] PATH_INFO: `/v3/users/bedc65eef1b3466686e1ad7b52b1d91a` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:20.435899 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109f11a-722d-4ee0-bec3-9e703aa20164 None admin] RBAC: Authorizing `identity:get_user(user_id=bedc65eef1b3466686e1ad7b52b1d91a)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:20.437389 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109f11a-722d-4ee0-bec3-9e703aa20164 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:20.438990 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 550/1086] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 13:01:20 2022] GET /identity/v3/users/bedc65eef1b3466686e1ad7b52b1d91a => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:20.445353 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109f11a-722d-4ee0-bec3-9e703aa20164 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:20.463996 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f9b09-9722-4013-91d7-785eedcef5a2 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:20.496100 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8dde6d-f8c5-4381-9fbc-69f26d81979d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:20.496912 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dde6d-f8c5-4381-9fbc-69f26d81979d None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:20.497196 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dde6d-f8c5-4381-9fbc-69f26d81979d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:20.497472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dde6d-f8c5-4381-9fbc-69f26d81979d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:20.507648 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8dde6d-f8c5-4381-9fbc-69f26d81979d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:20.509153 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8dde6d-f8c5-4381-9fbc-69f26d81979d None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:20.525048 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-2c8dde6d-f8c5-4381-9fbc-69f26d81979d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:01:20.526221 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 537/1087] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:01:20.531818 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8dde6d-f8c5-4381-9fbc-69f26d81979d None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:20.542360 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109f11a-722d-4ee0-bec3-9e703aa20164 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:20.571052 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43705c-0c1c-4827-a149-c31b8e90d18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:20.571890 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43705c-0c1c-4827-a149-c31b8e90d18a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:20.572168 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43705c-0c1c-4827-a149-c31b8e90d18a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:20.572436 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43705c-0c1c-4827-a149-c31b8e90d18a None admin] PATH_INFO: `/v3/projects/08cf7712b75b465696ded8e099b24354` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:20.573696 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43705c-0c1c-4827-a149-c31b8e90d18a None admin] RBAC: Authorizing `identity:get_project(project_id=08cf7712b75b465696ded8e099b24354)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:20.575108 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43705c-0c1c-4827-a149-c31b8e90d18a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:20.576864 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 551/1088] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 13:01:20 2022] GET /identity/v3/projects/08cf7712b75b465696ded8e099b24354 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:20.583097 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43705c-0c1c-4827-a149-c31b8e90d18a None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:20.626558 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8dde6d-f8c5-4381-9fbc-69f26d81979d None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:20.658178 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c95d5-debb-4767-8a64-fbe12f02cdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:20.658765 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c95d5-debb-4767-8a64-fbe12f02cdda None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:20.659046 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c95d5-debb-4767-8a64-fbe12f02cdda None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:20.659322 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c95d5-debb-4767-8a64-fbe12f02cdda None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:20.660615 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c95d5-debb-4767-8a64-fbe12f02cdda None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:20.660947 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c95d5-debb-4767-8a64-fbe12f02cdda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:20.662322 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c95d5-debb-4767-8a64-fbe12f02cdda None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:20.673513 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 538/1089] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:01:20.675594 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43705c-0c1c-4827-a149-c31b8e90d18a None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:20.679250 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c95d5-debb-4767-8a64-fbe12f02cdda None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:20.707961 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc99f2f-00f2-448b-9abc-6b41b404438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:20.708861 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc99f2f-00f2-448b-9abc-6b41b404438c None admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:20.709139 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc99f2f-00f2-448b-9abc-6b41b404438c None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:20.709409 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc99f2f-00f2-448b-9abc-6b41b404438c None admin] PATH_INFO: `/v3/projects/08cf7712b75b465696ded8e099b24354/users/bedc65eef1b3466686e1ad7b52b1d91a/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:20.711328 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc99f2f-00f2-448b-9abc-6b41b404438c None admin] RBAC: Authorizing `identity:create_grant(project_id=08cf7712b75b465696ded8e099b24354, user_id=bedc65eef1b3466686e1ad7b52b1d91a, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:20.712762 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc99f2f-00f2-448b-9abc-6b41b404438c None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:20.759853 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 552/1090] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 13:01:20 2022] PUT /identity/v3/projects/08cf7712b75b465696ded8e099b24354/users/bedc65eef1b3466686e1ad7b52b1d91a/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:01:20.784379 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c95d5-debb-4767-8a64-fbe12f02cdda None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:20.821057 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e377e1-cc22-4722-88d1-f72b175957f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:20.821875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e377e1-cc22-4722-88d1-f72b175957f2 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:20.822158 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e377e1-cc22-4722-88d1-f72b175957f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:20.822433 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e377e1-cc22-4722-88d1-f72b175957f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:20.830438 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e377e1-cc22-4722-88d1-f72b175957f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:20.832535 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e377e1-cc22-4722-88d1-f72b175957f2 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:20.847077 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-29e377e1-cc22-4722-88d1-f72b175957f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 13:01:20.848514 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 539/1091] 10.222.0.52 () {56 vars in 1093 bytes} [Tue Mar 8 13:01:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:20.854559 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc99f2f-00f2-448b-9abc-6b41b404438c None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:20.955908 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc99f2f-00f2-448b-9abc-6b41b404438c None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:20.987399 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc133a93-7676-4578-8c9f-d3ff0947fdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:20.988795 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc133a93-7676-4578-8c9f-d3ff0947fdba None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:20.989061 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc133a93-7676-4578-8c9f-d3ff0947fdba None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:20.989332 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc133a93-7676-4578-8c9f-d3ff0947fdba None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:20.990152 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc133a93-7676-4578-8c9f-d3ff0947fdba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:20.990456 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc133a93-7676-4578-8c9f-d3ff0947fdba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:20.991872 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc133a93-7676-4578-8c9f-d3ff0947fdba None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:21.008299 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 553/1092] 10.222.0.52 () {56 vars in 1133 bytes} [Tue Mar 8 13:01:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:21.014349 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e377e1-cc22-4722-88d1-f72b175957f2 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:21.119746 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e377e1-cc22-4722-88d1-f72b175957f2 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:21.152334 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b92a6-d1e3-4e5a-a625-4e108d467782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:21.153008 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b92a6-d1e3-4e5a-a625-4e108d467782 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:21.153289 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b92a6-d1e3-4e5a-a625-4e108d467782 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:21.153562 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b92a6-d1e3-4e5a-a625-4e108d467782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:21.216333 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b92a6-d1e3-4e5a-a625-4e108d467782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:21.217764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b92a6-d1e3-4e5a-a625-4e108d467782 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:21.310235 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 540/1093] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:01:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:01:21.315879 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc133a93-7676-4578-8c9f-d3ff0947fdba None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:21.412965 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc133a93-7676-4578-8c9f-d3ff0947fdba None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:21.444923 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5083b-52a5-4c5a-9838-c92c9e8a2492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:21.445705 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5083b-52a5-4c5a-9838-c92c9e8a2492 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:21.445979 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5083b-52a5-4c5a-9838-c92c9e8a2492 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:21.446242 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5083b-52a5-4c5a-9838-c92c9e8a2492 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:21.455774 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5083b-52a5-4c5a-9838-c92c9e8a2492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:21.457288 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5083b-52a5-4c5a-9838-c92c9e8a2492 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:21.473720 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-d0f5083b-52a5-4c5a-9838-c92c9e8a2492 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:01:21.474805 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 554/1094] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:21.480461 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b92a6-d1e3-4e5a-a625-4e108d467782 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:21.573367 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b92a6-d1e3-4e5a-a625-4e108d467782 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:21.605848 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c129e0-c75d-4151-9271-50a0de362661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:21.606503 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c129e0-c75d-4151-9271-50a0de362661 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:21.606783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c129e0-c75d-4151-9271-50a0de362661 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:21.607055 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c129e0-c75d-4151-9271-50a0de362661 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:21.607765 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c129e0-c75d-4151-9271-50a0de362661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:21.608068 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c129e0-c75d-4151-9271-50a0de362661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:21.609490 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c129e0-c75d-4151-9271-50a0de362661 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:21.620928 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 541/1095] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:21.626554 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5083b-52a5-4c5a-9838-c92c9e8a2492 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:21.720048 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5083b-52a5-4c5a-9838-c92c9e8a2492 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:21.752937 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f2f50-1627-4143-91de-80a4193addc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:21.753678 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f2f50-1627-4143-91de-80a4193addc3 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:21.753959 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f2f50-1627-4143-91de-80a4193addc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:21.754230 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f2f50-1627-4143-91de-80a4193addc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:21.760676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f2f50-1627-4143-91de-80a4193addc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:21.762133 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f2f50-1627-4143-91de-80a4193addc3 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:21.775343 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-ae4f2f50-1627-4143-91de-80a4193addc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:01:21.776504 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 555/1096] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:01:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:21.782291 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c129e0-c75d-4151-9271-50a0de362661 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:21.877793 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c129e0-c75d-4151-9271-50a0de362661 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:21.919649 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8f48d-8a8f-4344-95aa-63d447011158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:21.920309 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8f48d-8a8f-4344-95aa-63d447011158 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:21.920592 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8f48d-8a8f-4344-95aa-63d447011158 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:21.920897 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8f48d-8a8f-4344-95aa-63d447011158 None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:21.921679 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8f48d-8a8f-4344-95aa-63d447011158 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:21.921986 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8f48d-8a8f-4344-95aa-63d447011158 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:21.923420 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8f48d-8a8f-4344-95aa-63d447011158 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:21.935484 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 542/1097] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:01:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:21.941729 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f2f50-1627-4143-91de-80a4193addc3 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:22.038135 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f2f50-1627-4143-91de-80a4193addc3 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:22.069561 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5068107-67b3-4bd3-9284-ee90293a1019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:22.070212 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5068107-67b3-4bd3-9284-ee90293a1019 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:22.070492 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5068107-67b3-4bd3-9284-ee90293a1019 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:22.070766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5068107-67b3-4bd3-9284-ee90293a1019 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:22.071578 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5068107-67b3-4bd3-9284-ee90293a1019 None admin] RBAC: Adding query filter params (role.id=f0c236d58c10498686f59d63c5bcaa3e, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=72d4ac44d04943a5b24c7a1d6a31b7f2) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:22.071886 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5068107-67b3-4bd3-9284-ee90293a1019 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:22.073361 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5068107-67b3-4bd3-9284-ee90293a1019 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:22.078938 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 556/1098] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:01:21 2022] GET /identity/v3/role_assignments?user.id=72d4ac44d04943a5b24c7a1d6a31b7f2&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=f0c236d58c10498686f59d63c5bcaa3e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:23.049262 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b134689-c120-4be4-bd8b-689c468027a0 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:23.049786 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b134689-c120-4be4-bd8b-689c468027a0 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:23.049786 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b134689-c120-4be4-bd8b-689c468027a0 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:23.051630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 543/1099] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:23.056805 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02207cab-9740-4c0b-bc1d-48cbe652a7ea None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:23.057223 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02207cab-9740-4c0b-bc1d-48cbe652a7ea None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:23.057355 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02207cab-9740-4c0b-bc1d-48cbe652a7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:23.074328 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-02207cab-9740-4c0b-bc1d-48cbe652a7ea None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:23.075484 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-02207cab-9740-4c0b-bc1d-48cbe652a7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:23.137635 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 557/1100] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:01:23.161617 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b134689-c120-4be4-bd8b-689c468027a0 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:23.256065 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b134689-c120-4be4-bd8b-689c468027a0 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:23.287660 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2cdae-6f0b-45dd-9698-df30c6c086af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:23.288424 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2cdae-6f0b-45dd-9698-df30c6c086af None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:23.288727 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2cdae-6f0b-45dd-9698-df30c6c086af None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:23.289001 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2cdae-6f0b-45dd-9698-df30c6c086af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:23.298414 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2cdae-6f0b-45dd-9698-df30c6c086af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:01:23.305748 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-0fd2cdae-6f0b-45dd-9698-df30c6c086af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:01:23.306847 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 544/1101] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:01:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:23.312947 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02207cab-9740-4c0b-bc1d-48cbe652a7ea None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:23.406567 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02207cab-9740-4c0b-bc1d-48cbe652a7ea None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:23.439174 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f27e0e-4909-48af-90b0-2da27122f4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:23.439832 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f27e0e-4909-48af-90b0-2da27122f4f2 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:23.440116 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f27e0e-4909-48af-90b0-2da27122f4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:23.440391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f27e0e-4909-48af-90b0-2da27122f4f2 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:23.441154 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f27e0e-4909-48af-90b0-2da27122f4f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:23.441460 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f27e0e-4909-48af-90b0-2da27122f4f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:23.443617 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f27e0e-4909-48af-90b0-2da27122f4f2 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:23.451306 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 558/1102] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:01:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:23.457012 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2cdae-6f0b-45dd-9698-df30c6c086af None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:23.551287 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2cdae-6f0b-45dd-9698-df30c6c086af None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:23.591594 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690e0c6-0874-40f9-a936-d631e697f8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:23.591594 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690e0c6-0874-40f9-a936-d631e697f8de None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:23.591594 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690e0c6-0874-40f9-a936-d631e697f8de None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:23.591594 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690e0c6-0874-40f9-a936-d631e697f8de None admin] PATH_INFO: `/v3/users/bedc65eef1b3466686e1ad7b52b1d91a` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:23.592038 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690e0c6-0874-40f9-a936-d631e697f8de None admin] RBAC: Authorizing `identity:get_user(user_id=bedc65eef1b3466686e1ad7b52b1d91a)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:23.592038 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690e0c6-0874-40f9-a936-d631e697f8de None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:23.592038 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 545/1103] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 13:01:23 2022] GET /identity/v3/users/bedc65eef1b3466686e1ad7b52b1d91a => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:23.594107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f27e0e-4909-48af-90b0-2da27122f4f2 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:23.689098 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f27e0e-4909-48af-90b0-2da27122f4f2 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:23.720227 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c5d53-86ae-4720-85dc-2346586fffd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:23.721021 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c5d53-86ae-4720-85dc-2346586fffd2 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:23.721334 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c5d53-86ae-4720-85dc-2346586fffd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:23.721617 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c5d53-86ae-4720-85dc-2346586fffd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:23.784823 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c5d53-86ae-4720-85dc-2346586fffd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:23.786857 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c5d53-86ae-4720-85dc-2346586fffd2 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:23.877698 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 559/1104] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:01:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:01:23.883516 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690e0c6-0874-40f9-a936-d631e697f8de None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:23.980811 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690e0c6-0874-40f9-a936-d631e697f8de None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:24.012617 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4b998-3781-47ce-8e9f-3dab2907ddb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:24.013487 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4b998-3781-47ce-8e9f-3dab2907ddb1 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:24.013766 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4b998-3781-47ce-8e9f-3dab2907ddb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:24.014036 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4b998-3781-47ce-8e9f-3dab2907ddb1 None admin] PATH_INFO: `/v3/projects/08cf7712b75b465696ded8e099b24354` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:24.015191 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4b998-3781-47ce-8e9f-3dab2907ddb1 None admin] RBAC: Authorizing `identity:get_project(project_id=08cf7712b75b465696ded8e099b24354)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:24.016626 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4b998-3781-47ce-8e9f-3dab2907ddb1 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:24.018318 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 546/1105] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 13:01:23 2022] GET /identity/v3/projects/08cf7712b75b465696ded8e099b24354 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:24.024753 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c5d53-86ae-4720-85dc-2346586fffd2 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:24.116480 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c5d53-86ae-4720-85dc-2346586fffd2 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:24.149460 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb65b3-5ca3-488c-bebd-72da4be5edc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:24.150037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb65b3-5ca3-488c-bebd-72da4be5edc3 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:24.150312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb65b3-5ca3-488c-bebd-72da4be5edc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:24.150578 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb65b3-5ca3-488c-bebd-72da4be5edc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:24.151385 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb65b3-5ca3-488c-bebd-72da4be5edc3 None admin] RBAC: Adding query filter params (role.id=f9ec85924a914e078096b38cae4e6caa, scope.project.id=08cf7712b75b465696ded8e099b24354, user.id=bedc65eef1b3466686e1ad7b52b1d91a) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:24.151686 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb65b3-5ca3-488c-bebd-72da4be5edc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:24.153134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb65b3-5ca3-488c-bebd-72da4be5edc3 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:24.158617 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 560/1106] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:01:24 2022] GET /identity/v3/role_assignments?user.id=bedc65eef1b3466686e1ad7b52b1d91a&scope.project.id=08cf7712b75b465696ded8e099b24354&role.id=f9ec85924a914e078096b38cae4e6caa => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:26.451080 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43821630-7c95-4465-9f9d-ffb173b7b63a None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:26.451596 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43821630-7c95-4465-9f9d-ffb173b7b63a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:26.451707 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43821630-7c95-4465-9f9d-ffb173b7b63a None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:26.453437 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 547/1107] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:26.458638 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa946fcf-e51b-42a1-8d6b-c77678d638ec None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:26.459053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa946fcf-e51b-42a1-8d6b-c77678d638ec None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:26.459187 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa946fcf-e51b-42a1-8d6b-c77678d638ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:26.475429 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-aa946fcf-e51b-42a1-8d6b-c77678d638ec None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:26.476586 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-aa946fcf-e51b-42a1-8d6b-c77678d638ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:26.538638 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 561/1108] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:01:26.563724 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43821630-7c95-4465-9f9d-ffb173b7b63a None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:26.658296 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43821630-7c95-4465-9f9d-ffb173b7b63a None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:26.690270 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1e384-65ce-4d52-a8c0-855fe9359932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:26.691041 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1e384-65ce-4d52-a8c0-855fe9359932 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:26.691378 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1e384-65ce-4d52-a8c0-855fe9359932 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:26.691726 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1e384-65ce-4d52-a8c0-855fe9359932 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:26.693072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1e384-65ce-4d52-a8c0-855fe9359932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:26.694533 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1e384-65ce-4d52-a8c0-855fe9359932 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:26.696162 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 548/1109] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:01:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:26.701690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa946fcf-e51b-42a1-8d6b-c77678d638ec None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:26.799839 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa946fcf-e51b-42a1-8d6b-c77678d638ec None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:26.832577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c5cdc-7bd4-4aee-89e9-86a94435e474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:26.833270 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c5cdc-7bd4-4aee-89e9-86a94435e474 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:26.833550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c5cdc-7bd4-4aee-89e9-86a94435e474 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:26.833827 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c5cdc-7bd4-4aee-89e9-86a94435e474 None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:26.834538 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c5cdc-7bd4-4aee-89e9-86a94435e474 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:26.836039 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c5cdc-7bd4-4aee-89e9-86a94435e474 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:26.942595 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 562/1110] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 13:01:26 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:01:29.246812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef96aa8-7720-4b87-b55c-15a103ebf01f None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:29.247337 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef96aa8-7720-4b87-b55c-15a103ebf01f None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:29.247337 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef96aa8-7720-4b87-b55c-15a103ebf01f None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:29.249171 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 549/1111] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:29.254332 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ceb80e-5e1a-4a0b-a98f-51e463fdb9c9 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:29.254724 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ceb80e-5e1a-4a0b-a98f-51e463fdb9c9 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:29.254894 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ceb80e-5e1a-4a0b-a98f-51e463fdb9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:29.271795 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-01ceb80e-5e1a-4a0b-a98f-51e463fdb9c9 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:29.273246 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-01ceb80e-5e1a-4a0b-a98f-51e463fdb9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:29.336039 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 563/1112] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:01:29.358980 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef96aa8-7720-4b87-b55c-15a103ebf01f None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:29.459855 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef96aa8-7720-4b87-b55c-15a103ebf01f None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:29.494492 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05986f67-38b8-4c2d-baf4-a4d3099fb7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:29.495332 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05986f67-38b8-4c2d-baf4-a4d3099fb7f3 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:29.495613 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05986f67-38b8-4c2d-baf4-a4d3099fb7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:29.495885 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05986f67-38b8-4c2d-baf4-a4d3099fb7f3 None admin] PATH_INFO: `/v3/roles/a08ab7d3851a43ac8ed5339681d7de91` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:29.497401 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05986f67-38b8-4c2d-baf4-a4d3099fb7f3 None admin] RBAC: Authorizing `identity:get_role(role_id=a08ab7d3851a43ac8ed5339681d7de91)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:29.498714 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05986f67-38b8-4c2d-baf4-a4d3099fb7f3 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:29.500061 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 550/1113] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 13:01:29 2022] GET /identity/v3/roles/a08ab7d3851a43ac8ed5339681d7de91 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:29.505851 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ceb80e-5e1a-4a0b-a98f-51e463fdb9c9 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:29.597852 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ceb80e-5e1a-4a0b-a98f-51e463fdb9c9 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:29.629797 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619a7b6-a799-45b9-b205-d1f748adc97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:29.630651 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619a7b6-a799-45b9-b205-d1f748adc97f None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:29.630927 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619a7b6-a799-45b9-b205-d1f748adc97f None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:29.631197 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619a7b6-a799-45b9-b205-d1f748adc97f None admin] PATH_INFO: `/v3/users/d1795630d00842c7a3bfe70ebf84b439` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:29.643612 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619a7b6-a799-45b9-b205-d1f748adc97f None admin] RBAC: Authorizing `identity:get_user(user_id=d1795630d00842c7a3bfe70ebf84b439)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:29.645259 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619a7b6-a799-45b9-b205-d1f748adc97f None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:29.646865 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 564/1114] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 13:01:29 2022] GET /identity/v3/users/d1795630d00842c7a3bfe70ebf84b439 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:29.652903 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05986f67-38b8-4c2d-baf4-a4d3099fb7f3 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:29.746830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05986f67-38b8-4c2d-baf4-a4d3099fb7f3 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:29.777868 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9b025-8677-4a21-afab-fb0f792d4b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:29.778440 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9b025-8677-4a21-afab-fb0f792d4b13 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:29.778721 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9b025-8677-4a21-afab-fb0f792d4b13 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:29.778998 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9b025-8677-4a21-afab-fb0f792d4b13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:29.843379 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9b025-8677-4a21-afab-fb0f792d4b13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:29.844867 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9b025-8677-4a21-afab-fb0f792d4b13 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:29.936427 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 551/1115] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:01:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:01:29.942595 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619a7b6-a799-45b9-b205-d1f748adc97f None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:30.035491 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619a7b6-a799-45b9-b205-d1f748adc97f None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:30.066799 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777f29a-dceb-4845-8789-e90618ec42b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:30.067626 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777f29a-dceb-4845-8789-e90618ec42b7 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:30.067904 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777f29a-dceb-4845-8789-e90618ec42b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:30.068175 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777f29a-dceb-4845-8789-e90618ec42b7 None admin] PATH_INFO: `/v3/projects/08cf7712b75b465696ded8e099b24354` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:30.069344 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777f29a-dceb-4845-8789-e90618ec42b7 None admin] RBAC: Authorizing `identity:get_project(project_id=08cf7712b75b465696ded8e099b24354)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:30.070759 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777f29a-dceb-4845-8789-e90618ec42b7 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:30.072396 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 565/1116] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 13:01:29 2022] GET /identity/v3/projects/08cf7712b75b465696ded8e099b24354 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:30.078311 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9b025-8677-4a21-afab-fb0f792d4b13 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:30.169652 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9b025-8677-4a21-afab-fb0f792d4b13 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:30.200907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad020801-9cb2-4e26-81be-96036acfcacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:30.201540 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad020801-9cb2-4e26-81be-96036acfcacf None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:30.201818 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad020801-9cb2-4e26-81be-96036acfcacf None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:30.202089 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad020801-9cb2-4e26-81be-96036acfcacf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:30.202902 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad020801-9cb2-4e26-81be-96036acfcacf None admin] RBAC: Adding query filter params (role.id=a08ab7d3851a43ac8ed5339681d7de91, scope.project.id=08cf7712b75b465696ded8e099b24354, user.id=d1795630d00842c7a3bfe70ebf84b439) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:30.203209 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad020801-9cb2-4e26-81be-96036acfcacf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:30.204626 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad020801-9cb2-4e26-81be-96036acfcacf None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:30.210431 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 552/1117] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:01:30 2022] GET /identity/v3/role_assignments?user.id=d1795630d00842c7a3bfe70ebf84b439&scope.project.id=08cf7712b75b465696ded8e099b24354&role.id=a08ab7d3851a43ac8ed5339681d7de91 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:32.467383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca0c90-6ce1-491a-bf3b-90bfdf8c2a90 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:32.467876 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca0c90-6ce1-491a-bf3b-90bfdf8c2a90 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:32.467965 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca0c90-6ce1-491a-bf3b-90bfdf8c2a90 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:32.469748 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 566/1118] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:32.475456 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f86135-71c7-4057-bd78-ef951b8c9132 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:32.475819 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f86135-71c7-4057-bd78-ef951b8c9132 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:32.476011 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f86135-71c7-4057-bd78-ef951b8c9132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:32.493601 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-73f86135-71c7-4057-bd78-ef951b8c9132 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:32.494800 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-73f86135-71c7-4057-bd78-ef951b8c9132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:32.558068 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 553/1119] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:01:32.581782 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca0c90-6ce1-491a-bf3b-90bfdf8c2a90 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:32.676629 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca0c90-6ce1-491a-bf3b-90bfdf8c2a90 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:32.708436 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f7085-582b-44e6-b65e-7c34164d0e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:32.709292 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f7085-582b-44e6-b65e-7c34164d0e38 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:32.709568 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f7085-582b-44e6-b65e-7c34164d0e38 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:32.709838 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f7085-582b-44e6-b65e-7c34164d0e38 None admin] PATH_INFO: `/v3/roles/a08ab7d3851a43ac8ed5339681d7de91` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:32.711267 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f7085-582b-44e6-b65e-7c34164d0e38 None admin] RBAC: Authorizing `identity:get_role(role_id=a08ab7d3851a43ac8ed5339681d7de91)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:32.712626 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f7085-582b-44e6-b65e-7c34164d0e38 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:32.713972 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 567/1120] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 13:01:32 2022] GET /identity/v3/roles/a08ab7d3851a43ac8ed5339681d7de91 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:32.719634 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f86135-71c7-4057-bd78-ef951b8c9132 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:32.812546 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f86135-71c7-4057-bd78-ef951b8c9132 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:32.844393 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c959ed-e78b-4ce4-adb3-757da102adb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:32.845274 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c959ed-e78b-4ce4-adb3-757da102adb4 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:32.845553 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c959ed-e78b-4ce4-adb3-757da102adb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:32.845821 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c959ed-e78b-4ce4-adb3-757da102adb4 None admin] PATH_INFO: `/v3/users/d1795630d00842c7a3bfe70ebf84b439` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:32.846980 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c959ed-e78b-4ce4-adb3-757da102adb4 None admin] RBAC: Authorizing `identity:get_user(user_id=d1795630d00842c7a3bfe70ebf84b439)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:32.849305 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c959ed-e78b-4ce4-adb3-757da102adb4 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:32.850913 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 554/1121] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 13:01:32 2022] GET /identity/v3/users/d1795630d00842c7a3bfe70ebf84b439 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:32.856387 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f7085-582b-44e6-b65e-7c34164d0e38 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:32.948305 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f7085-582b-44e6-b65e-7c34164d0e38 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:32.980298 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8fc36-0d03-4df8-b9c0-9cef67b0ca9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:32.981157 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8fc36-0d03-4df8-b9c0-9cef67b0ca9b None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:32.981439 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8fc36-0d03-4df8-b9c0-9cef67b0ca9b None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:32.981711 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8fc36-0d03-4df8-b9c0-9cef67b0ca9b None admin] PATH_INFO: `/v3/projects/08cf7712b75b465696ded8e099b24354` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:32.982869 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8fc36-0d03-4df8-b9c0-9cef67b0ca9b None admin] RBAC: Authorizing `identity:get_project(project_id=08cf7712b75b465696ded8e099b24354)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:32.984286 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8fc36-0d03-4df8-b9c0-9cef67b0ca9b None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:32.985974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 568/1122] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 13:01:32 2022] GET /identity/v3/projects/08cf7712b75b465696ded8e099b24354 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:32.991774 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c959ed-e78b-4ce4-adb3-757da102adb4 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:33.084317 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c959ed-e78b-4ce4-adb3-757da102adb4 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:33.115946 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58befeba-5d8e-4839-8a62-62d50c94d366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:33.116833 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58befeba-5d8e-4839-8a62-62d50c94d366 None admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:33.117116 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58befeba-5d8e-4839-8a62-62d50c94d366 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:33.117386 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58befeba-5d8e-4839-8a62-62d50c94d366 None admin] PATH_INFO: `/v3/projects/08cf7712b75b465696ded8e099b24354/users/d1795630d00842c7a3bfe70ebf84b439/roles/a08ab7d3851a43ac8ed5339681d7de91` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:33.119522 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58befeba-5d8e-4839-8a62-62d50c94d366 None admin] RBAC: Authorizing `identity:create_grant(project_id=08cf7712b75b465696ded8e099b24354, user_id=d1795630d00842c7a3bfe70ebf84b439, role_id=a08ab7d3851a43ac8ed5339681d7de91)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:33.120965 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58befeba-5d8e-4839-8a62-62d50c94d366 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:33.202115 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 555/1123] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 13:01:32 2022] PUT /identity/v3/projects/08cf7712b75b465696ded8e099b24354/users/d1795630d00842c7a3bfe70ebf84b439/roles/a08ab7d3851a43ac8ed5339681d7de91 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:01:35.461305 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023cce8-11b5-4bcd-8901-eae291f33257 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:35.461807 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023cce8-11b5-4bcd-8901-eae291f33257 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:35.461896 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023cce8-11b5-4bcd-8901-eae291f33257 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:35.463649 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 569/1124] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:35.468921 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707a4bd-8297-4c9a-a6ee-18e1dd1ce2bd None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:35.469297 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707a4bd-8297-4c9a-a6ee-18e1dd1ce2bd None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:35.469471 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707a4bd-8297-4c9a-a6ee-18e1dd1ce2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:35.486217 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-3707a4bd-8297-4c9a-a6ee-18e1dd1ce2bd None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:35.487937 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-3707a4bd-8297-4c9a-a6ee-18e1dd1ce2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:35.551787 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 556/1125] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:01:35.574846 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023cce8-11b5-4bcd-8901-eae291f33257 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:35.671410 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023cce8-11b5-4bcd-8901-eae291f33257 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:35.702828 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5f7a1-2c50-42cf-ab63-0410ad4ca4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:35.703664 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5f7a1-2c50-42cf-ab63-0410ad4ca4ff None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:35.703944 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5f7a1-2c50-42cf-ab63-0410ad4ca4ff None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:35.704218 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5f7a1-2c50-42cf-ab63-0410ad4ca4ff None admin] PATH_INFO: `/v3/roles/a08ab7d3851a43ac8ed5339681d7de91` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:35.705684 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab5f7a1-2c50-42cf-ab63-0410ad4ca4ff None admin] RBAC: Authorizing `identity:get_role(role_id=a08ab7d3851a43ac8ed5339681d7de91)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:35.707164 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab5f7a1-2c50-42cf-ab63-0410ad4ca4ff None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:35.708511 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 570/1126] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 13:01:35 2022] GET /identity/v3/roles/a08ab7d3851a43ac8ed5339681d7de91 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:35.714348 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707a4bd-8297-4c9a-a6ee-18e1dd1ce2bd None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:35.807791 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707a4bd-8297-4c9a-a6ee-18e1dd1ce2bd None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:35.839170 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1fa89-ffcb-4bd9-97fa-635f96563ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:35.840045 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1fa89-ffcb-4bd9-97fa-635f96563ca6 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:35.840343 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1fa89-ffcb-4bd9-97fa-635f96563ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:35.840614 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1fa89-ffcb-4bd9-97fa-635f96563ca6 None admin] PATH_INFO: `/v3/users/d1795630d00842c7a3bfe70ebf84b439` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:35.841805 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1fa89-ffcb-4bd9-97fa-635f96563ca6 None admin] RBAC: Authorizing `identity:get_user(user_id=d1795630d00842c7a3bfe70ebf84b439)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:35.843230 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1fa89-ffcb-4bd9-97fa-635f96563ca6 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:35.844840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 557/1127] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 13:01:35 2022] GET /identity/v3/users/d1795630d00842c7a3bfe70ebf84b439 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:35.851059 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5f7a1-2c50-42cf-ab63-0410ad4ca4ff None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:35.943502 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5f7a1-2c50-42cf-ab63-0410ad4ca4ff None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:35.977239 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f0bbf-59f2-402a-a4da-2e791a8fbcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:35.977869 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f0bbf-59f2-402a-a4da-2e791a8fbcd6 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:35.978148 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f0bbf-59f2-402a-a4da-2e791a8fbcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:35.978420 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f0bbf-59f2-402a-a4da-2e791a8fbcd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:36.040514 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f0bbf-59f2-402a-a4da-2e791a8fbcd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:36.041972 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f0bbf-59f2-402a-a4da-2e791a8fbcd6 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:36.131758 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 571/1128] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:01:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:01:36.137705 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1fa89-ffcb-4bd9-97fa-635f96563ca6 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:36.231718 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1fa89-ffcb-4bd9-97fa-635f96563ca6 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:36.263373 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1a9e1-74a0-4eca-91d5-befede7d3199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:36.264214 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1a9e1-74a0-4eca-91d5-befede7d3199 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:36.264492 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1a9e1-74a0-4eca-91d5-befede7d3199 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:36.264790 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1a9e1-74a0-4eca-91d5-befede7d3199 None admin] PATH_INFO: `/v3/projects/08cf7712b75b465696ded8e099b24354` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:36.265966 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1a9e1-74a0-4eca-91d5-befede7d3199 None admin] RBAC: Authorizing `identity:get_project(project_id=08cf7712b75b465696ded8e099b24354)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:36.267401 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1a9e1-74a0-4eca-91d5-befede7d3199 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:36.269104 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 558/1129] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 13:01:36 2022] GET /identity/v3/projects/08cf7712b75b465696ded8e099b24354 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:36.276074 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f0bbf-59f2-402a-a4da-2e791a8fbcd6 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:36.368716 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f0bbf-59f2-402a-a4da-2e791a8fbcd6 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:36.401327 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb476a75-3cc3-4a2c-8d69-8b7e03cbc2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:36.401962 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb476a75-3cc3-4a2c-8d69-8b7e03cbc2d8 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:36.402237 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb476a75-3cc3-4a2c-8d69-8b7e03cbc2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:36.402505 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb476a75-3cc3-4a2c-8d69-8b7e03cbc2d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:36.403314 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb476a75-3cc3-4a2c-8d69-8b7e03cbc2d8 None admin] RBAC: Adding query filter params (role.id=a08ab7d3851a43ac8ed5339681d7de91, scope.project.id=08cf7712b75b465696ded8e099b24354, user.id=d1795630d00842c7a3bfe70ebf84b439) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:36.403620 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb476a75-3cc3-4a2c-8d69-8b7e03cbc2d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:36.405134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb476a75-3cc3-4a2c-8d69-8b7e03cbc2d8 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:36.410748 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 572/1130] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:01:36 2022] GET /identity/v3/role_assignments?user.id=d1795630d00842c7a3bfe70ebf84b439&scope.project.id=08cf7712b75b465696ded8e099b24354&role.id=a08ab7d3851a43ac8ed5339681d7de91 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:38.676467 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adfa67-2aff-489b-9646-5c4d9c1d49ee None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:38.676998 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adfa67-2aff-489b-9646-5c4d9c1d49ee None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:38.677107 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adfa67-2aff-489b-9646-5c4d9c1d49ee None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:38.678834 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 559/1131] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:38.683877 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6849cfd-6aa0-41de-82bb-eedc8baef1bb None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:38.684261 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6849cfd-6aa0-41de-82bb-eedc8baef1bb None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:38.684428 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6849cfd-6aa0-41de-82bb-eedc8baef1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:38.701997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-c6849cfd-6aa0-41de-82bb-eedc8baef1bb None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:38.703175 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-c6849cfd-6aa0-41de-82bb-eedc8baef1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:38.765171 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 573/1132] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:01:38.788914 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adfa67-2aff-489b-9646-5c4d9c1d49ee None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:38.885129 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adfa67-2aff-489b-9646-5c4d9c1d49ee None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:38.916048 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb14648-19af-41bd-9812-24611bab46c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:38.916840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb14648-19af-41bd-9812-24611bab46c8 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:38.917118 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb14648-19af-41bd-9812-24611bab46c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:38.917385 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb14648-19af-41bd-9812-24611bab46c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:38.918524 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb14648-19af-41bd-9812-24611bab46c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:38.919954 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb14648-19af-41bd-9812-24611bab46c8 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:38.921545 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 560/1133] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:01:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:38.927842 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6849cfd-6aa0-41de-82bb-eedc8baef1bb None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:39.018798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6849cfd-6aa0-41de-82bb-eedc8baef1bb None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:39.051595 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2888b95-7be2-4d18-88cf-f601abbe0310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:39.052158 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2888b95-7be2-4d18-88cf-f601abbe0310 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:39.052438 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2888b95-7be2-4d18-88cf-f601abbe0310 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:39.052746 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2888b95-7be2-4d18-88cf-f601abbe0310 None admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:39.053451 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2888b95-7be2-4d18-88cf-f601abbe0310 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:39.054880 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2888b95-7be2-4d18-88cf-f601abbe0310 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:39.165237 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 574/1134] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 13:01:38 2022] POST /identity/v3/projects => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:01:41.453409 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614a5dd-32ce-4176-9f92-e2e95d0721b7 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:41.453938 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614a5dd-32ce-4176-9f92-e2e95d0721b7 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:41.453938 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614a5dd-32ce-4176-9f92-e2e95d0721b7 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:41.455696 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 561/1135] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:41.461044 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667badbf-ac94-4076-ba04-6ece6e83fd64 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:41.461407 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667badbf-ac94-4076-ba04-6ece6e83fd64 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:41.461599 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667badbf-ac94-4076-ba04-6ece6e83fd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:41.478280 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-667badbf-ac94-4076-ba04-6ece6e83fd64 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:41.479427 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-667badbf-ac94-4076-ba04-6ece6e83fd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:41.541178 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 575/1136] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:01:41.565012 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614a5dd-32ce-4176-9f92-e2e95d0721b7 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:41.659845 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614a5dd-32ce-4176-9f92-e2e95d0721b7 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:41.691228 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d093c45-9898-488b-8314-22a896059738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:41.692084 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d093c45-9898-488b-8314-22a896059738 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:41.692358 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d093c45-9898-488b-8314-22a896059738 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:41.692622 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d093c45-9898-488b-8314-22a896059738 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:41.693796 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d093c45-9898-488b-8314-22a896059738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:41.695218 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d093c45-9898-488b-8314-22a896059738 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:41.696807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 562/1137] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:01:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:41.702352 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667badbf-ac94-4076-ba04-6ece6e83fd64 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:41.795650 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667badbf-ac94-4076-ba04-6ece6e83fd64 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:41.826979 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f266d68-ff5c-43a2-bc82-71cf512c21b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:41.827631 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f266d68-ff5c-43a2-bc82-71cf512c21b6 None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:41.827914 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f266d68-ff5c-43a2-bc82-71cf512c21b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:41.828187 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f266d68-ff5c-43a2-bc82-71cf512c21b6 None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:41.828926 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f266d68-ff5c-43a2-bc82-71cf512c21b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:41.830356 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f266d68-ff5c-43a2-bc82-71cf512c21b6 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:41.930245 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 576/1138] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 13:01:41 2022] POST /identity/v3/users => generated 286 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:01:44.312435 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43add714-6bb6-4cee-ae26-98c6954b2ef0 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:44.312991 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43add714-6bb6-4cee-ae26-98c6954b2ef0 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:44.312991 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43add714-6bb6-4cee-ae26-98c6954b2ef0 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:44.314782 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 563/1139] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:44.320568 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651bf26-a138-413e-9542-dc32e89add41 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:44.321030 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651bf26-a138-413e-9542-dc32e89add41 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:44.321150 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651bf26-a138-413e-9542-dc32e89add41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:44.337307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-d651bf26-a138-413e-9542-dc32e89add41 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:44.338461 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-d651bf26-a138-413e-9542-dc32e89add41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:44.401791 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 577/1140] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:01:44.424597 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43add714-6bb6-4cee-ae26-98c6954b2ef0 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:44.522260 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43add714-6bb6-4cee-ae26-98c6954b2ef0 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:44.553846 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b6d20-2391-4717-98c2-9cea953746b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:44.554613 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b6d20-2391-4717-98c2-9cea953746b5 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:44.554893 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b6d20-2391-4717-98c2-9cea953746b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:44.555164 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b6d20-2391-4717-98c2-9cea953746b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:44.564721 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b6d20-2391-4717-98c2-9cea953746b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:01:44.571544 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-716b6d20-2391-4717-98c2-9cea953746b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:01:44.572714 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 564/1141] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:01:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:44.581618 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651bf26-a138-413e-9542-dc32e89add41 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:44.672063 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651bf26-a138-413e-9542-dc32e89add41 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:44.704045 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f388cba-0a2a-4cdd-b0b4-6a6da9b55111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:44.704722 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f388cba-0a2a-4cdd-b0b4-6a6da9b55111 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:44.705006 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f388cba-0a2a-4cdd-b0b4-6a6da9b55111 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:44.705282 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f388cba-0a2a-4cdd-b0b4-6a6da9b55111 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:44.706070 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f388cba-0a2a-4cdd-b0b4-6a6da9b55111 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:44.706376 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f388cba-0a2a-4cdd-b0b4-6a6da9b55111 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:44.707767 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f388cba-0a2a-4cdd-b0b4-6a6da9b55111 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:44.715356 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 578/1142] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:01:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:44.721009 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b6d20-2391-4717-98c2-9cea953746b5 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:44.829654 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b6d20-2391-4717-98c2-9cea953746b5 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:44.862282 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8af44-e99a-441c-9b9a-115d80b3a738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:44.863153 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8af44-e99a-441c-9b9a-115d80b3a738 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:44.863434 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8af44-e99a-441c-9b9a-115d80b3a738 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:44.863710 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8af44-e99a-441c-9b9a-115d80b3a738 None admin] PATH_INFO: `/v3/users/c0f0d7cbb9d647559a2a8c9d8ccdcaa6` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:44.876318 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8af44-e99a-441c-9b9a-115d80b3a738 None admin] RBAC: Authorizing `identity:get_user(user_id=c0f0d7cbb9d647559a2a8c9d8ccdcaa6)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:44.877825 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8af44-e99a-441c-9b9a-115d80b3a738 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:44.879697 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 565/1143] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 13:01:44 2022] GET /identity/v3/users/c0f0d7cbb9d647559a2a8c9d8ccdcaa6 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:44.885426 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f388cba-0a2a-4cdd-b0b4-6a6da9b55111 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:44.979443 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f388cba-0a2a-4cdd-b0b4-6a6da9b55111 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:45.010020 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4096a5f-b39a-46e7-b6a8-cd4377101b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:45.010647 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4096a5f-b39a-46e7-b6a8-cd4377101b0a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:45.010924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4096a5f-b39a-46e7-b6a8-cd4377101b0a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:45.011194 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4096a5f-b39a-46e7-b6a8-cd4377101b0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:45.074376 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4096a5f-b39a-46e7-b6a8-cd4377101b0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:45.075843 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4096a5f-b39a-46e7-b6a8-cd4377101b0a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:45.172609 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 579/1144] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:01:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:01:45.178639 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8af44-e99a-441c-9b9a-115d80b3a738 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:45.273086 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8af44-e99a-441c-9b9a-115d80b3a738 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:45.304075 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdd0c2-1d8b-4764-9d31-8a1332e334cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:45.304934 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdd0c2-1d8b-4764-9d31-8a1332e334cb None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:45.305214 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdd0c2-1d8b-4764-9d31-8a1332e334cb None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:45.305490 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdd0c2-1d8b-4764-9d31-8a1332e334cb None admin] PATH_INFO: `/v3/projects/dcfe9dbac3e940aea7d416b1e39c1324` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:45.306644 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdd0c2-1d8b-4764-9d31-8a1332e334cb None admin] RBAC: Authorizing `identity:get_project(project_id=dcfe9dbac3e940aea7d416b1e39c1324)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:45.308071 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdd0c2-1d8b-4764-9d31-8a1332e334cb None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:45.309744 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 566/1145] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 13:01:45 2022] GET /identity/v3/projects/dcfe9dbac3e940aea7d416b1e39c1324 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:45.316200 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4096a5f-b39a-46e7-b6a8-cd4377101b0a None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:45.408849 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4096a5f-b39a-46e7-b6a8-cd4377101b0a None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:45.439741 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e05f0-184b-4ce8-8022-15c35f47646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:45.440940 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e05f0-184b-4ce8-8022-15c35f47646b None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:45.441215 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e05f0-184b-4ce8-8022-15c35f47646b None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:45.441563 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e05f0-184b-4ce8-8022-15c35f47646b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:45.442374 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e05f0-184b-4ce8-8022-15c35f47646b None admin] RBAC: Adding query filter params (role.id=f9ec85924a914e078096b38cae4e6caa, scope.project.id=dcfe9dbac3e940aea7d416b1e39c1324, user.id=c0f0d7cbb9d647559a2a8c9d8ccdcaa6) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:45.442678 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e05f0-184b-4ce8-8022-15c35f47646b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:45.444089 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e05f0-184b-4ce8-8022-15c35f47646b None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:45.449220 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 580/1146] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:01:45 2022] GET /identity/v3/role_assignments?user.id=c0f0d7cbb9d647559a2a8c9d8ccdcaa6&scope.project.id=dcfe9dbac3e940aea7d416b1e39c1324&role.id=f9ec85924a914e078096b38cae4e6caa => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:47.723106 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d705bd-3827-4fa4-9a70-29ede4723b9b None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:47.723687 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d705bd-3827-4fa4-9a70-29ede4723b9b None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:47.723687 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d705bd-3827-4fa4-9a70-29ede4723b9b None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:47.725444 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 567/1147] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:47.730692 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2aeb89-5a17-4dba-ad80-ab8ed7e50b9e None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:47.731145 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2aeb89-5a17-4dba-ad80-ab8ed7e50b9e None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:47.731249 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2aeb89-5a17-4dba-ad80-ab8ed7e50b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:47.748188 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-4f2aeb89-5a17-4dba-ad80-ab8ed7e50b9e None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:47.749398 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-4f2aeb89-5a17-4dba-ad80-ab8ed7e50b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:47.812320 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 581/1148] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:01:47.834952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d705bd-3827-4fa4-9a70-29ede4723b9b None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:47.931486 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d705bd-3827-4fa4-9a70-29ede4723b9b None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:47.963977 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc3b4a-efe9-4b93-8952-0ed79786429a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:47.964772 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc3b4a-efe9-4b93-8952-0ed79786429a None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:47.965056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc3b4a-efe9-4b93-8952-0ed79786429a None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:47.965328 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc3b4a-efe9-4b93-8952-0ed79786429a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:47.977998 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc3b4a-efe9-4b93-8952-0ed79786429a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:01:47.985263 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-86fc3b4a-efe9-4b93-8952-0ed79786429a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:01:47.986454 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 568/1149] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:01:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:47.992628 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2aeb89-5a17-4dba-ad80-ab8ed7e50b9e None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:48.084451 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2aeb89-5a17-4dba-ad80-ab8ed7e50b9e None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:48.115833 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dafab-5a9a-4f00-b5bc-64f2b287b1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:48.116479 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dafab-5a9a-4f00-b5bc-64f2b287b1aa None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:48.116794 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dafab-5a9a-4f00-b5bc-64f2b287b1aa None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:48.117068 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dafab-5a9a-4f00-b5bc-64f2b287b1aa None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:48.117794 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22dafab-5a9a-4f00-b5bc-64f2b287b1aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:48.118096 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22dafab-5a9a-4f00-b5bc-64f2b287b1aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:48.119446 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22dafab-5a9a-4f00-b5bc-64f2b287b1aa None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:48.126943 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 582/1150] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:01:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:48.132899 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc3b4a-efe9-4b93-8952-0ed79786429a None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:48.228168 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc3b4a-efe9-4b93-8952-0ed79786429a None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:48.259519 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e98572-1944-4cd2-9272-c71e3b2fe66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:48.260365 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e98572-1944-4cd2-9272-c71e3b2fe66c None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:48.260641 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e98572-1944-4cd2-9272-c71e3b2fe66c None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:48.260938 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e98572-1944-4cd2-9272-c71e3b2fe66c None admin] PATH_INFO: `/v3/users/c0f0d7cbb9d647559a2a8c9d8ccdcaa6` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:48.262090 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e98572-1944-4cd2-9272-c71e3b2fe66c None admin] RBAC: Authorizing `identity:get_user(user_id=c0f0d7cbb9d647559a2a8c9d8ccdcaa6)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:48.263528 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e98572-1944-4cd2-9272-c71e3b2fe66c None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:48.265151 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 569/1151] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 13:01:48 2022] GET /identity/v3/users/c0f0d7cbb9d647559a2a8c9d8ccdcaa6 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:48.271346 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dafab-5a9a-4f00-b5bc-64f2b287b1aa None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:48.365643 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dafab-5a9a-4f00-b5bc-64f2b287b1aa None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:48.396378 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e63614-053a-4b25-a5f2-a9cf3442d74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:48.397250 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e63614-053a-4b25-a5f2-a9cf3442d74f None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:48.397525 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e63614-053a-4b25-a5f2-a9cf3442d74f None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:48.397793 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e63614-053a-4b25-a5f2-a9cf3442d74f None admin] PATH_INFO: `/v3/projects/dcfe9dbac3e940aea7d416b1e39c1324` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:48.398939 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e63614-053a-4b25-a5f2-a9cf3442d74f None admin] RBAC: Authorizing `identity:get_project(project_id=dcfe9dbac3e940aea7d416b1e39c1324)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:48.400363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e63614-053a-4b25-a5f2-a9cf3442d74f None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:48.402049 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 583/1152] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 13:01:48 2022] GET /identity/v3/projects/dcfe9dbac3e940aea7d416b1e39c1324 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:48.407875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e98572-1944-4cd2-9272-c71e3b2fe66c None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:48.500266 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e98572-1944-4cd2-9272-c71e3b2fe66c None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:48.535690 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da831d-2886-44ee-a3cc-495b088830fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:48.536681 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da831d-2886-44ee-a3cc-495b088830fd None admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:48.536960 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da831d-2886-44ee-a3cc-495b088830fd None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:48.537230 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da831d-2886-44ee-a3cc-495b088830fd None admin] PATH_INFO: `/v3/projects/dcfe9dbac3e940aea7d416b1e39c1324/users/c0f0d7cbb9d647559a2a8c9d8ccdcaa6/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:48.539181 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da831d-2886-44ee-a3cc-495b088830fd None admin] RBAC: Authorizing `identity:create_grant(project_id=dcfe9dbac3e940aea7d416b1e39c1324, user_id=c0f0d7cbb9d647559a2a8c9d8ccdcaa6, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:48.540613 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da831d-2886-44ee-a3cc-495b088830fd None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:48.634861 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 570/1153] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 13:01:48 2022] PUT /identity/v3/projects/dcfe9dbac3e940aea7d416b1e39c1324/users/c0f0d7cbb9d647559a2a8c9d8ccdcaa6/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:01:50.920300 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051e732-8676-4c45-aeb7-3ae962f7ef0a None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:50.920913 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051e732-8676-4c45-aeb7-3ae962f7ef0a None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:50.920913 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051e732-8676-4c45-aeb7-3ae962f7ef0a None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:50.922644 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 584/1154] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:50.928354 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2efe9-86e7-4979-97e7-ea0b4d0b58a1 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:50.928799 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2efe9-86e7-4979-97e7-ea0b4d0b58a1 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:50.928917 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2efe9-86e7-4979-97e7-ea0b4d0b58a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:50.945952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-bbe2efe9-86e7-4979-97e7-ea0b4d0b58a1 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:50.947135 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-bbe2efe9-86e7-4979-97e7-ea0b4d0b58a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:51.008931 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 571/1155] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:01:51.032859 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051e732-8676-4c45-aeb7-3ae962f7ef0a None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:51.128874 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051e732-8676-4c45-aeb7-3ae962f7ef0a None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:51.159895 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf237d27-4d5d-4b52-ba91-d146d10f35d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:51.160688 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf237d27-4d5d-4b52-ba91-d146d10f35d2 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:51.160965 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf237d27-4d5d-4b52-ba91-d146d10f35d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:51.161240 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf237d27-4d5d-4b52-ba91-d146d10f35d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:51.171122 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf237d27-4d5d-4b52-ba91-d146d10f35d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:01:51.178402 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-bf237d27-4d5d-4b52-ba91-d146d10f35d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:01:51.179550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 585/1156] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:01:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:51.185518 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2efe9-86e7-4979-97e7-ea0b4d0b58a1 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:51.279507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2efe9-86e7-4979-97e7-ea0b4d0b58a1 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:51.311997 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5884c-c393-4d76-8c38-1a1b488c6810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:51.312646 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5884c-c393-4d76-8c38-1a1b488c6810 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:51.312960 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5884c-c393-4d76-8c38-1a1b488c6810 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:51.313239 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5884c-c393-4d76-8c38-1a1b488c6810 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:51.313978 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5884c-c393-4d76-8c38-1a1b488c6810 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:51.314284 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5884c-c393-4d76-8c38-1a1b488c6810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:51.315874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5884c-c393-4d76-8c38-1a1b488c6810 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:51.323680 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 572/1157] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:01:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:51.329522 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf237d27-4d5d-4b52-ba91-d146d10f35d2 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:51.462481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf237d27-4d5d-4b52-ba91-d146d10f35d2 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:51.462481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34319f-706d-4472-87f2-89b019955b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:51.462481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34319f-706d-4472-87f2-89b019955b37 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:51.462481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34319f-706d-4472-87f2-89b019955b37 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:51.462998 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34319f-706d-4472-87f2-89b019955b37 None admin] PATH_INFO: `/v3/users/c0f0d7cbb9d647559a2a8c9d8ccdcaa6` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:51.462998 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34319f-706d-4472-87f2-89b019955b37 None admin] RBAC: Authorizing `identity:get_user(user_id=c0f0d7cbb9d647559a2a8c9d8ccdcaa6)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:51.464438 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34319f-706d-4472-87f2-89b019955b37 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:51.466435 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 586/1158] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 13:01:51 2022] GET /identity/v3/users/c0f0d7cbb9d647559a2a8c9d8ccdcaa6 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:51.472916 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5884c-c393-4d76-8c38-1a1b488c6810 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:51.569343 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5884c-c393-4d76-8c38-1a1b488c6810 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:51.602257 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180222a-ab89-4dd1-84cd-cde6750b4e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:51.602919 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180222a-ab89-4dd1-84cd-cde6750b4e61 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:51.604222 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180222a-ab89-4dd1-84cd-cde6750b4e61 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:51.604222 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180222a-ab89-4dd1-84cd-cde6750b4e61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:51.667406 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180222a-ab89-4dd1-84cd-cde6750b4e61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:51.668820 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180222a-ab89-4dd1-84cd-cde6750b4e61 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:51.885543 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 573/1159] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:01:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 13:01:51.891354 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34319f-706d-4472-87f2-89b019955b37 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:51.985227 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34319f-706d-4472-87f2-89b019955b37 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:52.020260 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb0fdd-6be6-44b0-b636-3b199769fdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:52.021381 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb0fdd-6be6-44b0-b636-3b199769fdde None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:52.021658 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb0fdd-6be6-44b0-b636-3b199769fdde None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:52.021927 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb0fdd-6be6-44b0-b636-3b199769fdde None admin] PATH_INFO: `/v3/projects/dcfe9dbac3e940aea7d416b1e39c1324` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:52.023078 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb0fdd-6be6-44b0-b636-3b199769fdde None admin] RBAC: Authorizing `identity:get_project(project_id=dcfe9dbac3e940aea7d416b1e39c1324)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:52.024497 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb0fdd-6be6-44b0-b636-3b199769fdde None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:52.026189 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 587/1160] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 13:01:51 2022] GET /identity/v3/projects/dcfe9dbac3e940aea7d416b1e39c1324 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:52.032246 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180222a-ab89-4dd1-84cd-cde6750b4e61 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:52.123610 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180222a-ab89-4dd1-84cd-cde6750b4e61 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:52.155678 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6252945-7287-4ded-820b-d8c2487b8507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:52.156253 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6252945-7287-4ded-820b-d8c2487b8507 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:52.156529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6252945-7287-4ded-820b-d8c2487b8507 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:52.156824 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6252945-7287-4ded-820b-d8c2487b8507 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:52.157629 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6252945-7287-4ded-820b-d8c2487b8507 None admin] RBAC: Adding query filter params (role.id=f9ec85924a914e078096b38cae4e6caa, scope.project.id=dcfe9dbac3e940aea7d416b1e39c1324, user.id=c0f0d7cbb9d647559a2a8c9d8ccdcaa6) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:52.157934 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6252945-7287-4ded-820b-d8c2487b8507 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:52.159499 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6252945-7287-4ded-820b-d8c2487b8507 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:52.164957 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 574/1161] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:01:52 2022] GET /identity/v3/role_assignments?user.id=c0f0d7cbb9d647559a2a8c9d8ccdcaa6&scope.project.id=dcfe9dbac3e940aea7d416b1e39c1324&role.id=f9ec85924a914e078096b38cae4e6caa => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:54.473337 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f5c3a-2a73-4349-80ed-f340d8349e4b None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:54.473871 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f5c3a-2a73-4349-80ed-f340d8349e4b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:54.473871 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f5c3a-2a73-4349-80ed-f340d8349e4b None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:54.475633 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 588/1162] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:54.480763 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4750b03-c3d3-4e67-9ef2-0f4fda11f96b None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:54.481176 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4750b03-c3d3-4e67-9ef2-0f4fda11f96b None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:54.481319 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4750b03-c3d3-4e67-9ef2-0f4fda11f96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:54.498291 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-f4750b03-c3d3-4e67-9ef2-0f4fda11f96b None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:54.499455 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f4750b03-c3d3-4e67-9ef2-0f4fda11f96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:54.561217 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 575/1163] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:01:54.584056 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f5c3a-2a73-4349-80ed-f340d8349e4b None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:54.681581 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f5c3a-2a73-4349-80ed-f340d8349e4b None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:54.713702 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b4f00-1e00-4af4-964c-7849a86acf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:54.714342 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b4f00-1e00-4af4-964c-7849a86acf18 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:54.714625 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b4f00-1e00-4af4-964c-7849a86acf18 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:54.714900 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b4f00-1e00-4af4-964c-7849a86acf18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:54.778474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b4f00-1e00-4af4-964c-7849a86acf18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:54.779904 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b4f00-1e00-4af4-964c-7849a86acf18 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:54.872056 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 589/1164] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:01:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:01:54.877923 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4750b03-c3d3-4e67-9ef2-0f4fda11f96b None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:54.969003 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4750b03-c3d3-4e67-9ef2-0f4fda11f96b None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:54.999293 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c3be0-63aa-4f48-9139-b17e81c6f117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:55.000072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c3be0-63aa-4f48-9139-b17e81c6f117 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:55.000347 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c3be0-63aa-4f48-9139-b17e81c6f117 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:55.000614 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c3be0-63aa-4f48-9139-b17e81c6f117 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:55.007566 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c3be0-63aa-4f48-9139-b17e81c6f117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:55.009024 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c3be0-63aa-4f48-9139-b17e81c6f117 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:55.022841 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-da3c3be0-63aa-4f48-9139-b17e81c6f117 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Mar 08 13:01:55.023950 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 576/1165] 10.222.0.52 () {56 vars in 1117 bytes} [Tue Mar 8 13:01:54 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:01:55.029839 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b4f00-1e00-4af4-964c-7849a86acf18 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:55.120190 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b4f00-1e00-4af4-964c-7849a86acf18 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:55.151572 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d1ea5-f0dc-456c-b12a-43d3d8050b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:55.152205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d1ea5-f0dc-456c-b12a-43d3d8050b4a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:55.152487 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d1ea5-f0dc-456c-b12a-43d3d8050b4a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:55.152784 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d1ea5-f0dc-456c-b12a-43d3d8050b4a None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:55.153491 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d1ea5-f0dc-456c-b12a-43d3d8050b4a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:01:55.153790 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d1ea5-f0dc-456c-b12a-43d3d8050b4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:55.155144 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d1ea5-f0dc-456c-b12a-43d3d8050b4a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:55.162476 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 590/1166] 10.222.0.52 () {56 vars in 1115 bytes} [Tue Mar 8 13:01:55 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:01:57.416038 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dada5-d247-40d8-8d26-9f0024c12908 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:57.416517 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dada5-d247-40d8-8d26-9f0024c12908 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:57.416608 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dada5-d247-40d8-8d26-9f0024c12908 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:57.418954 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 577/1167] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:01:57.424999 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76233fb0-9338-4946-a365-1119c60a998e None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:57.425408 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76233fb0-9338-4946-a365-1119c60a998e None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:57.425557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76233fb0-9338-4946-a365-1119c60a998e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:57.442934 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-76233fb0-9338-4946-a365-1119c60a998e None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:01:57.444125 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-76233fb0-9338-4946-a365-1119c60a998e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:01:57.510897 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 591/1168] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:01:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:01:57.537751 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dada5-d247-40d8-8d26-9f0024c12908 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:01:57.633288 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dada5-d247-40d8-8d26-9f0024c12908 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:01:57.665062 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767445b9-c6de-48ce-a230-3bbf883de46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:01:57.665695 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767445b9-c6de-48ce-a230-3bbf883de46b None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:01:57.665978 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767445b9-c6de-48ce-a230-3bbf883de46b None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:01:57.666254 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767445b9-c6de-48ce-a230-3bbf883de46b None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:01:57.666985 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767445b9-c6de-48ce-a230-3bbf883de46b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:01:57.668340 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767445b9-c6de-48ce-a230-3bbf883de46b None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:01:57.743670 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 578/1169] 10.222.0.52 () {60 vars in 1138 bytes} [Tue Mar 8 13:01:57 2022] POST /identity/v3/domains => generated 267 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:02:00.048290 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7378604-0913-48bc-b4ba-245678c95799 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:00.048879 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7378604-0913-48bc-b4ba-245678c95799 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:00.048879 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7378604-0913-48bc-b4ba-245678c95799 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:00.050640 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 592/1170] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:02:00.055995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab2b89-8cb6-46bd-80e1-636ee5acff60 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:00.056390 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab2b89-8cb6-46bd-80e1-636ee5acff60 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:00.056546 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab2b89-8cb6-46bd-80e1-636ee5acff60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:00.072972 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-8cab2b89-8cb6-46bd-80e1-636ee5acff60 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:02:00.074141 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-8cab2b89-8cb6-46bd-80e1-636ee5acff60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:02:00.155254 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 579/1171] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:02:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:02:00.179326 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7378604-0913-48bc-b4ba-245678c95799 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:00.274517 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7378604-0913-48bc-b4ba-245678c95799 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:00.305117 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394201f9-1ff9-48c0-908a-2debf0269cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:00.305901 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394201f9-1ff9-48c0-908a-2debf0269cb2 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:00.306179 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394201f9-1ff9-48c0-908a-2debf0269cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:00.306450 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394201f9-1ff9-48c0-908a-2debf0269cb2 None admin] PATH_INFO: `/v3/domains/607ebf10ae44457faaf76fb3103dbe48` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:00.316821 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394201f9-1ff9-48c0-908a-2debf0269cb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=607ebf10ae44457faaf76fb3103dbe48)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:02:00.318261 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394201f9-1ff9-48c0-908a-2debf0269cb2 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:02:00.319867 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 593/1172] 10.222.0.52 () {56 vars in 1183 bytes} [Tue Mar 8 13:02:00 2022] GET /identity/v3/domains/607ebf10ae44457faaf76fb3103dbe48 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:02:00.325594 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab2b89-8cb6-46bd-80e1-636ee5acff60 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:00.416909 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab2b89-8cb6-46bd-80e1-636ee5acff60 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:00.447926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7b712-eb5c-4dc7-95a2-9c0538785eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:00.448563 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7b712-eb5c-4dc7-95a2-9c0538785eff None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:00.448866 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7b712-eb5c-4dc7-95a2-9c0538785eff None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:00.449135 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7b712-eb5c-4dc7-95a2-9c0538785eff None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:00.449832 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7b712-eb5c-4dc7-95a2-9c0538785eff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:02:00.451240 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7b712-eb5c-4dc7-95a2-9c0538785eff None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:02:00.572593 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 580/1173] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 13:02:00 2022] POST /identity/v3/projects => generated 361 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:02:02.892145 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1cfe9-ec82-41c1-adf8-d57fe9980d7e None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:02.892726 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1cfe9-ec82-41c1-adf8-d57fe9980d7e None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:02.892726 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1cfe9-ec82-41c1-adf8-d57fe9980d7e None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:02.894503 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 594/1174] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:02:02.900070 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747898c-6e81-4450-bc26-172edeb5b4cf None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:02.900446 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747898c-6e81-4450-bc26-172edeb5b4cf None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:02.900630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747898c-6e81-4450-bc26-172edeb5b4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:02.917274 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-2747898c-6e81-4450-bc26-172edeb5b4cf None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:02:02.918453 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-2747898c-6e81-4450-bc26-172edeb5b4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:02:02.980929 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 581/1175] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:02:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:02:03.006377 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1cfe9-ec82-41c1-adf8-d57fe9980d7e None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:03.101376 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1cfe9-ec82-41c1-adf8-d57fe9980d7e None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:03.132831 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6906c-6b7f-4e42-99ce-ab354c5db84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:03.133672 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6906c-6b7f-4e42-99ce-ab354c5db84b None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:03.133950 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6906c-6b7f-4e42-99ce-ab354c5db84b None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:03.134221 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6906c-6b7f-4e42-99ce-ab354c5db84b None admin] PATH_INFO: `/v3/domains/607ebf10ae44457faaf76fb3103dbe48` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:03.135366 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6906c-6b7f-4e42-99ce-ab354c5db84b None admin] RBAC: Authorizing `identity:get_domain(domain_id=607ebf10ae44457faaf76fb3103dbe48)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:02:03.136818 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6906c-6b7f-4e42-99ce-ab354c5db84b None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:02:03.138414 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 595/1176] 10.222.0.52 () {56 vars in 1183 bytes} [Tue Mar 8 13:02:03 2022] GET /identity/v3/domains/607ebf10ae44457faaf76fb3103dbe48 => generated 267 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:02:03.144118 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747898c-6e81-4450-bc26-172edeb5b4cf None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:03.235261 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747898c-6e81-4450-bc26-172edeb5b4cf None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:03.266492 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4f20d-0108-4909-9b2c-85a889e418e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:03.267181 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4f20d-0108-4909-9b2c-85a889e418e6 None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:03.267461 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4f20d-0108-4909-9b2c-85a889e418e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:03.267736 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4f20d-0108-4909-9b2c-85a889e418e6 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:03.268439 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4f20d-0108-4909-9b2c-85a889e418e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:02:03.270144 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4f20d-0108-4909-9b2c-85a889e418e6 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:02:03.358836 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 582/1177] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 13:02:03 2022] POST /identity/v3/users => generated 311 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:02:05.702259 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833953c8-54bc-4c2e-b83f-c754340a7d34 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:05.702764 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833953c8-54bc-4c2e-b83f-c754340a7d34 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:05.702872 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833953c8-54bc-4c2e-b83f-c754340a7d34 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:05.704651 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 596/1178] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:02:05.710096 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d7169-72e5-44d0-bd10-8954ab5e9ed2 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:05.710506 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d7169-72e5-44d0-bd10-8954ab5e9ed2 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:05.710644 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d7169-72e5-44d0-bd10-8954ab5e9ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:05.727614 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-2c0d7169-72e5-44d0-bd10-8954ab5e9ed2 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:02:05.728821 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-2c0d7169-72e5-44d0-bd10-8954ab5e9ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:02:05.791794 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 583/1179] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:02:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:02:05.818020 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833953c8-54bc-4c2e-b83f-c754340a7d34 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:05.914707 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833953c8-54bc-4c2e-b83f-c754340a7d34 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:05.945661 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4df981-8c43-4538-b344-6e1a25aa8175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:05.946437 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4df981-8c43-4538-b344-6e1a25aa8175 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:05.946715 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4df981-8c43-4538-b344-6e1a25aa8175 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:05.946986 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4df981-8c43-4538-b344-6e1a25aa8175 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:05.957424 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4df981-8c43-4538-b344-6e1a25aa8175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:02:05.963983 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-ea4df981-8c43-4538-b344-6e1a25aa8175 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:02:05.965160 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 597/1180] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:02:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:02:05.971959 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d7169-72e5-44d0-bd10-8954ab5e9ed2 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:06.065445 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d7169-72e5-44d0-bd10-8954ab5e9ed2 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:06.105022 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d49cde-26e6-4dc2-a3d6-c50c2acf7f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:06.105679 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d49cde-26e6-4dc2-a3d6-c50c2acf7f3e None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:06.105962 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d49cde-26e6-4dc2-a3d6-c50c2acf7f3e None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:06.106247 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d49cde-26e6-4dc2-a3d6-c50c2acf7f3e None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:06.106989 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d49cde-26e6-4dc2-a3d6-c50c2acf7f3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:02:06.107298 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d49cde-26e6-4dc2-a3d6-c50c2acf7f3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:02:06.108697 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d49cde-26e6-4dc2-a3d6-c50c2acf7f3e None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:02:06.116477 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 584/1181] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:02:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:02:06.122244 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4df981-8c43-4538-b344-6e1a25aa8175 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:06.217730 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4df981-8c43-4538-b344-6e1a25aa8175 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:06.249380 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195d6b2-f7c0-419b-ac01-2949964246bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:06.250218 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195d6b2-f7c0-419b-ac01-2949964246bc None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:06.250495 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195d6b2-f7c0-419b-ac01-2949964246bc None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:06.251322 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195d6b2-f7c0-419b-ac01-2949964246bc None admin] PATH_INFO: `/v3/users/b86fb09d59944c87af34fa99cfd3f35e` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:06.263549 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195d6b2-f7c0-419b-ac01-2949964246bc None admin] RBAC: Authorizing `identity:get_user(user_id=b86fb09d59944c87af34fa99cfd3f35e)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:02:06.265021 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195d6b2-f7c0-419b-ac01-2949964246bc None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:02:06.266797 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 598/1182] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 13:02:06 2022] GET /identity/v3/users/b86fb09d59944c87af34fa99cfd3f35e => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:02:06.272741 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d49cde-26e6-4dc2-a3d6-c50c2acf7f3e None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:06.367706 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d49cde-26e6-4dc2-a3d6-c50c2acf7f3e None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:06.399061 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaadbec-1287-4a34-bc84-7a2b5a972c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:06.399692 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaadbec-1287-4a34-bc84-7a2b5a972c71 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:06.399975 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaadbec-1287-4a34-bc84-7a2b5a972c71 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:06.400251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaadbec-1287-4a34-bc84-7a2b5a972c71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:06.463246 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaadbec-1287-4a34-bc84-7a2b5a972c71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:02:06.464680 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaadbec-1287-4a34-bc84-7a2b5a972c71 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:02:06.554850 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 585/1183] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:02:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:02:06.560570 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195d6b2-f7c0-419b-ac01-2949964246bc None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:06.653087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195d6b2-f7c0-419b-ac01-2949964246bc None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:06.684530 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e7979-f9b8-471a-a0da-8372f04dbdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:06.685380 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7979-f9b8-471a-a0da-8372f04dbdb3 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:06.685657 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7979-f9b8-471a-a0da-8372f04dbdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:06.685927 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7979-f9b8-471a-a0da-8372f04dbdb3 None admin] PATH_INFO: `/v3/projects/8e38e413f0cf498eb3cd9bd0c08a4fe0` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:06.687068 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e7979-f9b8-471a-a0da-8372f04dbdb3 None admin] RBAC: Authorizing `identity:get_project(project_id=8e38e413f0cf498eb3cd9bd0c08a4fe0)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:02:06.688500 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e7979-f9b8-471a-a0da-8372f04dbdb3 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:02:06.690297 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 599/1184] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 13:02:06 2022] GET /identity/v3/projects/8e38e413f0cf498eb3cd9bd0c08a4fe0 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:02:06.696141 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaadbec-1287-4a34-bc84-7a2b5a972c71 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:06.787615 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaadbec-1287-4a34-bc84-7a2b5a972c71 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:06.818526 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de72278-938d-4953-ba1f-729bf7b3a630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:06.819102 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de72278-938d-4953-ba1f-729bf7b3a630 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:06.819382 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de72278-938d-4953-ba1f-729bf7b3a630 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:06.819653 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de72278-938d-4953-ba1f-729bf7b3a630 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:06.820471 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de72278-938d-4953-ba1f-729bf7b3a630 None admin] RBAC: Adding query filter params (role.id=f9ec85924a914e078096b38cae4e6caa, scope.project.id=8e38e413f0cf498eb3cd9bd0c08a4fe0, user.id=b86fb09d59944c87af34fa99cfd3f35e) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:02:06.820808 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de72278-938d-4953-ba1f-729bf7b3a630 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:02:06.822228 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de72278-938d-4953-ba1f-729bf7b3a630 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:02:06.827450 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 586/1185] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:02:06 2022] GET /identity/v3/role_assignments?user.id=b86fb09d59944c87af34fa99cfd3f35e&scope.project.id=8e38e413f0cf498eb3cd9bd0c08a4fe0&role.id=f9ec85924a914e078096b38cae4e6caa => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:02:09.070164 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161305d3-53b3-4348-bc2e-83aecc5dc0fa None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:09.070689 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161305d3-53b3-4348-bc2e-83aecc5dc0fa None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:09.070689 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161305d3-53b3-4348-bc2e-83aecc5dc0fa None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:09.072468 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 600/1186] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:02:09.077678 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de07317-31aa-4995-ac9f-746c60dda9da None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:09.078098 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de07317-31aa-4995-ac9f-746c60dda9da None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:09.078233 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de07317-31aa-4995-ac9f-746c60dda9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:09.096062 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-2de07317-31aa-4995-ac9f-746c60dda9da None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:02:09.097263 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-2de07317-31aa-4995-ac9f-746c60dda9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:02:09.159786 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 587/1187] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:02:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:02:09.182261 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161305d3-53b3-4348-bc2e-83aecc5dc0fa None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:09.276938 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161305d3-53b3-4348-bc2e-83aecc5dc0fa None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:09.309059 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d7254-97f3-459d-a295-27cd797842b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:09.309828 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d7254-97f3-459d-a295-27cd797842b7 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:09.310108 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d7254-97f3-459d-a295-27cd797842b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:09.310379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d7254-97f3-459d-a295-27cd797842b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:09.320238 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d7254-97f3-459d-a295-27cd797842b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:02:09.326978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-615d7254-97f3-459d-a295-27cd797842b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:02:09.328149 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 601/1188] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:02:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:02:09.333953 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de07317-31aa-4995-ac9f-746c60dda9da None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:09.425862 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de07317-31aa-4995-ac9f-746c60dda9da None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:09.456614 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f343747-53a6-449c-92b5-fb3cdc86bf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:09.457285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f343747-53a6-449c-92b5-fb3cdc86bf05 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:09.457566 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f343747-53a6-449c-92b5-fb3cdc86bf05 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:09.457839 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f343747-53a6-449c-92b5-fb3cdc86bf05 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:09.458575 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f343747-53a6-449c-92b5-fb3cdc86bf05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:02:09.458879 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f343747-53a6-449c-92b5-fb3cdc86bf05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:02:09.460237 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f343747-53a6-449c-92b5-fb3cdc86bf05 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:02:09.467739 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 588/1189] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:02:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:02:09.474015 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d7254-97f3-459d-a295-27cd797842b7 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:09.568474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d7254-97f3-459d-a295-27cd797842b7 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:09.599649 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd355b-1764-467e-97c1-26c6c29014c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:09.600438 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd355b-1764-467e-97c1-26c6c29014c9 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:09.600743 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd355b-1764-467e-97c1-26c6c29014c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:09.601018 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd355b-1764-467e-97c1-26c6c29014c9 None admin] PATH_INFO: `/v3/users/b86fb09d59944c87af34fa99cfd3f35e` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:09.602177 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd355b-1764-467e-97c1-26c6c29014c9 None admin] RBAC: Authorizing `identity:get_user(user_id=b86fb09d59944c87af34fa99cfd3f35e)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:02:09.603599 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd355b-1764-467e-97c1-26c6c29014c9 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:02:09.605221 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 602/1190] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 13:02:09 2022] GET /identity/v3/users/b86fb09d59944c87af34fa99cfd3f35e => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:02:09.611766 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f343747-53a6-449c-92b5-fb3cdc86bf05 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:09.705400 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f343747-53a6-449c-92b5-fb3cdc86bf05 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:09.736598 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d90c6-c459-481b-bba1-8fbe94a7784e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:09.737464 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d90c6-c459-481b-bba1-8fbe94a7784e None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:09.737745 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d90c6-c459-481b-bba1-8fbe94a7784e None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:09.738015 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d90c6-c459-481b-bba1-8fbe94a7784e None admin] PATH_INFO: `/v3/projects/8e38e413f0cf498eb3cd9bd0c08a4fe0` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:09.739175 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d90c6-c459-481b-bba1-8fbe94a7784e None admin] RBAC: Authorizing `identity:get_project(project_id=8e38e413f0cf498eb3cd9bd0c08a4fe0)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:02:09.740607 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d90c6-c459-481b-bba1-8fbe94a7784e None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:02:09.742279 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 589/1191] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 13:02:09 2022] GET /identity/v3/projects/8e38e413f0cf498eb3cd9bd0c08a4fe0 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:02:09.747943 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd355b-1764-467e-97c1-26c6c29014c9 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:09.841937 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd355b-1764-467e-97c1-26c6c29014c9 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:09.873734 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf13c0-64ee-44dc-bbff-1144d5777601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:09.874549 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf13c0-64ee-44dc-bbff-1144d5777601 None admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:09.874829 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf13c0-64ee-44dc-bbff-1144d5777601 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:09.875104 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf13c0-64ee-44dc-bbff-1144d5777601 None admin] PATH_INFO: `/v3/projects/8e38e413f0cf498eb3cd9bd0c08a4fe0/users/b86fb09d59944c87af34fa99cfd3f35e/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:09.877645 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf13c0-64ee-44dc-bbff-1144d5777601 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e38e413f0cf498eb3cd9bd0c08a4fe0, user_id=b86fb09d59944c87af34fa99cfd3f35e, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:02:09.879070 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf13c0-64ee-44dc-bbff-1144d5777601 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:02:09.995100 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 603/1192] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 13:02:09 2022] PUT /identity/v3/projects/8e38e413f0cf498eb3cd9bd0c08a4fe0/users/b86fb09d59944c87af34fa99cfd3f35e/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:02:12.249381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8280a0-9b00-41af-bcfb-935edf543370 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:12.249937 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8280a0-9b00-41af-bcfb-935edf543370 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:12.249937 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8280a0-9b00-41af-bcfb-935edf543370 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:12.252250 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 590/1193] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:02:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:02:12.257564 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5f50c-d6be-459a-a56f-8f761228294a None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:12.257994 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5f50c-d6be-459a-a56f-8f761228294a None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:12.258142 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5f50c-d6be-459a-a56f-8f761228294a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:12.275520 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-f6b5f50c-d6be-459a-a56f-8f761228294a None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:02:12.276689 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f6b5f50c-d6be-459a-a56f-8f761228294a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:02:12.339928 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 604/1194] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:02:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:02:12.362964 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8280a0-9b00-41af-bcfb-935edf543370 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:12.458849 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8280a0-9b00-41af-bcfb-935edf543370 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:12.489751 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215ce4d-9238-46fe-971e-d1b28af56f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:12.490747 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215ce4d-9238-46fe-971e-d1b28af56f3d None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:12.491259 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215ce4d-9238-46fe-971e-d1b28af56f3d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:12.491766 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215ce4d-9238-46fe-971e-d1b28af56f3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:12.504411 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215ce4d-9238-46fe-971e-d1b28af56f3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:02:12.511113 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-0215ce4d-9238-46fe-971e-d1b28af56f3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:02:12.521345 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 591/1195] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:02:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:02:12.527453 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5f50c-d6be-459a-a56f-8f761228294a None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:12.745672 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5f50c-d6be-459a-a56f-8f761228294a None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:12.777028 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26baac7a-b564-47c5-acee-0eb4ce39e856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:12.777616 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baac7a-b564-47c5-acee-0eb4ce39e856 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:12.777890 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baac7a-b564-47c5-acee-0eb4ce39e856 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:12.778156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baac7a-b564-47c5-acee-0eb4ce39e856 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:12.778886 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26baac7a-b564-47c5-acee-0eb4ce39e856 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:02:12.779184 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26baac7a-b564-47c5-acee-0eb4ce39e856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:02:12.780518 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26baac7a-b564-47c5-acee-0eb4ce39e856 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:02:12.789071 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 605/1196] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:02:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:02:12.794773 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215ce4d-9238-46fe-971e-d1b28af56f3d None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:12.888511 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215ce4d-9238-46fe-971e-d1b28af56f3d None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:12.921048 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38208f-7c54-4c89-86ce-47709624f236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:12.921902 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38208f-7c54-4c89-86ce-47709624f236 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:12.922217 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38208f-7c54-4c89-86ce-47709624f236 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:12.922492 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38208f-7c54-4c89-86ce-47709624f236 None admin] PATH_INFO: `/v3/users/b86fb09d59944c87af34fa99cfd3f35e` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:12.923694 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38208f-7c54-4c89-86ce-47709624f236 None admin] RBAC: Authorizing `identity:get_user(user_id=b86fb09d59944c87af34fa99cfd3f35e)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:02:12.925160 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38208f-7c54-4c89-86ce-47709624f236 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:02:12.926755 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 592/1197] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 13:02:12 2022] GET /identity/v3/users/b86fb09d59944c87af34fa99cfd3f35e => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:02:12.932487 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26baac7a-b564-47c5-acee-0eb4ce39e856 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:13.026605 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26baac7a-b564-47c5-acee-0eb4ce39e856 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:13.057667 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63ee5c-9dbe-49fa-a5ac-19e8c0de219b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:13.058237 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63ee5c-9dbe-49fa-a5ac-19e8c0de219b None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:13.058514 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63ee5c-9dbe-49fa-a5ac-19e8c0de219b None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:13.058782 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63ee5c-9dbe-49fa-a5ac-19e8c0de219b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:13.119908 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63ee5c-9dbe-49fa-a5ac-19e8c0de219b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:02:13.121357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63ee5c-9dbe-49fa-a5ac-19e8c0de219b None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:02:13.212751 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 606/1198] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:02:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:02:13.218587 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38208f-7c54-4c89-86ce-47709624f236 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:13.312561 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38208f-7c54-4c89-86ce-47709624f236 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:13.344359 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99650e-fa0d-49c5-bb00-75ae64256405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:13.345234 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99650e-fa0d-49c5-bb00-75ae64256405 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:13.345513 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99650e-fa0d-49c5-bb00-75ae64256405 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:13.345786 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99650e-fa0d-49c5-bb00-75ae64256405 None admin] PATH_INFO: `/v3/projects/8e38e413f0cf498eb3cd9bd0c08a4fe0` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:13.347338 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99650e-fa0d-49c5-bb00-75ae64256405 None admin] RBAC: Authorizing `identity:get_project(project_id=8e38e413f0cf498eb3cd9bd0c08a4fe0)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:02:13.348381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99650e-fa0d-49c5-bb00-75ae64256405 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:02:13.350067 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 593/1199] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 13:02:13 2022] GET /identity/v3/projects/8e38e413f0cf498eb3cd9bd0c08a4fe0 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:02:13.355991 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63ee5c-9dbe-49fa-a5ac-19e8c0de219b None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:02:13.447386 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63ee5c-9dbe-49fa-a5ac-19e8c0de219b None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:02:13.478148 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba11e5d-f82a-47bf-a663-4334facc7b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:02:13.478776 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba11e5d-f82a-47bf-a663-4334facc7b54 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:02:13.479054 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba11e5d-f82a-47bf-a663-4334facc7b54 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:02:13.479325 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba11e5d-f82a-47bf-a663-4334facc7b54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:02:13.480124 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba11e5d-f82a-47bf-a663-4334facc7b54 None admin] RBAC: Adding query filter params (role.id=f9ec85924a914e078096b38cae4e6caa, scope.project.id=8e38e413f0cf498eb3cd9bd0c08a4fe0, user.id=b86fb09d59944c87af34fa99cfd3f35e) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:02:13.480429 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba11e5d-f82a-47bf-a663-4334facc7b54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:02:13.481868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba11e5d-f82a-47bf-a663-4334facc7b54 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:02:13.487787 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 607/1200] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:02:13 2022] GET /identity/v3/role_assignments?user.id=b86fb09d59944c87af34fa99cfd3f35e&scope.project.id=8e38e413f0cf498eb3cd9bd0c08a4fe0&role.id=f9ec85924a914e078096b38cae4e6caa => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:31.934026 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa5e89-fb19-4693-ad58-ccd9a9f25406 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:31.934715 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa5e89-fb19-4693-ad58-ccd9a9f25406 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:31.934715 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa5e89-fb19-4693-ad58-ccd9a9f25406 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:31.936350 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 594/1201] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:03:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:03:31.941745 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f24e2-f636-4387-ae37-082c34a478bc None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:31.943343 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f24e2-f636-4387-ae37-082c34a478bc None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:31.943343 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f24e2-f636-4387-ae37-082c34a478bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:31.959388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-fa9f24e2-f636-4387-ae37-082c34a478bc None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:03:31.960573 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-fa9f24e2-f636-4387-ae37-082c34a478bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:03:32.024443 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 608/1202] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:03:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:03:32.048322 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa5e89-fb19-4693-ad58-ccd9a9f25406 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:32.145112 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa5e89-fb19-4693-ad58-ccd9a9f25406 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:32.188086 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a420c8-cb31-402d-b6b8-e417c7d36092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:32.188834 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a420c8-cb31-402d-b6b8-e417c7d36092 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:32.189118 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a420c8-cb31-402d-b6b8-e417c7d36092 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:32.189391 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a420c8-cb31-402d-b6b8-e417c7d36092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:32.199311 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a420c8-cb31-402d-b6b8-e417c7d36092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:32.202077 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a420c8-cb31-402d-b6b8-e417c7d36092 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:32.218731 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-e0a420c8-cb31-402d-b6b8-e417c7d36092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:03:32.220097 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 595/1203] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:32.225867 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f24e2-f636-4387-ae37-082c34a478bc None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:32.322415 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f24e2-f636-4387-ae37-082c34a478bc None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:32.354992 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdb196-eadf-434c-93ea-d948749fe045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:32.355672 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdb196-eadf-434c-93ea-d948749fe045 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:32.355946 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdb196-eadf-434c-93ea-d948749fe045 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:32.356758 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdb196-eadf-434c-93ea-d948749fe045 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:32.357473 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bdb196-eadf-434c-93ea-d948749fe045 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:32.357776 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bdb196-eadf-434c-93ea-d948749fe045 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:32.359136 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bdb196-eadf-434c-93ea-d948749fe045 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:32.369935 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 609/1204] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:32.376168 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a420c8-cb31-402d-b6b8-e417c7d36092 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:32.483666 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a420c8-cb31-402d-b6b8-e417c7d36092 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:32.517507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414e7b3-f366-4059-bd35-ea42c275b020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:32.518173 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414e7b3-f366-4059-bd35-ea42c275b020 None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:32.518457 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414e7b3-f366-4059-bd35-ea42c275b020 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:32.518733 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414e7b3-f366-4059-bd35-ea42c275b020 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:32.519449 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414e7b3-f366-4059-bd35-ea42c275b020 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:32.520920 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414e7b3-f366-4059-bd35-ea42c275b020 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:32.675733 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 596/1205] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 13:03:32 2022] POST /identity/v3/users => generated 251 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:03:35.044060 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cdeb0-fa09-4f0c-8ce2-4167865007ed None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:35.044581 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cdeb0-fa09-4f0c-8ce2-4167865007ed None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:35.044581 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cdeb0-fa09-4f0c-8ce2-4167865007ed None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:35.046588 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 610/1206] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:03:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:03:35.051976 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e2868-193e-43d6-b884-acddaa6f64af None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:35.052412 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e2868-193e-43d6-b884-acddaa6f64af None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:35.052512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e2868-193e-43d6-b884-acddaa6f64af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:35.069495 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-c34e2868-193e-43d6-b884-acddaa6f64af None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:03:35.070684 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c34e2868-193e-43d6-b884-acddaa6f64af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:03:35.134472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 597/1207] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:03:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:03:35.160032 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cdeb0-fa09-4f0c-8ce2-4167865007ed None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:35.261173 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cdeb0-fa09-4f0c-8ce2-4167865007ed None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:35.293587 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36eb00-bba2-4bd1-a6c8-4397ad54b6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:35.294505 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36eb00-bba2-4bd1-a6c8-4397ad54b6a0 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:35.294706 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36eb00-bba2-4bd1-a6c8-4397ad54b6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:35.294976 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36eb00-bba2-4bd1-a6c8-4397ad54b6a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:35.305229 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36eb00-bba2-4bd1-a6c8-4397ad54b6a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:03:35.312872 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-6b36eb00-bba2-4bd1-a6c8-4397ad54b6a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:03:35.314030 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 611/1208] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:03:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:35.320211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e2868-193e-43d6-b884-acddaa6f64af None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:35.416623 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e2868-193e-43d6-b884-acddaa6f64af None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:35.448917 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f97697-ad6a-433e-b8ee-7915f90973fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:35.449673 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f97697-ad6a-433e-b8ee-7915f90973fa None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:35.449961 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f97697-ad6a-433e-b8ee-7915f90973fa None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:35.451200 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f97697-ad6a-433e-b8ee-7915f90973fa None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:35.451954 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f97697-ad6a-433e-b8ee-7915f90973fa None admin] RBAC: Adding query filter params (name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:35.452262 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f97697-ad6a-433e-b8ee-7915f90973fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:35.453659 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f97697-ad6a-433e-b8ee-7915f90973fa None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:35.461297 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 598/1209] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:03:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:35.467833 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36eb00-bba2-4bd1-a6c8-4397ad54b6a0 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:35.563907 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36eb00-bba2-4bd1-a6c8-4397ad54b6a0 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:35.597139 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3e17e-b733-4a21-aacc-acba442146a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:35.597922 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3e17e-b733-4a21-aacc-acba442146a6 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:35.598201 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3e17e-b733-4a21-aacc-acba442146a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:35.598475 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3e17e-b733-4a21-aacc-acba442146a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:35.608966 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3e17e-b733-4a21-aacc-acba442146a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:35.612247 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3e17e-b733-4a21-aacc-acba442146a6 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:35.625884 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-e2f3e17e-b733-4a21-aacc-acba442146a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:03:35.627022 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 612/1210] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:35.632851 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f97697-ad6a-433e-b8ee-7915f90973fa None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:35.727218 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f97697-ad6a-433e-b8ee-7915f90973fa None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:35.759499 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9089a6-2338-4b6f-a39b-9f56585ab6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:35.760152 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9089a6-2338-4b6f-a39b-9f56585ab6ad None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:35.760433 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9089a6-2338-4b6f-a39b-9f56585ab6ad None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:35.760732 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9089a6-2338-4b6f-a39b-9f56585ab6ad None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:35.761444 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9089a6-2338-4b6f-a39b-9f56585ab6ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:35.761748 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9089a6-2338-4b6f-a39b-9f56585ab6ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:35.763397 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9089a6-2338-4b6f-a39b-9f56585ab6ad None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:35.774384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 599/1211] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:35.781250 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3e17e-b733-4a21-aacc-acba442146a6 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:35.875689 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3e17e-b733-4a21-aacc-acba442146a6 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:35.907811 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d837e-f04a-4cea-aa60-2ee396f8a31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:35.908600 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d837e-f04a-4cea-aa60-2ee396f8a31e None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:35.908907 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d837e-f04a-4cea-aa60-2ee396f8a31e None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:35.909177 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d837e-f04a-4cea-aa60-2ee396f8a31e None admin] PATH_INFO: `/v3/users/placement` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:35.916363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d837e-f04a-4cea-aa60-2ee396f8a31e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:35.917831 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d837e-f04a-4cea-aa60-2ee396f8a31e None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:35.931356 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-012d837e-f04a-4cea-aa60-2ee396f8a31e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 13:03:35.932484 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 613/1212] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:03:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:03:35.938558 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9089a6-2338-4b6f-a39b-9f56585ab6ad None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:36.032908 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9089a6-2338-4b6f-a39b-9f56585ab6ad None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:36.066464 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b291f31-f350-4a51-b692-8aded880a401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:36.067115 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b291f31-f350-4a51-b692-8aded880a401 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:36.067392 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b291f31-f350-4a51-b692-8aded880a401 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:36.067663 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b291f31-f350-4a51-b692-8aded880a401 None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:36.068479 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b291f31-f350-4a51-b692-8aded880a401 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:36.068858 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b291f31-f350-4a51-b692-8aded880a401 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:36.070279 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b291f31-f350-4a51-b692-8aded880a401 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:36.088830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 600/1213] 10.222.0.52 () {56 vars in 1143 bytes} [Tue Mar 8 13:03:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:36.095388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d837e-f04a-4cea-aa60-2ee396f8a31e None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:36.197466 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d837e-f04a-4cea-aa60-2ee396f8a31e None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:36.231785 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a599d4f-1637-40fd-81c3-660233f0fa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:36.232602 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a599d4f-1637-40fd-81c3-660233f0fa77 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:36.232912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a599d4f-1637-40fd-81c3-660233f0fa77 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:36.233188 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a599d4f-1637-40fd-81c3-660233f0fa77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:36.296477 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a599d4f-1637-40fd-81c3-660233f0fa77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:36.297954 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a599d4f-1637-40fd-81c3-660233f0fa77 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:36.391942 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 614/1214] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:03:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:03:36.397718 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b291f31-f350-4a51-b692-8aded880a401 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:36.506002 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b291f31-f350-4a51-b692-8aded880a401 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:36.540997 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989a1ef-f329-4148-bfd3-d25d4e6426bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:36.541777 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989a1ef-f329-4148-bfd3-d25d4e6426bc None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:36.542056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989a1ef-f329-4148-bfd3-d25d4e6426bc None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:36.542331 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989a1ef-f329-4148-bfd3-d25d4e6426bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:36.552159 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989a1ef-f329-4148-bfd3-d25d4e6426bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:36.553677 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989a1ef-f329-4148-bfd3-d25d4e6426bc None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:36.570694 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-6989a1ef-f329-4148-bfd3-d25d4e6426bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:03:36.571840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 601/1215] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:03:36.578605 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a599d4f-1637-40fd-81c3-660233f0fa77 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:36.672510 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a599d4f-1637-40fd-81c3-660233f0fa77 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:36.704192 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbc9ca-2d67-45a8-af52-27d74b3b8da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:36.704867 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbc9ca-2d67-45a8-af52-27d74b3b8da6 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:36.705147 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbc9ca-2d67-45a8-af52-27d74b3b8da6 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:36.705418 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbc9ca-2d67-45a8-af52-27d74b3b8da6 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:36.706141 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbc9ca-2d67-45a8-af52-27d74b3b8da6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:36.706443 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbc9ca-2d67-45a8-af52-27d74b3b8da6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:36.707808 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbc9ca-2d67-45a8-af52-27d74b3b8da6 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:36.719432 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 615/1216] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:36.725087 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989a1ef-f329-4148-bfd3-d25d4e6426bc None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:36.825903 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989a1ef-f329-4148-bfd3-d25d4e6426bc None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:36.858508 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb44d19-a0a6-4e45-8453-4d8b746c6051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:36.859282 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb44d19-a0a6-4e45-8453-4d8b746c6051 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:36.859560 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb44d19-a0a6-4e45-8453-4d8b746c6051 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:36.859872 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb44d19-a0a6-4e45-8453-4d8b746c6051 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:36.866346 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb44d19-a0a6-4e45-8453-4d8b746c6051 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:36.867623 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb44d19-a0a6-4e45-8453-4d8b746c6051 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:36.880611 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-7bb44d19-a0a6-4e45-8453-4d8b746c6051 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:03:36.881805 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 602/1217] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:03:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:36.888549 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbc9ca-2d67-45a8-af52-27d74b3b8da6 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:36.984209 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbc9ca-2d67-45a8-af52-27d74b3b8da6 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:37.016219 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a416b21-6ac4-4e81-9065-0c8bb89bf4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:37.016934 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a416b21-6ac4-4e81-9065-0c8bb89bf4f9 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:37.017203 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a416b21-6ac4-4e81-9065-0c8bb89bf4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:37.017577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a416b21-6ac4-4e81-9065-0c8bb89bf4f9 None admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:37.018278 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a416b21-6ac4-4e81-9065-0c8bb89bf4f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:37.018589 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a416b21-6ac4-4e81-9065-0c8bb89bf4f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:37.020036 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a416b21-6ac4-4e81-9065-0c8bb89bf4f9 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:37.033071 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 616/1218] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:03:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:37.039240 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb44d19-a0a6-4e45-8453-4d8b746c6051 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:37.132641 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb44d19-a0a6-4e45-8453-4d8b746c6051 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:37.165185 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c971c5a-3e7a-474a-a02a-059703064e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:37.165823 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c971c5a-3e7a-474a-a02a-059703064e43 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:37.166107 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c971c5a-3e7a-474a-a02a-059703064e43 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:37.166380 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c971c5a-3e7a-474a-a02a-059703064e43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:37.167193 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c971c5a-3e7a-474a-a02a-059703064e43 None admin] RBAC: Adding query filter params (role.id=fe0e7f0760f74b09b441426d672df700, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=9b917ce4f7f34b289218f7d36a43983e) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:37.167502 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c971c5a-3e7a-474a-a02a-059703064e43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:37.168994 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c971c5a-3e7a-474a-a02a-059703064e43 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:37.174492 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 603/1219] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:03:37 2022] GET /identity/v3/role_assignments?user.id=9b917ce4f7f34b289218f7d36a43983e&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=fe0e7f0760f74b09b441426d672df700 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:39.462722 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebda4d-e979-4981-999d-87f1792635b4 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:39.463270 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebda4d-e979-4981-999d-87f1792635b4 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:39.463270 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebda4d-e979-4981-999d-87f1792635b4 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:39.465091 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 617/1220] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:03:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:03:39.471087 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd8085-7980-4e1d-a9b9-1eb65292ed9c None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:39.471518 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd8085-7980-4e1d-a9b9-1eb65292ed9c None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:39.471629 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd8085-7980-4e1d-a9b9-1eb65292ed9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:39.488758 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-fcdd8085-7980-4e1d-a9b9-1eb65292ed9c None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:03:39.489940 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-fcdd8085-7980-4e1d-a9b9-1eb65292ed9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:03:39.553036 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 604/1221] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:03:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:03:39.575630 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebda4d-e979-4981-999d-87f1792635b4 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:39.672586 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebda4d-e979-4981-999d-87f1792635b4 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:39.704303 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d380fd-9ded-4f26-856c-4d5b2e4ec01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:39.705110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d380fd-9ded-4f26-856c-4d5b2e4ec01e None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:39.705388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d380fd-9ded-4f26-856c-4d5b2e4ec01e None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:39.705654 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d380fd-9ded-4f26-856c-4d5b2e4ec01e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:39.715213 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d380fd-9ded-4f26-856c-4d5b2e4ec01e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:03:39.722760 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-01d380fd-9ded-4f26-856c-4d5b2e4ec01e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:03:39.723924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 618/1222] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:03:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:39.729905 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd8085-7980-4e1d-a9b9-1eb65292ed9c None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:39.823129 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd8085-7980-4e1d-a9b9-1eb65292ed9c None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:39.855721 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708fccb-fadf-472a-be3d-bcb53278270b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:39.856370 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708fccb-fadf-472a-be3d-bcb53278270b None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:39.856789 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708fccb-fadf-472a-be3d-bcb53278270b None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:39.857158 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708fccb-fadf-472a-be3d-bcb53278270b None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:39.857893 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708fccb-fadf-472a-be3d-bcb53278270b None admin] RBAC: Adding query filter params (name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:39.858193 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708fccb-fadf-472a-be3d-bcb53278270b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:39.859550 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708fccb-fadf-472a-be3d-bcb53278270b None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:39.867264 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 605/1223] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:03:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:39.873207 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d380fd-9ded-4f26-856c-4d5b2e4ec01e None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:39.970438 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d380fd-9ded-4f26-856c-4d5b2e4ec01e None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:40.002092 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a0f3b-954c-4c47-a769-ec4d242d5b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:40.002873 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a0f3b-954c-4c47-a769-ec4d242d5b6d None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:40.003152 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a0f3b-954c-4c47-a769-ec4d242d5b6d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:40.003422 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a0f3b-954c-4c47-a769-ec4d242d5b6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:40.014715 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a0f3b-954c-4c47-a769-ec4d242d5b6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:40.016218 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a0f3b-954c-4c47-a769-ec4d242d5b6d None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:40.032800 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-4f6a0f3b-954c-4c47-a769-ec4d242d5b6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:03:40.033974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 619/1224] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:40.039680 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708fccb-fadf-472a-be3d-bcb53278270b None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:40.134522 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708fccb-fadf-472a-be3d-bcb53278270b None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:40.165779 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575b3d2-d7cf-4e72-8dab-86f5f24ea069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:40.166434 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575b3d2-d7cf-4e72-8dab-86f5f24ea069 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:40.166716 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575b3d2-d7cf-4e72-8dab-86f5f24ea069 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:40.166989 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575b3d2-d7cf-4e72-8dab-86f5f24ea069 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:40.167704 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575b3d2-d7cf-4e72-8dab-86f5f24ea069 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:40.168012 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575b3d2-d7cf-4e72-8dab-86f5f24ea069 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:40.169961 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575b3d2-d7cf-4e72-8dab-86f5f24ea069 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:40.181404 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 606/1225] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:40.187781 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a0f3b-954c-4c47-a769-ec4d242d5b6d None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:40.283930 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a0f3b-954c-4c47-a769-ec4d242d5b6d None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:40.315436 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1076373-32fd-410a-a8cd-87eb89f6dcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:40.316220 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1076373-32fd-410a-a8cd-87eb89f6dcb6 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:40.316500 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1076373-32fd-410a-a8cd-87eb89f6dcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:40.316804 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1076373-32fd-410a-a8cd-87eb89f6dcb6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:40.324213 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1076373-32fd-410a-a8cd-87eb89f6dcb6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:40.325805 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1076373-32fd-410a-a8cd-87eb89f6dcb6 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:40.338848 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-f1076373-32fd-410a-a8cd-87eb89f6dcb6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 13:03:40.340014 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 620/1226] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:03:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:40.346503 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575b3d2-d7cf-4e72-8dab-86f5f24ea069 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:40.441996 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575b3d2-d7cf-4e72-8dab-86f5f24ea069 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:40.475851 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e773896-264d-425b-b74a-09ad866bb64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:40.476514 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e773896-264d-425b-b74a-09ad866bb64a None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:40.476824 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e773896-264d-425b-b74a-09ad866bb64a None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:40.477098 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e773896-264d-425b-b74a-09ad866bb64a None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:40.477922 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e773896-264d-425b-b74a-09ad866bb64a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:40.478327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e773896-264d-425b-b74a-09ad866bb64a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:40.479747 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e773896-264d-425b-b74a-09ad866bb64a None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:40.502802 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 607/1227] 10.222.0.52 () {56 vars in 1143 bytes} [Tue Mar 8 13:03:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:40.508710 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1076373-32fd-410a-a8cd-87eb89f6dcb6 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:40.605134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1076373-32fd-410a-a8cd-87eb89f6dcb6 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:40.638414 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b31f5a-0bfd-4007-8e65-baec47e24669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:40.639371 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b31f5a-0bfd-4007-8e65-baec47e24669 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:40.639653 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b31f5a-0bfd-4007-8e65-baec47e24669 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:40.639954 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b31f5a-0bfd-4007-8e65-baec47e24669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:40.649961 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b31f5a-0bfd-4007-8e65-baec47e24669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:40.651431 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b31f5a-0bfd-4007-8e65-baec47e24669 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:40.667943 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-20b31f5a-0bfd-4007-8e65-baec47e24669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:03:40.669716 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 621/1228] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:40.675492 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e773896-264d-425b-b74a-09ad866bb64a None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:40.770595 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e773896-264d-425b-b74a-09ad866bb64a None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:40.802639 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4571e6-d702-49c5-baa0-4f8a4aa1961a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:40.803284 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4571e6-d702-49c5-baa0-4f8a4aa1961a None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:40.803559 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4571e6-d702-49c5-baa0-4f8a4aa1961a None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:40.803830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4571e6-d702-49c5-baa0-4f8a4aa1961a None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:40.804531 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4571e6-d702-49c5-baa0-4f8a4aa1961a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:40.804857 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4571e6-d702-49c5-baa0-4f8a4aa1961a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:40.806217 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4571e6-d702-49c5-baa0-4f8a4aa1961a None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:40.817528 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 608/1229] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:40.823239 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b31f5a-0bfd-4007-8e65-baec47e24669 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:40.920030 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b31f5a-0bfd-4007-8e65-baec47e24669 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:40.952898 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eca3f0-3b5f-4692-99e7-0c9704a27aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:40.953688 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eca3f0-3b5f-4692-99e7-0c9704a27aa8 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:40.953970 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eca3f0-3b5f-4692-99e7-0c9704a27aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:40.954246 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eca3f0-3b5f-4692-99e7-0c9704a27aa8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:40.960761 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eca3f0-3b5f-4692-99e7-0c9704a27aa8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:40.962197 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eca3f0-3b5f-4692-99e7-0c9704a27aa8 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:40.975792 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-84eca3f0-3b5f-4692-99e7-0c9704a27aa8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:03:40.976968 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 622/1230] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:03:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:40.982928 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4571e6-d702-49c5-baa0-4f8a4aa1961a None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:41.078917 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4571e6-d702-49c5-baa0-4f8a4aa1961a None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:41.111343 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a52d05-5a23-400b-8335-d6cd92275fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:41.111988 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a52d05-5a23-400b-8335-d6cd92275fb1 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:41.112269 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a52d05-5a23-400b-8335-d6cd92275fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:41.112543 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a52d05-5a23-400b-8335-d6cd92275fb1 None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:41.113354 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a52d05-5a23-400b-8335-d6cd92275fb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:41.113665 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a52d05-5a23-400b-8335-d6cd92275fb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:41.115093 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a52d05-5a23-400b-8335-d6cd92275fb1 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:41.126667 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 609/1231] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:03:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:41.132629 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eca3f0-3b5f-4692-99e7-0c9704a27aa8 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:41.227132 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eca3f0-3b5f-4692-99e7-0c9704a27aa8 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:41.260108 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31656eb8-a41c-4b2e-8ecb-f0786156d47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:41.261015 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31656eb8-a41c-4b2e-8ecb-f0786156d47b None admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:41.265458 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31656eb8-a41c-4b2e-8ecb-f0786156d47b None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:41.265458 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31656eb8-a41c-4b2e-8ecb-f0786156d47b None admin] PATH_INFO: `/v3/projects/2b478af53391486eb72c85c786ed4abb/users/9b917ce4f7f34b289218f7d36a43983e/roles/fe0e7f0760f74b09b441426d672df700` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:41.275459 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31656eb8-a41c-4b2e-8ecb-f0786156d47b None admin] RBAC: Authorizing `identity:create_grant(project_id=2b478af53391486eb72c85c786ed4abb, user_id=9b917ce4f7f34b289218f7d36a43983e, role_id=fe0e7f0760f74b09b441426d672df700)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:41.276993 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31656eb8-a41c-4b2e-8ecb-f0786156d47b None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:41.382117 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 623/1232] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 13:03:41 2022] PUT /identity/v3/projects/2b478af53391486eb72c85c786ed4abb/users/9b917ce4f7f34b289218f7d36a43983e/roles/fe0e7f0760f74b09b441426d672df700 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:03:43.666286 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bec58a-12da-4432-8d7c-bf2841b28f08 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:43.666816 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bec58a-12da-4432-8d7c-bf2841b28f08 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:43.666816 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bec58a-12da-4432-8d7c-bf2841b28f08 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:43.668545 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 610/1233] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:03:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:03:43.674147 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf3ad1-17d5-452e-a41e-a7531133f4c5 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:43.674573 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf3ad1-17d5-452e-a41e-a7531133f4c5 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:43.674698 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf3ad1-17d5-452e-a41e-a7531133f4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:43.690624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-facf3ad1-17d5-452e-a41e-a7531133f4c5 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:03:43.691792 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-facf3ad1-17d5-452e-a41e-a7531133f4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:03:43.756053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 624/1234] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:03:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:03:43.780875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bec58a-12da-4432-8d7c-bf2841b28f08 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:43.880823 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bec58a-12da-4432-8d7c-bf2841b28f08 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:43.913942 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9944c-bc8e-4ccb-8377-d36323eae57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:43.914824 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9944c-bc8e-4ccb-8377-d36323eae57b None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:43.914983 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9944c-bc8e-4ccb-8377-d36323eae57b None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:43.915254 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9944c-bc8e-4ccb-8377-d36323eae57b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:43.925517 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9944c-bc8e-4ccb-8377-d36323eae57b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:03:43.932354 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-80a9944c-bc8e-4ccb-8377-d36323eae57b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:03:43.933554 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 611/1235] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 13:03:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:03:43.940266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf3ad1-17d5-452e-a41e-a7531133f4c5 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:44.034041 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf3ad1-17d5-452e-a41e-a7531133f4c5 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:44.066250 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c0b30-0685-4292-99dd-d713b441f891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:44.066912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c0b30-0685-4292-99dd-d713b441f891 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:44.067188 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c0b30-0685-4292-99dd-d713b441f891 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:44.067463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c0b30-0685-4292-99dd-d713b441f891 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:44.068188 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c0b30-0685-4292-99dd-d713b441f891 None admin] RBAC: Adding query filter params (name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:44.068489 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c0b30-0685-4292-99dd-d713b441f891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:44.070151 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c0b30-0685-4292-99dd-d713b441f891 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:44.079620 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 625/1236] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 13:03:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:44.085331 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9944c-bc8e-4ccb-8377-d36323eae57b None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:44.181589 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9944c-bc8e-4ccb-8377-d36323eae57b None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:44.212934 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b27ac-97cd-403f-baae-cbbfae8bdac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:44.213733 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b27ac-97cd-403f-baae-cbbfae8bdac4 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:44.214015 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b27ac-97cd-403f-baae-cbbfae8bdac4 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:44.214286 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b27ac-97cd-403f-baae-cbbfae8bdac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:44.225473 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b27ac-97cd-403f-baae-cbbfae8bdac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:44.226985 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b27ac-97cd-403f-baae-cbbfae8bdac4 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:44.243443 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-df0b27ac-97cd-403f-baae-cbbfae8bdac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:03:44.244585 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 612/1237] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:44.251666 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c0b30-0685-4292-99dd-d713b441f891 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:44.347821 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c0b30-0685-4292-99dd-d713b441f891 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:44.380036 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7752c1-e225-447f-8d48-e34bea276d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:44.380712 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7752c1-e225-447f-8d48-e34bea276d9e None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:44.380996 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7752c1-e225-447f-8d48-e34bea276d9e None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:44.381267 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7752c1-e225-447f-8d48-e34bea276d9e None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:44.381973 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7752c1-e225-447f-8d48-e34bea276d9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:44.382273 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7752c1-e225-447f-8d48-e34bea276d9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:44.383624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7752c1-e225-447f-8d48-e34bea276d9e None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:44.395353 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 626/1238] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:44.400962 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b27ac-97cd-403f-baae-cbbfae8bdac4 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:44.496229 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b27ac-97cd-403f-baae-cbbfae8bdac4 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:44.529764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336f2a6-d350-4ed1-b8f9-765e5b970bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:44.531196 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336f2a6-d350-4ed1-b8f9-765e5b970bd7 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:44.531196 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336f2a6-d350-4ed1-b8f9-765e5b970bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:44.531196 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336f2a6-d350-4ed1-b8f9-765e5b970bd7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:44.539110 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336f2a6-d350-4ed1-b8f9-765e5b970bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:44.540532 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336f2a6-d350-4ed1-b8f9-765e5b970bd7 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:44.553546 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-a336f2a6-d350-4ed1-b8f9-765e5b970bd7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 13:03:44.554682 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 613/1239] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:03:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:44.560759 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7752c1-e225-447f-8d48-e34bea276d9e None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:44.656964 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7752c1-e225-447f-8d48-e34bea276d9e None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:44.688757 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7651e-957f-452a-9765-202933260cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:44.689421 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7651e-957f-452a-9765-202933260cd2 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:44.689685 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7651e-957f-452a-9765-202933260cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:44.689955 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7651e-957f-452a-9765-202933260cd2 None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:44.690774 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7651e-957f-452a-9765-202933260cd2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:44.691081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7651e-957f-452a-9765-202933260cd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:44.692496 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7651e-957f-452a-9765-202933260cd2 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:44.710036 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 627/1240] 10.222.0.52 () {56 vars in 1143 bytes} [Tue Mar 8 13:03:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:44.715849 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336f2a6-d350-4ed1-b8f9-765e5b970bd7 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:44.811347 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336f2a6-d350-4ed1-b8f9-765e5b970bd7 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:44.845897 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4be8c-0aba-494e-a3bd-da07eee2f92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:44.846541 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4be8c-0aba-494e-a3bd-da07eee2f92a None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:44.846819 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4be8c-0aba-494e-a3bd-da07eee2f92a None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:44.847089 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4be8c-0aba-494e-a3bd-da07eee2f92a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:44.914486 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4be8c-0aba-494e-a3bd-da07eee2f92a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:44.915975 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4be8c-0aba-494e-a3bd-da07eee2f92a None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:45.009139 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 614/1241] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:03:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:03:45.015610 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7651e-957f-452a-9765-202933260cd2 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:45.110699 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7651e-957f-452a-9765-202933260cd2 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:45.143101 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2019a-087d-4b38-9303-7b8bc90427e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:45.143873 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2019a-087d-4b38-9303-7b8bc90427e9 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:45.144150 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2019a-087d-4b38-9303-7b8bc90427e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:45.144419 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2019a-087d-4b38-9303-7b8bc90427e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:45.154559 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2019a-087d-4b38-9303-7b8bc90427e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:45.156125 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2019a-087d-4b38-9303-7b8bc90427e9 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:45.172604 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-95a2019a-087d-4b38-9303-7b8bc90427e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:03:45.173815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 628/1242] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:45.179566 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4be8c-0aba-494e-a3bd-da07eee2f92a None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:45.274429 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4be8c-0aba-494e-a3bd-da07eee2f92a None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:45.306413 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb5139-c686-487f-94b8-25054d63af64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:45.307064 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb5139-c686-487f-94b8-25054d63af64 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:45.307345 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb5139-c686-487f-94b8-25054d63af64 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:45.307619 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb5139-c686-487f-94b8-25054d63af64 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:45.308326 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb5139-c686-487f-94b8-25054d63af64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:45.308630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb5139-c686-487f-94b8-25054d63af64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:45.310109 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb5139-c686-487f-94b8-25054d63af64 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:45.321367 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 615/1243] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:45.327753 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2019a-087d-4b38-9303-7b8bc90427e9 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:45.423116 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2019a-087d-4b38-9303-7b8bc90427e9 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:45.455788 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c25b2c-1297-4243-8e54-f688fe01351d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:45.456564 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c25b2c-1297-4243-8e54-f688fe01351d None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:45.456866 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c25b2c-1297-4243-8e54-f688fe01351d None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:45.457132 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c25b2c-1297-4243-8e54-f688fe01351d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:45.463661 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c25b2c-1297-4243-8e54-f688fe01351d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:45.465619 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c25b2c-1297-4243-8e54-f688fe01351d None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:45.478344 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-b4c25b2c-1297-4243-8e54-f688fe01351d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:03:45.479481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 629/1244] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:03:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:45.485741 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb5139-c686-487f-94b8-25054d63af64 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:45.583890 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb5139-c686-487f-94b8-25054d63af64 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:45.616609 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ed34a-6f9c-4181-93fc-9633a51a546e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:45.617317 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ed34a-6f9c-4181-93fc-9633a51a546e None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:45.617595 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ed34a-6f9c-4181-93fc-9633a51a546e None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:45.617864 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ed34a-6f9c-4181-93fc-9633a51a546e None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:45.618720 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ed34a-6f9c-4181-93fc-9633a51a546e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:45.619020 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ed34a-6f9c-4181-93fc-9633a51a546e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:45.620436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ed34a-6f9c-4181-93fc-9633a51a546e None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:45.632587 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 616/1245] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:03:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:45.639057 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c25b2c-1297-4243-8e54-f688fe01351d None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:45.734354 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c25b2c-1297-4243-8e54-f688fe01351d None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:45.766870 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f3735-9da1-4286-88eb-9ce18034b330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:45.767505 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f3735-9da1-4286-88eb-9ce18034b330 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:45.767781 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f3735-9da1-4286-88eb-9ce18034b330 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:45.768695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f3735-9da1-4286-88eb-9ce18034b330 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:45.768870 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f3735-9da1-4286-88eb-9ce18034b330 None admin] RBAC: Adding query filter params (role.id=fe0e7f0760f74b09b441426d672df700, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=9b917ce4f7f34b289218f7d36a43983e) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:45.769179 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f3735-9da1-4286-88eb-9ce18034b330 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:45.770592 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f3735-9da1-4286-88eb-9ce18034b330 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:45.776096 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 630/1246] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:03:45 2022] GET /identity/v3/role_assignments?user.id=9b917ce4f7f34b289218f7d36a43983e&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=fe0e7f0760f74b09b441426d672df700 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:48.286578 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae96253-6a46-42ee-a974-48888ab8704c None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:48.287180 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae96253-6a46-42ee-a974-48888ab8704c None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:48.287180 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae96253-6a46-42ee-a974-48888ab8704c None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:48.288949 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 617/1247] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:03:48.294148 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c9ac6-e879-4d1a-b415-a0be9a5cbe22 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:48.295093 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c9ac6-e879-4d1a-b415-a0be9a5cbe22 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:48.295093 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c9ac6-e879-4d1a-b415-a0be9a5cbe22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:48.311542 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-328c9ac6-e879-4d1a-b415-a0be9a5cbe22 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:03:48.312722 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-328c9ac6-e879-4d1a-b415-a0be9a5cbe22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:03:48.378209 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 631/1248] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:03:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:03:48.402596 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae96253-6a46-42ee-a974-48888ab8704c None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:48.500208 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae96253-6a46-42ee-a974-48888ab8704c None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:48.539744 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73d4b7-bf57-4c0c-95bd-53763938dd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:48.540450 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73d4b7-bf57-4c0c-95bd-53763938dd66 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:48.540755 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73d4b7-bf57-4c0c-95bd-53763938dd66 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:48.541032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73d4b7-bf57-4c0c-95bd-53763938dd66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:48.550894 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73d4b7-bf57-4c0c-95bd-53763938dd66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:03:48.557832 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-0c73d4b7-bf57-4c0c-95bd-53763938dd66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:03:48.559001 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 618/1249] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:03:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:03:48.565934 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c9ac6-e879-4d1a-b415-a0be9a5cbe22 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:48.665577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c9ac6-e879-4d1a-b415-a0be9a5cbe22 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:48.698322 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478ceb9-35fb-4585-bb59-3c00b6ecdac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:48.698971 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478ceb9-35fb-4585-bb59-3c00b6ecdac4 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:48.699250 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478ceb9-35fb-4585-bb59-3c00b6ecdac4 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:48.699520 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478ceb9-35fb-4585-bb59-3c00b6ecdac4 None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:48.700276 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478ceb9-35fb-4585-bb59-3c00b6ecdac4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:48.700575 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478ceb9-35fb-4585-bb59-3c00b6ecdac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:48.702771 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478ceb9-35fb-4585-bb59-3c00b6ecdac4 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:48.710616 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 632/1250] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:03:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:03:48.716303 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73d4b7-bf57-4c0c-95bd-53763938dd66 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:48.815807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73d4b7-bf57-4c0c-95bd-53763938dd66 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:48.849180 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e62035-94f8-4c08-854c-2d1c553896cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:48.849993 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e62035-94f8-4c08-854c-2d1c553896cf None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:48.850278 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e62035-94f8-4c08-854c-2d1c553896cf None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:48.850553 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e62035-94f8-4c08-854c-2d1c553896cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:48.860862 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e62035-94f8-4c08-854c-2d1c553896cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:48.862309 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e62035-94f8-4c08-854c-2d1c553896cf None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:48.877974 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-53e62035-94f8-4c08-854c-2d1c553896cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:03:48.879126 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 619/1251] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:48.884872 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478ceb9-35fb-4585-bb59-3c00b6ecdac4 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:48.982088 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478ceb9-35fb-4585-bb59-3c00b6ecdac4 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:49.014669 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af226c-9448-4f8e-aa68-481a76da8f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:49.015328 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af226c-9448-4f8e-aa68-481a76da8f66 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:49.015605 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af226c-9448-4f8e-aa68-481a76da8f66 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:49.015873 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af226c-9448-4f8e-aa68-481a76da8f66 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:49.016680 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af226c-9448-4f8e-aa68-481a76da8f66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:49.016983 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af226c-9448-4f8e-aa68-481a76da8f66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:49.018338 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af226c-9448-4f8e-aa68-481a76da8f66 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:49.031100 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 633/1252] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:49.036840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e62035-94f8-4c08-854c-2d1c553896cf None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:49.134983 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e62035-94f8-4c08-854c-2d1c553896cf None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:49.167763 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9b52b-5349-4c13-b6b0-e4d3ce4c88d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:49.168556 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9b52b-5349-4c13-b6b0-e4d3ce4c88d7 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:49.171164 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9b52b-5349-4c13-b6b0-e4d3ce4c88d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:49.171164 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9b52b-5349-4c13-b6b0-e4d3ce4c88d7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:49.177166 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9b52b-5349-4c13-b6b0-e4d3ce4c88d7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:49.178612 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9b52b-5349-4c13-b6b0-e4d3ce4c88d7 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:49.192374 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-a1e9b52b-5349-4c13-b6b0-e4d3ce4c88d7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 13:03:49.193612 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 620/1253] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:03:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:49.199384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af226c-9448-4f8e-aa68-481a76da8f66 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:49.297382 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af226c-9448-4f8e-aa68-481a76da8f66 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:49.332160 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7f71b-152d-42bd-99ef-c662d82fcda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:49.332933 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7f71b-152d-42bd-99ef-c662d82fcda8 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:49.333214 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7f71b-152d-42bd-99ef-c662d82fcda8 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:49.333488 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7f71b-152d-42bd-99ef-c662d82fcda8 None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:49.334318 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7f71b-152d-42bd-99ef-c662d82fcda8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:49.334624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7f71b-152d-42bd-99ef-c662d82fcda8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:49.336048 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7f71b-152d-42bd-99ef-c662d82fcda8 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:49.353315 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 634/1254] 10.222.0.52 () {56 vars in 1143 bytes} [Tue Mar 8 13:03:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:49.359540 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9b52b-5349-4c13-b6b0-e4d3ce4c88d7 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:49.459366 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9b52b-5349-4c13-b6b0-e4d3ce4c88d7 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:49.493251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca740b0-b19b-4c8e-b00f-270923cb3bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:49.493894 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca740b0-b19b-4c8e-b00f-270923cb3bd0 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:49.494196 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca740b0-b19b-4c8e-b00f-270923cb3bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:49.494472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca740b0-b19b-4c8e-b00f-270923cb3bd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:49.573811 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca740b0-b19b-4c8e-b00f-270923cb3bd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:49.575322 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca740b0-b19b-4c8e-b00f-270923cb3bd0 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:49.674875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 621/1255] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:03:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:03:49.681072 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7f71b-152d-42bd-99ef-c662d82fcda8 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:49.777359 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7f71b-152d-42bd-99ef-c662d82fcda8 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:49.809735 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab9c13-c5ce-421e-9a02-fde8f02e17d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:49.810517 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab9c13-c5ce-421e-9a02-fde8f02e17d2 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:49.810791 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab9c13-c5ce-421e-9a02-fde8f02e17d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:49.811775 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab9c13-c5ce-421e-9a02-fde8f02e17d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:49.821755 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab9c13-c5ce-421e-9a02-fde8f02e17d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:49.824379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab9c13-c5ce-421e-9a02-fde8f02e17d2 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:49.839607 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-94ab9c13-c5ce-421e-9a02-fde8f02e17d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:03:49.840775 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 635/1256] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:49.848557 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca740b0-b19b-4c8e-b00f-270923cb3bd0 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:49.942986 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca740b0-b19b-4c8e-b00f-270923cb3bd0 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:49.975137 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de80e14-7345-4c6a-aa3b-9a139e28c3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:49.976211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de80e14-7345-4c6a-aa3b-9a139e28c3f0 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:49.976211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de80e14-7345-4c6a-aa3b-9a139e28c3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:49.976429 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de80e14-7345-4c6a-aa3b-9a139e28c3f0 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:49.977118 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de80e14-7345-4c6a-aa3b-9a139e28c3f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:49.977424 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de80e14-7345-4c6a-aa3b-9a139e28c3f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:49.978792 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de80e14-7345-4c6a-aa3b-9a139e28c3f0 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:49.990418 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 622/1257] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:49.996083 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab9c13-c5ce-421e-9a02-fde8f02e17d2 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:50.091127 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab9c13-c5ce-421e-9a02-fde8f02e17d2 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:50.126994 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff7463-ffe2-4771-9393-ffa541677517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:50.127940 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff7463-ffe2-4771-9393-ffa541677517 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:50.128273 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff7463-ffe2-4771-9393-ffa541677517 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:50.128604 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff7463-ffe2-4771-9393-ffa541677517 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:50.136419 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff7463-ffe2-4771-9393-ffa541677517 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:50.138929 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff7463-ffe2-4771-9393-ffa541677517 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:50.153279 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-5cff7463-ffe2-4771-9393-ffa541677517 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:03:50.155172 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 636/1258] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:03:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:50.161333 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de80e14-7345-4c6a-aa3b-9a139e28c3f0 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:50.257855 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de80e14-7345-4c6a-aa3b-9a139e28c3f0 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:50.291069 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8626b-a346-41e6-9222-6195e6491015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:50.291729 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8626b-a346-41e6-9222-6195e6491015 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:50.292017 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8626b-a346-41e6-9222-6195e6491015 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:50.292285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8626b-a346-41e6-9222-6195e6491015 None admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:50.293130 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8626b-a346-41e6-9222-6195e6491015 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:50.293438 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8626b-a346-41e6-9222-6195e6491015 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:50.294877 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8626b-a346-41e6-9222-6195e6491015 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:50.307090 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 623/1259] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:03:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:50.313609 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff7463-ffe2-4771-9393-ffa541677517 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:50.424501 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff7463-ffe2-4771-9393-ffa541677517 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:50.458405 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ef430-142f-479c-a1f9-692d1098ceff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:50.459056 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ef430-142f-479c-a1f9-692d1098ceff None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:50.459333 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ef430-142f-479c-a1f9-692d1098ceff None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:50.459602 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ef430-142f-479c-a1f9-692d1098ceff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:50.460411 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ef430-142f-479c-a1f9-692d1098ceff None admin] RBAC: Adding query filter params (role.id=f9ec85924a914e078096b38cae4e6caa, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=9b917ce4f7f34b289218f7d36a43983e) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:50.460748 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ef430-142f-479c-a1f9-692d1098ceff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:50.462217 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ef430-142f-479c-a1f9-692d1098ceff None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:50.469050 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 637/1260] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:03:50 2022] GET /identity/v3/role_assignments?user.id=9b917ce4f7f34b289218f7d36a43983e&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=f9ec85924a914e078096b38cae4e6caa => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:03:52.837150 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7d5fc-55ff-4099-a901-d6e0fae3498c None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:52.837736 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7d5fc-55ff-4099-a901-d6e0fae3498c None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:52.837736 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7d5fc-55ff-4099-a901-d6e0fae3498c None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:52.839490 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 624/1261] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:03:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:03:52.845425 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc051a5-57c8-446c-aea4-5f07da78cfbf None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:52.845874 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc051a5-57c8-446c-aea4-5f07da78cfbf None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:52.845974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc051a5-57c8-446c-aea4-5f07da78cfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:52.863843 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-7dc051a5-57c8-446c-aea4-5f07da78cfbf None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:03:52.865095 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-7dc051a5-57c8-446c-aea4-5f07da78cfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:03:52.929598 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 638/1262] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:03:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:03:52.953151 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7d5fc-55ff-4099-a901-d6e0fae3498c None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:53.050276 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7d5fc-55ff-4099-a901-d6e0fae3498c None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:53.082754 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951b046-0354-401a-bf9f-3da69a1cc58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:53.083532 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951b046-0354-401a-bf9f-3da69a1cc58c None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:53.083818 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951b046-0354-401a-bf9f-3da69a1cc58c None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:53.084118 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951b046-0354-401a-bf9f-3da69a1cc58c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:53.094135 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951b046-0354-401a-bf9f-3da69a1cc58c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:03:53.101039 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-d951b046-0354-401a-bf9f-3da69a1cc58c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:03:53.102243 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 625/1263] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:03:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:53.108564 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc051a5-57c8-446c-aea4-5f07da78cfbf None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:53.220218 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc051a5-57c8-446c-aea4-5f07da78cfbf None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:53.252970 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66553bcb-43a7-4508-9b06-ed973c23e2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:53.253631 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66553bcb-43a7-4508-9b06-ed973c23e2ac None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:53.253914 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66553bcb-43a7-4508-9b06-ed973c23e2ac None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:53.254186 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66553bcb-43a7-4508-9b06-ed973c23e2ac None admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:53.254921 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66553bcb-43a7-4508-9b06-ed973c23e2ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:53.255223 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66553bcb-43a7-4508-9b06-ed973c23e2ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:53.256591 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66553bcb-43a7-4508-9b06-ed973c23e2ac None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:53.265606 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 639/1264] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:03:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:53.271382 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951b046-0354-401a-bf9f-3da69a1cc58c None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:53.367649 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951b046-0354-401a-bf9f-3da69a1cc58c None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:53.400323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa2f94-9942-4d97-a9bf-6cc47e57c960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:53.401138 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa2f94-9942-4d97-a9bf-6cc47e57c960 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:53.401424 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa2f94-9942-4d97-a9bf-6cc47e57c960 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:53.401699 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa2f94-9942-4d97-a9bf-6cc47e57c960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:53.412055 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa2f94-9942-4d97-a9bf-6cc47e57c960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:53.413525 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa2f94-9942-4d97-a9bf-6cc47e57c960 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:53.430210 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-efaa2f94-9942-4d97-a9bf-6cc47e57c960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:03:53.431355 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 626/1265] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:03:53.437971 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66553bcb-43a7-4508-9b06-ed973c23e2ac None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:53.533059 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66553bcb-43a7-4508-9b06-ed973c23e2ac None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:53.565861 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8afd54-41a6-470e-8aa5-c35401da5d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:53.566511 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8afd54-41a6-470e-8aa5-c35401da5d6b None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:53.566788 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8afd54-41a6-470e-8aa5-c35401da5d6b None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:53.567057 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8afd54-41a6-470e-8aa5-c35401da5d6b None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:53.567759 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8afd54-41a6-470e-8aa5-c35401da5d6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:53.568060 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8afd54-41a6-470e-8aa5-c35401da5d6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:53.569442 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8afd54-41a6-470e-8aa5-c35401da5d6b None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:53.580441 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 640/1266] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:53.586012 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa2f94-9942-4d97-a9bf-6cc47e57c960 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:53.683902 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa2f94-9942-4d97-a9bf-6cc47e57c960 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:53.715575 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460424e-f54d-4a59-b58a-a6bc391d812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:53.716389 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460424e-f54d-4a59-b58a-a6bc391d812a None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:53.716694 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460424e-f54d-4a59-b58a-a6bc391d812a None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:53.716975 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460424e-f54d-4a59-b58a-a6bc391d812a None admin] PATH_INFO: `/v3/users/placement` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:53.724853 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460424e-f54d-4a59-b58a-a6bc391d812a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:53.726295 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460424e-f54d-4a59-b58a-a6bc391d812a None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:53.740097 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-1460424e-f54d-4a59-b58a-a6bc391d812a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 13:03:53.741280 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 627/1267] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:03:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:53.746964 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8afd54-41a6-470e-8aa5-c35401da5d6b None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:53.841940 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8afd54-41a6-470e-8aa5-c35401da5d6b None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:53.875066 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacaba2-6d78-429b-8208-09f55c6e7161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:53.875725 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacaba2-6d78-429b-8208-09f55c6e7161 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:53.876111 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacaba2-6d78-429b-8208-09f55c6e7161 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:53.876358 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacaba2-6d78-429b-8208-09f55c6e7161 None admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:53.877230 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacaba2-6d78-429b-8208-09f55c6e7161 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:53.877538 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacaba2-6d78-429b-8208-09f55c6e7161 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:53.878962 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacaba2-6d78-429b-8208-09f55c6e7161 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:53.895931 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 641/1268] 10.222.0.52 () {56 vars in 1143 bytes} [Tue Mar 8 13:03:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:53.901551 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460424e-f54d-4a59-b58a-a6bc391d812a None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:53.997952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460424e-f54d-4a59-b58a-a6bc391d812a None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:54.030301 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb18ea2-db27-43db-bf98-33a959874828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:54.031148 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb18ea2-db27-43db-bf98-33a959874828 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:54.031422 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb18ea2-db27-43db-bf98-33a959874828 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:54.031695 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb18ea2-db27-43db-bf98-33a959874828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:54.041883 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb18ea2-db27-43db-bf98-33a959874828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:54.043356 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb18ea2-db27-43db-bf98-33a959874828 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:54.059776 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-feb18ea2-db27-43db-bf98-33a959874828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:03:54.060941 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 628/1269] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:54.066756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacaba2-6d78-429b-8208-09f55c6e7161 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:54.163943 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacaba2-6d78-429b-8208-09f55c6e7161 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:54.195227 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303309d-5e2f-4051-ba1a-4e7edfd28597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:54.195868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303309d-5e2f-4051-ba1a-4e7edfd28597 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:54.196143 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303309d-5e2f-4051-ba1a-4e7edfd28597 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:54.196413 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303309d-5e2f-4051-ba1a-4e7edfd28597 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:54.197146 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303309d-5e2f-4051-ba1a-4e7edfd28597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:54.197446 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303309d-5e2f-4051-ba1a-4e7edfd28597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:54.198842 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303309d-5e2f-4051-ba1a-4e7edfd28597 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:54.209838 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 642/1270] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:54.215429 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb18ea2-db27-43db-bf98-33a959874828 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:54.314200 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb18ea2-db27-43db-bf98-33a959874828 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:54.346766 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34f4e3-9b6b-48cc-94c1-d8feff01e7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:54.347552 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34f4e3-9b6b-48cc-94c1-d8feff01e7ce None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:54.347834 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34f4e3-9b6b-48cc-94c1-d8feff01e7ce None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:54.348108 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34f4e3-9b6b-48cc-94c1-d8feff01e7ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:54.354657 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34f4e3-9b6b-48cc-94c1-d8feff01e7ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:54.356100 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34f4e3-9b6b-48cc-94c1-d8feff01e7ce None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:54.369547 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-ae34f4e3-9b6b-48cc-94c1-d8feff01e7ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:03:54.370707 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 629/1271] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:03:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:54.376987 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303309d-5e2f-4051-ba1a-4e7edfd28597 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:54.474697 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303309d-5e2f-4051-ba1a-4e7edfd28597 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:54.508967 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2d931-34be-4de9-9c12-146e7154e347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:54.509618 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2d931-34be-4de9-9c12-146e7154e347 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:54.509895 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2d931-34be-4de9-9c12-146e7154e347 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:54.510166 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2d931-34be-4de9-9c12-146e7154e347 None admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:54.510933 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2d931-34be-4de9-9c12-146e7154e347 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:54.511237 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2d931-34be-4de9-9c12-146e7154e347 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:54.512649 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2d931-34be-4de9-9c12-146e7154e347 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:54.524845 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 643/1272] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:54.531197 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34f4e3-9b6b-48cc-94c1-d8feff01e7ce None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:54.626977 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34f4e3-9b6b-48cc-94c1-d8feff01e7ce None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:54.661386 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f6555-601e-460d-b2a9-f0cbfc463882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:54.662266 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f6555-601e-460d-b2a9-f0cbfc463882 None admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:54.662547 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f6555-601e-460d-b2a9-f0cbfc463882 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:54.662818 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f6555-601e-460d-b2a9-f0cbfc463882 None admin] PATH_INFO: `/v3/projects/2b478af53391486eb72c85c786ed4abb/users/9b917ce4f7f34b289218f7d36a43983e/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:54.664803 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f6555-601e-460d-b2a9-f0cbfc463882 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b478af53391486eb72c85c786ed4abb, user_id=9b917ce4f7f34b289218f7d36a43983e, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:54.666241 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f6555-601e-460d-b2a9-f0cbfc463882 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:54.767621 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 630/1273] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 13:03:54 2022] PUT /identity/v3/projects/2b478af53391486eb72c85c786ed4abb/users/9b917ce4f7f34b289218f7d36a43983e/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:03:57.050042 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f38dea-9c05-4b6f-bc15-0ad35a94edd7 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:57.050636 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f38dea-9c05-4b6f-bc15-0ad35a94edd7 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:57.050636 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f38dea-9c05-4b6f-bc15-0ad35a94edd7 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:57.052425 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 644/1274] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:03:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:03:57.057691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdae25-3410-4bf7-ac0c-501543d21a6f None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:57.058116 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdae25-3410-4bf7-ac0c-501543d21a6f None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:57.058243 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdae25-3410-4bf7-ac0c-501543d21a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:57.075043 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-dacdae25-3410-4bf7-ac0c-501543d21a6f None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:03:57.076217 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-dacdae25-3410-4bf7-ac0c-501543d21a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:03:57.140840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 631/1275] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:03:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:03:57.163905 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f38dea-9c05-4b6f-bc15-0ad35a94edd7 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:57.260916 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f38dea-9c05-4b6f-bc15-0ad35a94edd7 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:57.292481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba0a8b-b284-4921-8df6-adc4c47cc713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:57.293285 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba0a8b-b284-4921-8df6-adc4c47cc713 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:57.293644 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba0a8b-b284-4921-8df6-adc4c47cc713 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:57.293912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba0a8b-b284-4921-8df6-adc4c47cc713 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:57.304464 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba0a8b-b284-4921-8df6-adc4c47cc713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:03:57.311836 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-a7ba0a8b-b284-4921-8df6-adc4c47cc713 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:03:57.313003 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 645/1276] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 13:03:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:57.319099 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdae25-3410-4bf7-ac0c-501543d21a6f None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:57.413200 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdae25-3410-4bf7-ac0c-501543d21a6f None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:57.446319 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c652b-ba87-4630-adf9-761e471317c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:57.447016 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c652b-ba87-4630-adf9-761e471317c2 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:57.447300 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c652b-ba87-4630-adf9-761e471317c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:57.447577 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c652b-ba87-4630-adf9-761e471317c2 None admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:57.448318 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c652b-ba87-4630-adf9-761e471317c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:57.448625 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c652b-ba87-4630-adf9-761e471317c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:57.450026 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c652b-ba87-4630-adf9-761e471317c2 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:57.457726 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 632/1277] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 13:03:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:57.463425 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba0a8b-b284-4921-8df6-adc4c47cc713 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:57.559968 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba0a8b-b284-4921-8df6-adc4c47cc713 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:57.591326 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1779a-860b-4434-80ed-e481add93506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:57.592110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1779a-860b-4434-80ed-e481add93506 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:57.592387 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1779a-860b-4434-80ed-e481add93506 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:57.593226 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1779a-860b-4434-80ed-e481add93506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:57.603428 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1779a-860b-4434-80ed-e481add93506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:57.604896 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1779a-860b-4434-80ed-e481add93506 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:57.621082 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-88b1779a-860b-4434-80ed-e481add93506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:03:57.622232 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 646/1278] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:57.628084 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c652b-ba87-4630-adf9-761e471317c2 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:57.722512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c652b-ba87-4630-adf9-761e471317c2 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:57.753266 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35505953-1a0b-4fbc-9da1-ba867f305d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:57.753906 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35505953-1a0b-4fbc-9da1-ba867f305d51 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:57.754184 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35505953-1a0b-4fbc-9da1-ba867f305d51 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:57.754454 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35505953-1a0b-4fbc-9da1-ba867f305d51 None admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:57.755153 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35505953-1a0b-4fbc-9da1-ba867f305d51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:57.755451 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35505953-1a0b-4fbc-9da1-ba867f305d51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:57.756836 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35505953-1a0b-4fbc-9da1-ba867f305d51 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:57.768160 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 633/1279] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:57.773953 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1779a-860b-4434-80ed-e481add93506 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:57.870092 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1779a-860b-4434-80ed-e481add93506 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:57.901863 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec367d5-a093-4635-a4f1-f2b958e2c643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:57.902651 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec367d5-a093-4635-a4f1-f2b958e2c643 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:57.902937 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec367d5-a093-4635-a4f1-f2b958e2c643 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:57.903212 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec367d5-a093-4635-a4f1-f2b958e2c643 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:57.910755 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec367d5-a093-4635-a4f1-f2b958e2c643 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:57.912201 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec367d5-a093-4635-a4f1-f2b958e2c643 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:57.926456 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-cec367d5-a093-4635-a4f1-f2b958e2c643 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 13:03:57.927605 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 647/1280] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:03:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:57.933449 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35505953-1a0b-4fbc-9da1-ba867f305d51 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:58.028735 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35505953-1a0b-4fbc-9da1-ba867f305d51 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:58.064036 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8baeb6-6660-490b-8e20-f99a5db6a55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:58.064717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8baeb6-6660-490b-8e20-f99a5db6a55d None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:58.065006 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8baeb6-6660-490b-8e20-f99a5db6a55d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:58.065285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8baeb6-6660-490b-8e20-f99a5db6a55d None admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:58.066110 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8baeb6-6660-490b-8e20-f99a5db6a55d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:58.066419 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8baeb6-6660-490b-8e20-f99a5db6a55d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:58.067845 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8baeb6-6660-490b-8e20-f99a5db6a55d None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:58.084790 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 634/1281] 10.222.0.52 () {56 vars in 1143 bytes} [Tue Mar 8 13:03:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:58.090474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec367d5-a093-4635-a4f1-f2b958e2c643 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:58.195293 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec367d5-a093-4635-a4f1-f2b958e2c643 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:58.226891 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e6172-8939-4f59-a2a5-c597b2c5528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:58.227527 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e6172-8939-4f59-a2a5-c597b2c5528b None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:58.227806 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e6172-8939-4f59-a2a5-c597b2c5528b None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:58.228075 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e6172-8939-4f59-a2a5-c597b2c5528b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:58.291627 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e6172-8939-4f59-a2a5-c597b2c5528b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:58.293107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e6172-8939-4f59-a2a5-c597b2c5528b None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:58.391676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 648/1282] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 13:03:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 13:03:58.397376 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8baeb6-6660-490b-8e20-f99a5db6a55d None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:58.491115 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8baeb6-6660-490b-8e20-f99a5db6a55d None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:58.522910 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b5c3b-9d62-4362-8a4a-5707cc08c310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:58.523737 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b5c3b-9d62-4362-8a4a-5707cc08c310 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:58.524015 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b5c3b-9d62-4362-8a4a-5707cc08c310 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:58.524283 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b5c3b-9d62-4362-8a4a-5707cc08c310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:58.534474 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b5c3b-9d62-4362-8a4a-5707cc08c310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:58.535979 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b5c3b-9d62-4362-8a4a-5707cc08c310 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:58.552788 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-ea9b5c3b-9d62-4362-8a4a-5707cc08c310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:03:58.555487 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 635/1283] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:03:58.559674 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e6172-8939-4f59-a2a5-c597b2c5528b None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:58.654504 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e6172-8939-4f59-a2a5-c597b2c5528b None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:58.686166 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd3270-7dcd-4fa5-b338-ac1d3a2b12c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:58.686916 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3270-7dcd-4fa5-b338-ac1d3a2b12c5 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:58.687196 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3270-7dcd-4fa5-b338-ac1d3a2b12c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:58.687469 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3270-7dcd-4fa5-b338-ac1d3a2b12c5 None admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:58.688179 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd3270-7dcd-4fa5-b338-ac1d3a2b12c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:58.688481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd3270-7dcd-4fa5-b338-ac1d3a2b12c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:58.689878 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd3270-7dcd-4fa5-b338-ac1d3a2b12c5 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:58.700542 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 649/1284] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 13:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:58.706743 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b5c3b-9d62-4362-8a4a-5707cc08c310 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:58.802796 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b5c3b-9d62-4362-8a4a-5707cc08c310 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:58.837120 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7d936-20b3-4d56-a2f4-fec3a5bd7811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:58.837935 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7d936-20b3-4d56-a2f4-fec3a5bd7811 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:58.838210 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7d936-20b3-4d56-a2f4-fec3a5bd7811 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:58.838477 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7d936-20b3-4d56-a2f4-fec3a5bd7811 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:58.845748 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7d936-20b3-4d56-a2f4-fec3a5bd7811 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:58.847185 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7d936-20b3-4d56-a2f4-fec3a5bd7811 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:58.859631 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING keystone.server.flask.application [None req-f0c7d936-20b3-4d56-a2f4-fec3a5bd7811 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:03:58.860784 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 636/1285] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 13:03:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:03:58.866608 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd3270-7dcd-4fa5-b338-ac1d3a2b12c5 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:58.963436 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd3270-7dcd-4fa5-b338-ac1d3a2b12c5 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:58.995900 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d7270-d4df-4a78-bd9e-3a3c7d02e471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:58.996560 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d7270-d4df-4a78-bd9e-3a3c7d02e471 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:58.996944 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d7270-d4df-4a78-bd9e-3a3c7d02e471 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:58.997225 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d7270-d4df-4a78-bd9e-3a3c7d02e471 None admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:58.998098 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d7270-d4df-4a78-bd9e-3a3c7d02e471 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:58.998613 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d7270-d4df-4a78-bd9e-3a3c7d02e471 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:59.000236 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d7270-d4df-4a78-bd9e-3a3c7d02e471 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:59.012978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 650/1286] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 13:03:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:03:59.019752 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7d936-20b3-4d56-a2f4-fec3a5bd7811 None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:03:59.125776 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7d936-20b3-4d56-a2f4-fec3a5bd7811 None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:03:59.161737 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03773e07-8b64-4724-acb1-c574c8e06451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:03:59.162405 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03773e07-8b64-4724-acb1-c574c8e06451 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:03:59.162688 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03773e07-8b64-4724-acb1-c574c8e06451 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:03:59.162961 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03773e07-8b64-4724-acb1-c574c8e06451 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:03:59.163807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03773e07-8b64-4724-acb1-c574c8e06451 None admin] RBAC: Adding query filter params (role.id=f9ec85924a914e078096b38cae4e6caa, scope.project.id=2b478af53391486eb72c85c786ed4abb, user.id=9b917ce4f7f34b289218f7d36a43983e) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:03:59.164119 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03773e07-8b64-4724-acb1-c574c8e06451 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:03:59.165620 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03773e07-8b64-4724-acb1-c574c8e06451 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:03:59.172299 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 637/1287] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 13:03:59 2022] GET /identity/v3/role_assignments?user.id=9b917ce4f7f34b289218f7d36a43983e&scope.project.id=2b478af53391486eb72c85c786ed4abb&role.id=f9ec85924a914e078096b38cae4e6caa => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:04:01.504682 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e86a3-2bcc-4c05-b7de-6cd043a266f5 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:04:01.505216 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e86a3-2bcc-4c05-b7de-6cd043a266f5 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:04:01.505312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e86a3-2bcc-4c05-b7de-6cd043a266f5 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:04:01.507129 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 651/1288] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:04:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:04:01.512363 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936968f-c9fc-416e-952c-aa2a98c2d4da None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:04:01.512812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936968f-c9fc-416e-952c-aa2a98c2d4da None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:04:01.512945 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936968f-c9fc-416e-952c-aa2a98c2d4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:04:01.531921 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-e936968f-c9fc-416e-952c-aa2a98c2d4da None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:04:01.537846 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-e936968f-c9fc-416e-952c-aa2a98c2d4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:04:01.605035 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 638/1289] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:04:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:04:01.627442 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e86a3-2bcc-4c05-b7de-6cd043a266f5 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:04:01.723781 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e86a3-2bcc-4c05-b7de-6cd043a266f5 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:04:01.754605 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a6e40-c8cb-42d5-8b9c-a58b8539a3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:04:01.755384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a6e40-c8cb-42d5-8b9c-a58b8539a3a7 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:04:01.755658 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a6e40-c8cb-42d5-8b9c-a58b8539a3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:04:01.755926 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a6e40-c8cb-42d5-8b9c-a58b8539a3a7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:04:01.756563 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a6e40-c8cb-42d5-8b9c-a58b8539a3a7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:04:01.757991 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a6e40-c8cb-42d5-8b9c-a58b8539a3a7 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:04:01.769387 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-c79a6e40-c8cb-42d5-8b9c-a58b8539a3a7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 08 13:04:01.770525 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 652/1290] 10.222.0.52 () {56 vars in 1117 bytes} [Tue Mar 8 13:04:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:04:01.776598 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936968f-c9fc-416e-952c-aa2a98c2d4da None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:04:01.871340 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936968f-c9fc-416e-952c-aa2a98c2d4da None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:04:01.915407 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331dc34c-95ae-4a99-a551-4c5031a4412d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:04:01.916067 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dc34c-95ae-4a99-a551-4c5031a4412d None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:04:01.916338 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dc34c-95ae-4a99-a551-4c5031a4412d None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:04:01.916605 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dc34c-95ae-4a99-a551-4c5031a4412d None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:04:01.917328 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331dc34c-95ae-4a99-a551-4c5031a4412d None admin] RBAC: Adding query filter params (name=placement) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:04:01.917629 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331dc34c-95ae-4a99-a551-4c5031a4412d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:04:01.918995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331dc34c-95ae-4a99-a551-4c5031a4412d None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:04:01.923816 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 639/1291] 10.222.0.52 () {56 vars in 1116 bytes} [Tue Mar 8 13:04:01 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:04:01.929928 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a6e40-c8cb-42d5-8b9c-a58b8539a3a7 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:04:02.026611 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a6e40-c8cb-42d5-8b9c-a58b8539a3a7 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:04:02.057709 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddb44f-acd4-4f60-9929-25c381046f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:04:02.058394 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddb44f-acd4-4f60-9929-25c381046f1a None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:04:02.058676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddb44f-acd4-4f60-9929-25c381046f1a None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:04:02.058949 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddb44f-acd4-4f60-9929-25c381046f1a None admin] PATH_INFO: `/v3/services` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:04:02.059646 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddb44f-acd4-4f60-9929-25c381046f1a None admin] RBAC: Adding query filter params (type=placement) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:04:02.059950 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddb44f-acd4-4f60-9929-25c381046f1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:04:02.061859 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddb44f-acd4-4f60-9929-25c381046f1a None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:04:02.066398 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 653/1292] 10.222.0.52 () {56 vars in 1116 bytes} [Tue Mar 8 13:04:01 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:04:04.336693 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912597a-da33-4867-bb20-7487e39a42e0 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:04:04.337235 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912597a-da33-4867-bb20-7487e39a42e0 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:04:04.337235 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912597a-da33-4867-bb20-7487e39a42e0 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:04:04.339032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 640/1293] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:04:04.344630 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d000e37-d5ed-48b3-8371-4b402ec3d1eb None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:04:04.345092 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d000e37-d5ed-48b3-8371-4b402ec3d1eb None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:04:04.345255 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d000e37-d5ed-48b3-8371-4b402ec3d1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:04:04.363661 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-7d000e37-d5ed-48b3-8371-4b402ec3d1eb None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:04:04.364875 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-7d000e37-d5ed-48b3-8371-4b402ec3d1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:04:04.429628 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 654/1294] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:04:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:04:04.452536 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912597a-da33-4867-bb20-7487e39a42e0 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:04:04.549959 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912597a-da33-4867-bb20-7487e39a42e0 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:04:04.586050 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b1e12-8be0-47b8-b35b-eebd9d84a928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:04:04.586761 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b1e12-8be0-47b8-b35b-eebd9d84a928 None admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:04:04.587002 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b1e12-8be0-47b8-b35b-eebd9d84a928 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:04:04.587278 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b1e12-8be0-47b8-b35b-eebd9d84a928 None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:04:04.588007 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b1e12-8be0-47b8-b35b-eebd9d84a928 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:04:04.589413 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b1e12-8be0-47b8-b35b-eebd9d84a928 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:04:04.669165 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 641/1295] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 13:04:04 2022] POST /identity/v3/services => generated 246 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:04:06.945274 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660775e-c8cb-4b95-9d7c-c7ff8389b126 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:04:06.945822 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660775e-c8cb-4b95-9d7c-c7ff8389b126 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:04:06.945822 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660775e-c8cb-4b95-9d7c-c7ff8389b126 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:04:06.947655 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 655/1296] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:04:06.953458 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f0fc5-d2ed-4456-8e4d-7475f639c6e1 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:04:06.958750 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f0fc5-d2ed-4456-8e4d-7475f639c6e1 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:04:06.958750 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f0fc5-d2ed-4456-8e4d-7475f639c6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:04:06.970907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-d40f0fc5-d2ed-4456-8e4d-7475f639c6e1 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:04:06.972071 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-d40f0fc5-d2ed-4456-8e4d-7475f639c6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:04:07.040490 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 642/1297] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:04:06 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:04:07.063083 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660775e-c8cb-4b95-9d7c-c7ff8389b126 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:04:07.162236 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660775e-c8cb-4b95-9d7c-c7ff8389b126 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:04:07.194753 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfcec7-15fd-4e5d-9639-ed8435774908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:04:07.195591 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfcec7-15fd-4e5d-9639-ed8435774908 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:04:07.195822 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfcec7-15fd-4e5d-9639-ed8435774908 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:04:07.196091 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfcec7-15fd-4e5d-9639-ed8435774908 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:04:07.196756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfcec7-15fd-4e5d-9639-ed8435774908 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:04:07.198160 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfcec7-15fd-4e5d-9639-ed8435774908 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:04:07.209355 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-76dfcec7-15fd-4e5d-9639-ed8435774908 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 08 13:04:07.210545 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 656/1298] 10.222.0.52 () {56 vars in 1117 bytes} [Tue Mar 8 13:04:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:04:07.216682 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f0fc5-d2ed-4456-8e4d-7475f639c6e1 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:04:07.310417 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f0fc5-d2ed-4456-8e4d-7475f639c6e1 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:04:07.343294 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d367a85-88df-471b-a4b1-b0772d2a277b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:04:07.343952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d367a85-88df-471b-a4b1-b0772d2a277b None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:04:07.344236 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d367a85-88df-471b-a4b1-b0772d2a277b None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:04:07.344512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d367a85-88df-471b-a4b1-b0772d2a277b None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:04:07.345248 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d367a85-88df-471b-a4b1-b0772d2a277b None admin] RBAC: Adding query filter params (name=placement) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:04:07.345559 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d367a85-88df-471b-a4b1-b0772d2a277b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:04:07.346973 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d367a85-88df-471b-a4b1-b0772d2a277b None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:04:07.351999 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 643/1299] 10.222.0.52 () {56 vars in 1116 bytes} [Tue Mar 8 13:04:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:04:07.358053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfcec7-15fd-4e5d-9639-ed8435774908 None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:04:07.458901 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfcec7-15fd-4e5d-9639-ed8435774908 None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:04:07.490286 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc5daa-c2da-4040-8448-e6c25bdc3200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:04:07.490930 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc5daa-c2da-4040-8448-e6c25bdc3200 None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:04:07.491205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc5daa-c2da-4040-8448-e6c25bdc3200 None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:04:07.491474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc5daa-c2da-4040-8448-e6c25bdc3200 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:04:07.492242 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc5daa-c2da-4040-8448-e6c25bdc3200 None admin] RBAC: Adding query filter params (interface=public, service_id=861cd2e2f049413b910c83e6b3c06a6c, region_id=RegionOne) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:04:07.492551 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc5daa-c2da-4040-8448-e6c25bdc3200 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:04:07.493937 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc5daa-c2da-4040-8448-e6c25bdc3200 None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:04:07.498689 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 657/1300] 10.222.0.52 () {56 vars in 1251 bytes} [Tue Mar 8 13:04:07 2022] GET /identity/v3/endpoints?service_id=861cd2e2f049413b910c83e6b3c06a6c&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:04:07.505256 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d367a85-88df-471b-a4b1-b0772d2a277b None admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:04:07.598960 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d367a85-88df-471b-a4b1-b0772d2a277b None admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:04:07.631169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e9cb1-c5a4-4557-bcaa-610b2b7158d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:04:07.631813 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e9cb1-c5a4-4557-bcaa-610b2b7158d0 None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:04:07.632095 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e9cb1-c5a4-4557-bcaa-610b2b7158d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:04:07.632368 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e9cb1-c5a4-4557-bcaa-610b2b7158d0 None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:04:07.633080 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e9cb1-c5a4-4557-bcaa-610b2b7158d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:04:07.634471 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e9cb1-c5a4-4557-bcaa-610b2b7158d0 None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:04:07.641243 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 644/1301] 10.222.0.52 () {56 vars in 1087 bytes} [Tue Mar 8 13:04:07 2022] GET /identity/v3/services => generated 2191 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:04:09.925922 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddc9f5-c1ca-4400-b3af-a4ab71146050 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:04:09.926597 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddc9f5-c1ca-4400-b3af-a4ab71146050 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:04:09.926597 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddc9f5-c1ca-4400-b3af-a4ab71146050 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:04:09.928365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 658/1302] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:04:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:04:09.933567 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e75de1-3241-4b81-ba55-f93a4a10598c None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:04:09.933949 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e75de1-3241-4b81-ba55-f93a4a10598c None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:04:09.934145 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e75de1-3241-4b81-ba55-f93a4a10598c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:04:09.950634 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-a5e75de1-3241-4b81-ba55-f93a4a10598c None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:04:09.951802 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-a5e75de1-3241-4b81-ba55-f93a4a10598c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:04:10.014691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 645/1303] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:04:09 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:04:10.046389 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddc9f5-c1ca-4400-b3af-a4ab71146050 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:04:10.144976 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddc9f5-c1ca-4400-b3af-a4ab71146050 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:04:10.177409 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27571d-3505-4c6d-aab8-19221375b97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:04:10.178139 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27571d-3505-4c6d-aab8-19221375b97e None admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:04:10.178427 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27571d-3505-4c6d-aab8-19221375b97e None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:04:10.178704 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27571d-3505-4c6d-aab8-19221375b97e None admin] PATH_INFO: `/v3/services/placement` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:04:10.179346 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27571d-3505-4c6d-aab8-19221375b97e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:04:10.180737 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27571d-3505-4c6d-aab8-19221375b97e None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:04:10.192220 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING keystone.server.flask.application [None req-7a27571d-3505-4c6d-aab8-19221375b97e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 08 13:04:10.193387 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 659/1304] 10.222.0.52 () {56 vars in 1117 bytes} [Tue Mar 8 13:04:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:04:10.199860 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e75de1-3241-4b81-ba55-f93a4a10598c None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:04:10.293599 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e75de1-3241-4b81-ba55-f93a4a10598c None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:04:10.331141 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e853f-1582-4b91-a265-46cefe94ea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:04:10.335119 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e853f-1582-4b91-a265-46cefe94ea9b None admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:04:10.335404 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e853f-1582-4b91-a265-46cefe94ea9b None admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:04:10.335755 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e853f-1582-4b91-a265-46cefe94ea9b None admin] PATH_INFO: `/v3/services` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:04:10.337307 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e853f-1582-4b91-a265-46cefe94ea9b None admin] RBAC: Adding query filter params (name=placement) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:04:10.337617 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e853f-1582-4b91-a265-46cefe94ea9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:04:10.339004 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e853f-1582-4b91-a265-46cefe94ea9b None admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:04:10.345792 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 646/1305] 10.222.0.52 () {56 vars in 1116 bytes} [Tue Mar 8 13:04:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:04:10.350762 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27571d-3505-4c6d-aab8-19221375b97e None admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:04:10.446283 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27571d-3505-4c6d-aab8-19221375b97e None admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:04:10.478372 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2df64-330e-4f55-8962-d957f29e65ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:04:10.481297 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2df64-330e-4f55-8962-d957f29e65ef None admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:04:10.481297 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2df64-330e-4f55-8962-d957f29e65ef None admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:04:10.481297 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2df64-330e-4f55-8962-d957f29e65ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:04:10.481297 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2df64-330e-4f55-8962-d957f29e65ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:04:10.481667 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2df64-330e-4f55-8962-d957f29e65ef None admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:04:10.570107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 660/1306] 10.222.0.52 () {60 vars in 1144 bytes} [Tue Mar 8 13:04:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:10:20.095040 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3d2fe-2816-45c9-92de-979b9b2d5100 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:20.095517 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3d2fe-2816-45c9-92de-979b9b2d5100 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:20.095597 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3d2fe-2816-45c9-92de-979b9b2d5100 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:20.097413 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 647/1307] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:10:20.105610 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404eebc1-37c7-431f-91e0-78fb504d993f None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:20.107330 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404eebc1-37c7-431f-91e0-78fb504d993f None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:20.108037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404eebc1-37c7-431f-91e0-78fb504d993f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:20.215558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-404eebc1-37c7-431f-91e0-78fb504d993f None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:10:20.217216 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-404eebc1-37c7-431f-91e0-78fb504d993f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:20.374722 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 661/1308] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:10:20.399072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3d2fe-2816-45c9-92de-979b9b2d5100 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:10:20.403648 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-46d3d2fe-2816-45c9-92de-979b9b2d5100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:20.555513 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3d2fe-2816-45c9-92de-979b9b2d5100 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:10:20.651768 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18566409-d843-48a9-987e-bb367dc220cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:10:20.652693 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18566409-d843-48a9-987e-bb367dc220cf admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:20.653647 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18566409-d843-48a9-987e-bb367dc220cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:20.654126 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18566409-d843-48a9-987e-bb367dc220cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:20.654924 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18566409-d843-48a9-987e-bb367dc220cf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:10:20.656732 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING py.warnings [None req-18566409-d843-48a9-987e-bb367dc220cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:10:20.656732 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: warnings.warn(msg) Mar 08 13:10:20.656732 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: Mar 08 13:10:20.658021 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18566409-d843-48a9-987e-bb367dc220cf admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:10:20.677350 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 648/1309] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:10:20 2022] GET /identity/v3/projects => generated 2553 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:10:23.044185 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b493061-39ea-4803-8a6c-3060b30bc2e3 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:23.044769 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b493061-39ea-4803-8a6c-3060b30bc2e3 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:23.045039 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b493061-39ea-4803-8a6c-3060b30bc2e3 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:23.046852 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 662/1310] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:10:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:10:23.052232 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d09d7-f753-4a19-8495-d0a3e6ba180d None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:23.052685 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d09d7-f753-4a19-8495-d0a3e6ba180d None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:23.052826 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d09d7-f753-4a19-8495-d0a3e6ba180d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:23.121915 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-771d09d7-f753-4a19-8495-d0a3e6ba180d None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:10:23.123179 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-771d09d7-f753-4a19-8495-d0a3e6ba180d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:23.217810 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 649/1311] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:10:23.269545 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecff4dd-3514-4e0d-b63f-8e61ceb78ba7 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:23.269831 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecff4dd-3514-4e0d-b63f-8e61ceb78ba7 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:23.270111 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecff4dd-3514-4e0d-b63f-8e61ceb78ba7 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:23.272064 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 663/1312] 10.222.0.52 () {54 vars in 964 bytes} [Tue Mar 8 13:10:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:10:23.278353 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf7001-e299-4e80-84bd-d94902a099ca None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:23.278680 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf7001-e299-4e80-84bd-d94902a099ca None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:23.278897 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf7001-e299-4e80-84bd-d94902a099ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:23.361343 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-5ecf7001-e299-4e80-84bd-d94902a099ca None None] MFA Rules not processed for user `22bf06400d8f47f4bb3badd7f65bc205`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:10:23.362586 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-5ecf7001-e299-4e80-84bd-d94902a099ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:23.444856 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 650/1313] 10.222.0.52 () {58 vars in 1061 bytes} [Tue Mar 8 13:10:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:10:23.454133 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecff4dd-3514-4e0d-b63f-8e61ceb78ba7 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:10:23.455754 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-8ecff4dd-3514-4e0d-b63f-8e61ceb78ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:23.581962 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecff4dd-3514-4e0d-b63f-8e61ceb78ba7 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:10:23.664602 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88e245-ee74-4386-a46b-5ab0906f8b48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:10:23.666030 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88e245-ee74-4386-a46b-5ab0906f8b48 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:23.666347 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88e245-ee74-4386-a46b-5ab0906f8b48 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:23.666631 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88e245-ee74-4386-a46b-5ab0906f8b48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:23.668512 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-ec88e245-ee74-4386-a46b-5ab0906f8b48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:23.797671 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88e245-ee74-4386-a46b-5ab0906f8b48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:10:23.799086 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88e245-ee74-4386-a46b-5ab0906f8b48 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:10:23.819946 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 664/1314] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:10:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:10:26.488335 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd796a1-0075-44d2-9915-fcaefa4f39e5 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:26.488892 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd796a1-0075-44d2-9915-fcaefa4f39e5 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:26.488892 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd796a1-0075-44d2-9915-fcaefa4f39e5 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:26.490685 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 651/1315] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:10:26.495791 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f23257-15dc-4791-8566-57c0b2d0a076 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:26.496159 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f23257-15dc-4791-8566-57c0b2d0a076 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:26.496363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f23257-15dc-4791-8566-57c0b2d0a076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:26.563550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-47f23257-15dc-4791-8566-57c0b2d0a076 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:10:26.564775 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-47f23257-15dc-4791-8566-57c0b2d0a076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:26.657410 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 665/1316] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:10:26.712016 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad9514-6fef-4eea-b8f6-e479b765a363 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:26.712297 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad9514-6fef-4eea-b8f6-e479b765a363 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:26.712573 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad9514-6fef-4eea-b8f6-e479b765a363 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:26.714390 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 652/1317] 10.222.0.52 () {54 vars in 964 bytes} [Tue Mar 8 13:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:10:26.720896 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870866c-d639-49bd-b644-3e9163abc6d9 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:26.721186 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870866c-d639-49bd-b644-3e9163abc6d9 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:26.721464 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870866c-d639-49bd-b644-3e9163abc6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:26.795566 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-5870866c-d639-49bd-b644-3e9163abc6d9 None None] MFA Rules not processed for user `22bf06400d8f47f4bb3badd7f65bc205`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:10:26.796798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-5870866c-d639-49bd-b644-3e9163abc6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:26.868791 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 666/1318] 10.222.0.52 () {58 vars in 1061 bytes} [Tue Mar 8 13:10:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:10:26.877614 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad9514-6fef-4eea-b8f6-e479b765a363 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:10:26.879132 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-9bad9514-6fef-4eea-b8f6-e479b765a363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:26.982623 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad9514-6fef-4eea-b8f6-e479b765a363 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:10:27.053711 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f600f-d044-41c3-bf30-fad539edb899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:10:27.054346 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f600f-d044-41c3-bf30-fad539edb899 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:27.054622 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f600f-d044-41c3-bf30-fad539edb899 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:27.054893 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f600f-d044-41c3-bf30-fad539edb899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:27.056805 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-444f600f-d044-41c3-bf30-fad539edb899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:27.161731 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f600f-d044-41c3-bf30-fad539edb899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:10:27.163376 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f600f-d044-41c3-bf30-fad539edb899 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:10:27.181240 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 653/1319] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:10:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:10:30.259206 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3b82b-2217-41c9-8281-7aa1c7844993 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:30.259810 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3b82b-2217-41c9-8281-7aa1c7844993 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:30.259810 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3b82b-2217-41c9-8281-7aa1c7844993 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:30.261564 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 667/1320] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:10:30.267629 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdec17-07d9-4fb0-9d10-258ebc6f13c1 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:30.268052 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdec17-07d9-4fb0-9d10-258ebc6f13c1 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:30.268189 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdec17-07d9-4fb0-9d10-258ebc6f13c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:30.332187 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-08fdec17-07d9-4fb0-9d10-258ebc6f13c1 None None] MFA Rules not processed for user `be52c2e382db45d0af34429705c6405e`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:10:30.333434 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-08fdec17-07d9-4fb0-9d10-258ebc6f13c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:30.425274 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 654/1321] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:10:30 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:10:30.467798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3b82b-2217-41c9-8281-7aa1c7844993 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:10:30.469409 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-eff3b82b-2217-41c9-8281-7aa1c7844993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:30.569989 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3b82b-2217-41c9-8281-7aa1c7844993 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:10:30.641332 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db22898-de83-41dd-8718-782879bf9533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:10:30.641980 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db22898-de83-41dd-8718-782879bf9533 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:30.642423 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db22898-de83-41dd-8718-782879bf9533 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:30.642700 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db22898-de83-41dd-8718-782879bf9533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:30.645295 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-4db22898-de83-41dd-8718-782879bf9533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:30.761373 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db22898-de83-41dd-8718-782879bf9533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:10:30.763344 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db22898-de83-41dd-8718-782879bf9533 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:10:30.781041 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 668/1322] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:10:30 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:10:33.908870 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fccd0-dd64-4b71-812c-13d0e4b9d89b None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:33.909396 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fccd0-dd64-4b71-812c-13d0e4b9d89b None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:33.909516 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fccd0-dd64-4b71-812c-13d0e4b9d89b None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:33.911252 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 655/1323] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:10:33.916774 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5873667-865a-4f12-9990-ec858eb1b97e None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:33.917203 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5873667-865a-4f12-9990-ec858eb1b97e None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:33.917338 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5873667-865a-4f12-9990-ec858eb1b97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:33.980014 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-c5873667-865a-4f12-9990-ec858eb1b97e None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:10:33.981281 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-c5873667-865a-4f12-9990-ec858eb1b97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:34.075039 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 669/1324] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:10:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:10:34.114941 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fccd0-dd64-4b71-812c-13d0e4b9d89b None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:10:34.116465 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-526fccd0-dd64-4b71-812c-13d0e4b9d89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:34.214760 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fccd0-dd64-4b71-812c-13d0e4b9d89b None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:10:34.284205 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be321b0b-b3d5-4716-95ae-3ff74db9342d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:10:34.284860 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be321b0b-b3d5-4716-95ae-3ff74db9342d service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:34.285145 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be321b0b-b3d5-4716-95ae-3ff74db9342d service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:34.285416 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be321b0b-b3d5-4716-95ae-3ff74db9342d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:34.287022 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-be321b0b-b3d5-4716-95ae-3ff74db9342d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:34.393933 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be321b0b-b3d5-4716-95ae-3ff74db9342d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:10:34.395378 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be321b0b-b3d5-4716-95ae-3ff74db9342d service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:10:34.412699 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 656/1325] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:10:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:10:37.806229 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da02d0-1e97-4560-9b55-17fa6d671f8d None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:37.806786 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da02d0-1e97-4560-9b55-17fa6d671f8d None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:37.806786 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da02d0-1e97-4560-9b55-17fa6d671f8d None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:37.813036 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 670/1326] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:10:37.814670 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc37969-0030-4dc4-abdb-9b0d007e6fc9 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:37.815105 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc37969-0030-4dc4-abdb-9b0d007e6fc9 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:37.815209 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc37969-0030-4dc4-abdb-9b0d007e6fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:37.880266 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-8cc37969-0030-4dc4-abdb-9b0d007e6fc9 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:10:37.881501 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-8cc37969-0030-4dc4-abdb-9b0d007e6fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:37.973833 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 657/1327] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:10:38.012009 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da02d0-1e97-4560-9b55-17fa6d671f8d None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:10:38.013646 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-99da02d0-1e97-4560-9b55-17fa6d671f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:38.116315 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da02d0-1e97-4560-9b55-17fa6d671f8d None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:10:38.188771 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095208a3-025a-4144-9832-99f572fef048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:10:38.189422 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095208a3-025a-4144-9832-99f572fef048 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:38.189703 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095208a3-025a-4144-9832-99f572fef048 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:38.189976 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095208a3-025a-4144-9832-99f572fef048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:38.191604 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-095208a3-025a-4144-9832-99f572fef048 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:38.300597 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095208a3-025a-4144-9832-99f572fef048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:10:38.302088 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095208a3-025a-4144-9832-99f572fef048 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:10:38.321132 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 671/1328] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:10:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:10:40.689423 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7ab75-61af-42ab-b9b6-e6ab9535371a None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:40.689949 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7ab75-61af-42ab-b9b6-e6ab9535371a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:40.690057 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7ab75-61af-42ab-b9b6-e6ab9535371a None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:40.693001 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 658/1329] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:10:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:10:40.698225 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e6afe-0d78-443a-86f0-b899f742d245 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:40.698753 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e6afe-0d78-443a-86f0-b899f742d245 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:40.698893 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e6afe-0d78-443a-86f0-b899f742d245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:40.763410 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-8b9e6afe-0d78-443a-86f0-b899f742d245 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:10:40.764601 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-8b9e6afe-0d78-443a-86f0-b899f742d245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:40.859388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 672/1330] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:10:40.894959 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7ab75-61af-42ab-b9b6-e6ab9535371a None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:10:40.896575 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-80d7ab75-61af-42ab-b9b6-e6ab9535371a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:40.997860 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7ab75-61af-42ab-b9b6-e6ab9535371a None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:10:41.069807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856b9b2-7b57-4349-879f-5bec5ad43d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:10:41.070470 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856b9b2-7b57-4349-879f-5bec5ad43d7e service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:41.070751 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856b9b2-7b57-4349-879f-5bec5ad43d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:41.071026 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856b9b2-7b57-4349-879f-5bec5ad43d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:41.072691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-3856b9b2-7b57-4349-879f-5bec5ad43d7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:41.177584 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856b9b2-7b57-4349-879f-5bec5ad43d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:10:41.179116 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856b9b2-7b57-4349-879f-5bec5ad43d7e service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:10:41.197737 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 659/1331] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:10:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:10:43.675884 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa42838-7649-44aa-a3b2-7659ed93a240 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:43.676406 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa42838-7649-44aa-a3b2-7659ed93a240 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:43.676554 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa42838-7649-44aa-a3b2-7659ed93a240 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:43.678430 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 673/1332] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:10:43.684435 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5629e-1386-4c42-a391-5d152b3dbdf7 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:43.684897 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5629e-1386-4c42-a391-5d152b3dbdf7 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:43.685048 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5629e-1386-4c42-a391-5d152b3dbdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:43.754235 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-f0e5629e-1386-4c42-a391-5d152b3dbdf7 None None] MFA Rules not processed for user `be52c2e382db45d0af34429705c6405e`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:10:43.755526 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f0e5629e-1386-4c42-a391-5d152b3dbdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:43.852319 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 660/1333] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:10:43 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:10:43.891219 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa42838-7649-44aa-a3b2-7659ed93a240 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:10:43.892853 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-7aa42838-7649-44aa-a3b2-7659ed93a240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:43.993129 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa42838-7649-44aa-a3b2-7659ed93a240 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:10:44.069997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9cf459-0c5e-4d59-9701-1e78bd8baa28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:10:44.070701 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cf459-0c5e-4d59-9701-1e78bd8baa28 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:44.070982 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cf459-0c5e-4d59-9701-1e78bd8baa28 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:44.071253 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cf459-0c5e-4d59-9701-1e78bd8baa28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:44.072931 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-6e9cf459-0c5e-4d59-9701-1e78bd8baa28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:44.178244 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9cf459-0c5e-4d59-9701-1e78bd8baa28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:10:44.179711 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9cf459-0c5e-4d59-9701-1e78bd8baa28 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:10:44.197581 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 674/1334] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:10:43 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:10:47.063617 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262e066-94f9-4098-b6a2-d69255c20921 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:47.064182 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262e066-94f9-4098-b6a2-d69255c20921 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:47.064182 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262e066-94f9-4098-b6a2-d69255c20921 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:47.065971 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 661/1335] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:10:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:10:47.071343 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2877a-ab46-4b61-aaf1-8ee6dd706fd9 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:47.071754 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2877a-ab46-4b61-aaf1-8ee6dd706fd9 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:47.071896 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2877a-ab46-4b61-aaf1-8ee6dd706fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:47.145353 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-ddb2877a-ab46-4b61-aaf1-8ee6dd706fd9 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:10:47.149743 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-ddb2877a-ab46-4b61-aaf1-8ee6dd706fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:47.246931 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 675/1336] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:10:47.287486 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262e066-94f9-4098-b6a2-d69255c20921 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:10:47.289061 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b262e066-94f9-4098-b6a2-d69255c20921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:47.396197 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262e066-94f9-4098-b6a2-d69255c20921 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:10:47.466978 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5e4bc-0026-4abf-94d9-c8a34da814ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:10:47.467656 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5e4bc-0026-4abf-94d9-c8a34da814ae service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:47.467935 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5e4bc-0026-4abf-94d9-c8a34da814ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:47.468204 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5e4bc-0026-4abf-94d9-c8a34da814ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:47.469889 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-98e5e4bc-0026-4abf-94d9-c8a34da814ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:47.574239 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5e4bc-0026-4abf-94d9-c8a34da814ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:10:47.575800 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5e4bc-0026-4abf-94d9-c8a34da814ae service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:10:47.593304 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 662/1337] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:10:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:10:49.958673 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05684bb0-7d7b-4224-87e9-b1adbd41fc6a None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:49.959220 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05684bb0-7d7b-4224-87e9-b1adbd41fc6a None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:49.959220 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05684bb0-7d7b-4224-87e9-b1adbd41fc6a None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:49.961023 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 676/1338] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:10:49.966648 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faddce2-cecc-49df-ac9a-717d620b03c0 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:49.967029 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faddce2-cecc-49df-ac9a-717d620b03c0 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:49.967202 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faddce2-cecc-49df-ac9a-717d620b03c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:50.031084 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-0faddce2-cecc-49df-ac9a-717d620b03c0 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:10:50.032289 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-0faddce2-cecc-49df-ac9a-717d620b03c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:50.129534 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 663/1339] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:10:50.170869 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05684bb0-7d7b-4224-87e9-b1adbd41fc6a None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:10:50.173876 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-05684bb0-7d7b-4224-87e9-b1adbd41fc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:50.282469 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05684bb0-7d7b-4224-87e9-b1adbd41fc6a None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:10:50.295223 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72f651-3783-4b88-ba26-e1c75c296e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:10:50.295978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72f651-3783-4b88-ba26-e1c75c296e6b service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:50.296260 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72f651-3783-4b88-ba26-e1c75c296e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:50.296532 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72f651-3783-4b88-ba26-e1c75c296e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:50.298173 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-ce72f651-3783-4b88-ba26-e1c75c296e6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:50.399882 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72f651-3783-4b88-ba26-e1c75c296e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:10:50.401935 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72f651-3783-4b88-ba26-e1c75c296e6b service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:10:50.422250 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 677/1340] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:10:53.520636 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc39fb-a4e5-4d4b-af1f-44029e639054 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:53.521186 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc39fb-a4e5-4d4b-af1f-44029e639054 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:53.521281 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc39fb-a4e5-4d4b-af1f-44029e639054 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:53.523010 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 664/1341] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:10:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:10:53.528422 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d6d3d-9988-445b-ae3c-4067ae489541 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:53.528903 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d6d3d-9988-445b-ae3c-4067ae489541 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:53.529000 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d6d3d-9988-445b-ae3c-4067ae489541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:53.572997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-fb2d6d3d-9988-445b-ae3c-4067ae489541 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:10:53.574868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-fb2d6d3d-9988-445b-ae3c-4067ae489541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:53.658633 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 678/1342] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:10:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:10:53.694217 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc39fb-a4e5-4d4b-af1f-44029e639054 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:10:53.696320 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-efcc39fb-a4e5-4d4b-af1f-44029e639054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:53.719194 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc39fb-a4e5-4d4b-af1f-44029e639054 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:10:53.722695 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca90bd0-199f-44ae-85ee-442e9f1db967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:10:53.723323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca90bd0-199f-44ae-85ee-442e9f1db967 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:53.723604 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca90bd0-199f-44ae-85ee-442e9f1db967 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:53.723877 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca90bd0-199f-44ae-85ee-442e9f1db967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:53.733077 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca90bd0-199f-44ae-85ee-442e9f1db967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:10:53.734498 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca90bd0-199f-44ae-85ee-442e9f1db967 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:10:53.743611 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 665/1343] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:10:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:10:58.645987 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5012c96-0dbd-4671-ab9c-7a912c37b859 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:58.646557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5012c96-0dbd-4671-ab9c-7a912c37b859 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:58.646557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5012c96-0dbd-4671-ab9c-7a912c37b859 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:58.648374 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 679/1344] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:10:58.654665 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af508d-d76d-4f07-95e5-3e31601578d7 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:58.655120 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af508d-d76d-4f07-95e5-3e31601578d7 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:58.655365 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af508d-d76d-4f07-95e5-3e31601578d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:58.687720 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-57af508d-d76d-4f07-95e5-3e31601578d7 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:10:58.688949 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-57af508d-d76d-4f07-95e5-3e31601578d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:10:58.696631 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 666/1345] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:10:58.736358 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5012c96-0dbd-4671-ab9c-7a912c37b859 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:10:58.746865 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5012c96-0dbd-4671-ab9c-7a912c37b859 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:10:58.750597 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4993fa6-4b20-44bc-94a9-6a82dffcf08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:10:58.751643 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4993fa6-4b20-44bc-94a9-6a82dffcf08b service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:10:58.752068 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4993fa6-4b20-44bc-94a9-6a82dffcf08b service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:10:58.752347 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4993fa6-4b20-44bc-94a9-6a82dffcf08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:10:58.762412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4993fa6-4b20-44bc-94a9-6a82dffcf08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:10:58.764037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4993fa6-4b20-44bc-94a9-6a82dffcf08b service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:10:58.781686 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 680/1346] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:11:02.118278 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce1afc-3f56-4639-a54d-14b6086015b4 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:02.118830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce1afc-3f56-4639-a54d-14b6086015b4 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:02.118830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce1afc-3f56-4639-a54d-14b6086015b4 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:02.120774 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 667/1347] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:02.126045 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f99c72-bad0-49cd-adfd-63217f0f2f29 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:02.126459 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f99c72-bad0-49cd-adfd-63217f0f2f29 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:02.126614 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f99c72-bad0-49cd-adfd-63217f0f2f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:02.145513 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-41f99c72-bad0-49cd-adfd-63217f0f2f29 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:02.146689 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-41f99c72-bad0-49cd-adfd-63217f0f2f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:02.154956 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 681/1348] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:11:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:02.191981 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce1afc-3f56-4639-a54d-14b6086015b4 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:11:02.203027 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce1afc-3f56-4639-a54d-14b6086015b4 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:11:02.206526 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a3453-7238-47c7-9fb2-1248aa338083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:11:02.207151 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a3453-7238-47c7-9fb2-1248aa338083 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:02.207430 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a3453-7238-47c7-9fb2-1248aa338083 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:02.207703 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a3453-7238-47c7-9fb2-1248aa338083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:02.217196 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a3453-7238-47c7-9fb2-1248aa338083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:11:02.218916 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a3453-7238-47c7-9fb2-1248aa338083 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:11:02.227792 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 668/1349] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:11:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:11:06.839463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c438444-3931-45fb-9f42-caf9a35aad51 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:06.839977 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c438444-3931-45fb-9f42-caf9a35aad51 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:06.840085 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c438444-3931-45fb-9f42-caf9a35aad51 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:06.842439 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 682/1350] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:11:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:06.847737 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668c572-a3c7-4c1d-b5ce-75158dac4685 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:06.848190 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668c572-a3c7-4c1d-b5ce-75158dac4685 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:06.848362 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668c572-a3c7-4c1d-b5ce-75158dac4685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:06.870461 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-4668c572-a3c7-4c1d-b5ce-75158dac4685 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:06.871883 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-4668c572-a3c7-4c1d-b5ce-75158dac4685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:06.880156 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 669/1351] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:06.918207 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c438444-3931-45fb-9f42-caf9a35aad51 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:11:06.929538 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c438444-3931-45fb-9f42-caf9a35aad51 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:11:06.934185 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03c211-e242-4543-893c-eec6cbdd05f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:11:06.934818 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03c211-e242-4543-893c-eec6cbdd05f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:06.935104 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03c211-e242-4543-893c-eec6cbdd05f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:06.935384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03c211-e242-4543-893c-eec6cbdd05f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:06.944758 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03c211-e242-4543-893c-eec6cbdd05f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:11:06.946192 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03c211-e242-4543-893c-eec6cbdd05f7 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:11:06.956024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 683/1352] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:11:12.255381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bea0ed-4f5f-49a9-8e42-17a1d4ad2b3b None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:12.261392 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bea0ed-4f5f-49a9-8e42-17a1d4ad2b3b None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:12.281363 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bea0ed-4f5f-49a9-8e42-17a1d4ad2b3b None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:12.283103 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 670/1353] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 13:11:12 2022] GET /identity => generated 270 bytes in 29 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:12.288954 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f35212-7a3b-435b-ad38-16f58166679d None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:12.289864 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f35212-7a3b-435b-ad38-16f58166679d None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:12.290343 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f35212-7a3b-435b-ad38-16f58166679d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:12.424738 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-61f35212-7a3b-435b-ad38-16f58166679d None None] MFA Rules not processed for user `9b917ce4f7f34b289218f7d36a43983e`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:12.428927 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-61f35212-7a3b-435b-ad38-16f58166679d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:12.590827 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 684/1354] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 13:11:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:17.040898 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94fb06-820c-4cb4-a382-1d567728db7b None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:17.041817 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94fb06-820c-4cb4-a382-1d567728db7b None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:17.042114 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94fb06-820c-4cb4-a382-1d567728db7b None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:17.044104 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 671/1355] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 13:11:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:17.049240 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657330d-0bdb-4f04-a938-9e6b74bfe6b0 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:17.049683 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657330d-0bdb-4f04-a938-9e6b74bfe6b0 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:17.049784 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657330d-0bdb-4f04-a938-9e6b74bfe6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:17.068294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-a657330d-0bdb-4f04-a938-9e6b74bfe6b0 None None] MFA Rules not processed for user `9b917ce4f7f34b289218f7d36a43983e`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:17.069580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a657330d-0bdb-4f04-a938-9e6b74bfe6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:17.078727 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 685/1356] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 13:11:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:18.510868 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a419100-2162-4c70-b951-f74ad3d70df7 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:18.511397 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a419100-2162-4c70-b951-f74ad3d70df7 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:18.511525 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a419100-2162-4c70-b951-f74ad3d70df7 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:18.513293 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 672/1357] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 13:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:18.518416 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cc2c1-0c6e-4663-a102-266ae655da0f None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:18.518841 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cc2c1-0c6e-4663-a102-266ae655da0f None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:18.518968 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cc2c1-0c6e-4663-a102-266ae655da0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:18.537007 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-f30cc2c1-0c6e-4663-a102-266ae655da0f None None] MFA Rules not processed for user `9b917ce4f7f34b289218f7d36a43983e`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:18.538181 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f30cc2c1-0c6e-4663-a102-266ae655da0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:18.547104 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 686/1358] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 13:11:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:11:22.528367 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6910b-ab91-4f83-8624-a5439206790a None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:22.528922 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6910b-ab91-4f83-8624-a5439206790a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:22.529003 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6910b-ab91-4f83-8624-a5439206790a None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:22.530951 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 673/1359] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:22.536010 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0b952-2c53-46ed-b0a2-22efa34933fe None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:22.536394 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0b952-2c53-46ed-b0a2-22efa34933fe None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:22.536563 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0b952-2c53-46ed-b0a2-22efa34933fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:22.554130 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-c9f0b952-2c53-46ed-b0a2-22efa34933fe None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:22.555402 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-c9f0b952-2c53-46ed-b0a2-22efa34933fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:22.563598 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 687/1360] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:22.612233 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037ca58-c36f-4a46-a5ec-8bf1223a4689 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:22.612513 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037ca58-c36f-4a46-a5ec-8bf1223a4689 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:22.612809 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037ca58-c36f-4a46-a5ec-8bf1223a4689 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:22.615015 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 674/1361] 10.222.0.52 () {54 vars in 961 bytes} [Tue Mar 8 13:11:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:22.621697 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48107b24-0642-42ff-bdb7-285114cc65e3 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:22.621985 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48107b24-0642-42ff-bdb7-285114cc65e3 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:22.622272 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48107b24-0642-42ff-bdb7-285114cc65e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:22.682213 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-48107b24-0642-42ff-bdb7-285114cc65e3 None None] MFA Rules not processed for user `72d4ac44d04943a5b24c7a1d6a31b7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:22.683383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-48107b24-0642-42ff-bdb7-285114cc65e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:22.762129 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 688/1362] 10.222.0.52 () {58 vars in 1058 bytes} [Tue Mar 8 13:11:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:22.770291 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037ca58-c36f-4a46-a5ec-8bf1223a4689 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:11:22.788195 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037ca58-c36f-4a46-a5ec-8bf1223a4689 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:11:22.790640 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80a5aa-6050-4973-8e05-c2dde7a8e7e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:11:22.791349 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80a5aa-6050-4973-8e05-c2dde7a8e7e2 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:22.791628 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80a5aa-6050-4973-8e05-c2dde7a8e7e2 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:22.791901 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80a5aa-6050-4973-8e05-c2dde7a8e7e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:22.800377 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80a5aa-6050-4973-8e05-c2dde7a8e7e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:11:22.802023 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80a5aa-6050-4973-8e05-c2dde7a8e7e2 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:11:22.812748 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 675/1363] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:11:25.366242 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6175-5fde-47e7-86a5-a82e2d4daac3 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:25.366774 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6175-5fde-47e7-86a5-a82e2d4daac3 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:25.366868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6175-5fde-47e7-86a5-a82e2d4daac3 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:25.368623 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 689/1364] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:25.374094 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0f036-2692-4412-9d5f-0e8297557413 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:25.374863 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0f036-2692-4412-9d5f-0e8297557413 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:25.375319 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0f036-2692-4412-9d5f-0e8297557413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:25.394888 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-86a0f036-2692-4412-9d5f-0e8297557413 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:25.396081 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-86a0f036-2692-4412-9d5f-0e8297557413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:25.404775 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 676/1365] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:25.449886 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f6175-5fde-47e7-86a5-a82e2d4daac3 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:11:25.464804 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f6175-5fde-47e7-86a5-a82e2d4daac3 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:11:25.470365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d0585-e70b-4040-8992-35ea336cb239 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:11:25.471006 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d0585-e70b-4040-8992-35ea336cb239 service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:25.471287 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d0585-e70b-4040-8992-35ea336cb239 service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:25.471751 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d0585-e70b-4040-8992-35ea336cb239 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:25.480642 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d0585-e70b-4040-8992-35ea336cb239 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:11:25.482293 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d0585-e70b-4040-8992-35ea336cb239 service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:11:25.492744 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 690/1366] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:11:28.280170 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645523e-fb03-45e6-b38a-947041d1ac20 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:28.280713 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645523e-fb03-45e6-b38a-947041d1ac20 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:28.280842 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645523e-fb03-45e6-b38a-947041d1ac20 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:28.282537 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 677/1367] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:28.287714 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62818489-47f8-480d-a058-7524ed542396 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:28.288121 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62818489-47f8-480d-a058-7524ed542396 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:28.288263 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62818489-47f8-480d-a058-7524ed542396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:28.307560 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-62818489-47f8-480d-a058-7524ed542396 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:28.308825 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-62818489-47f8-480d-a058-7524ed542396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:28.317180 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 691/1368] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:28.362654 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811be9a8-1629-43ae-82bb-4806185cc201 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:28.362957 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811be9a8-1629-43ae-82bb-4806185cc201 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:28.363217 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811be9a8-1629-43ae-82bb-4806185cc201 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:28.365023 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 678/1369] 10.222.0.52 () {54 vars in 961 bytes} [Tue Mar 8 13:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:28.371002 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3564ec-460d-428a-8749-c3ff117cb821 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:28.371315 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3564ec-460d-428a-8749-c3ff117cb821 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:28.371590 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3564ec-460d-428a-8749-c3ff117cb821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:28.395556 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-0a3564ec-460d-428a-8749-c3ff117cb821 None None] MFA Rules not processed for user `72d4ac44d04943a5b24c7a1d6a31b7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:28.396831 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0a3564ec-460d-428a-8749-c3ff117cb821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:28.406315 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 692/1370] 10.222.0.52 () {58 vars in 1058 bytes} [Tue Mar 8 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:28.414103 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811be9a8-1629-43ae-82bb-4806185cc201 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:11:28.428212 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811be9a8-1629-43ae-82bb-4806185cc201 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:11:28.434259 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe6e14-7aaf-4dd9-be0d-0c036b326394 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:11:28.434893 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe6e14-7aaf-4dd9-be0d-0c036b326394 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:28.435176 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe6e14-7aaf-4dd9-be0d-0c036b326394 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:28.435455 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe6e14-7aaf-4dd9-be0d-0c036b326394 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:28.444264 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe6e14-7aaf-4dd9-be0d-0c036b326394 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:11:28.446506 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe6e14-7aaf-4dd9-be0d-0c036b326394 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:11:28.460693 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 679/1371] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:11:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:11:30.974819 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d080856-796a-4b1c-8d55-4690fcbb1cab None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:30.975347 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d080856-796a-4b1c-8d55-4690fcbb1cab None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:30.975347 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d080856-796a-4b1c-8d55-4690fcbb1cab None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:30.978037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 693/1372] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:30.983461 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64a457-5fcb-409e-902f-2cfb0935418e None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:30.983878 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64a457-5fcb-409e-902f-2cfb0935418e None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:30.984556 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64a457-5fcb-409e-902f-2cfb0935418e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:31.002262 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-4a64a457-5fcb-409e-902f-2cfb0935418e None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:31.003466 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-4a64a457-5fcb-409e-902f-2cfb0935418e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:31.006775 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb4808-bbe0-4915-8adc-86422c460fd8 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:31.007061 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb4808-bbe0-4915-8adc-86422c460fd8 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:31.007334 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb4808-bbe0-4915-8adc-86422c460fd8 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:31.012699 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 694/1373] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:11:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:11:31.013198 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 680/1374] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:31.015205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e2d72-9948-4115-8232-0721d596db69 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:31.015591 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e2d72-9948-4115-8232-0721d596db69 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:31.015926 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e2d72-9948-4115-8232-0721d596db69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:31.036701 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-594e2d72-9948-4115-8232-0721d596db69 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:31.038004 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-594e2d72-9948-4115-8232-0721d596db69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:31.048332 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 695/1375] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:11:31.060351 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64a457-5fcb-409e-902f-2cfb0935418e None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:11:31.075189 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64a457-5fcb-409e-902f-2cfb0935418e None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:11:31.082230 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0c508-b9ee-4c8f-80ac-32319120073b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:11:31.082910 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0c508-b9ee-4c8f-80ac-32319120073b service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:31.083161 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0c508-b9ee-4c8f-80ac-32319120073b service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:31.083618 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0c508-b9ee-4c8f-80ac-32319120073b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:31.096527 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0c508-b9ee-4c8f-80ac-32319120073b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:11:31.099055 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0c508-b9ee-4c8f-80ac-32319120073b service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:11:31.112695 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 681/1376] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:11:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:11:31.366052 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77d3cb-c1ab-4dd7-a227-6ee20b9b6171 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:31.366338 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77d3cb-c1ab-4dd7-a227-6ee20b9b6171 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:31.366611 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77d3cb-c1ab-4dd7-a227-6ee20b9b6171 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:31.369709 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 696/1377] 10.222.0.52 () {54 vars in 963 bytes} [Tue Mar 8 13:11:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:31.375137 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabf233-665c-4e65-81da-b50a16b3f99a None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:31.375451 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabf233-665c-4e65-81da-b50a16b3f99a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:31.375692 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabf233-665c-4e65-81da-b50a16b3f99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:31.445215 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-fdabf233-665c-4e65-81da-b50a16b3f99a None None] MFA Rules not processed for user `b9a2746615c14162be82dea409930590`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:31.447379 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-fdabf233-665c-4e65-81da-b50a16b3f99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:31.513406 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 682/1378] 10.222.0.52 () {58 vars in 1060 bytes} [Tue Mar 8 13:11:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:31.521167 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77d3cb-c1ab-4dd7-a227-6ee20b9b6171 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:11:31.531913 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77d3cb-c1ab-4dd7-a227-6ee20b9b6171 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:11:31.535467 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e410b68-8754-4ea7-8129-4092117b30a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:11:31.536123 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e410b68-8754-4ea7-8129-4092117b30a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:31.536591 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e410b68-8754-4ea7-8129-4092117b30a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:31.536893 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e410b68-8754-4ea7-8129-4092117b30a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:31.545973 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e410b68-8754-4ea7-8129-4092117b30a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:11:31.547400 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e410b68-8754-4ea7-8129-4092117b30a4 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:11:31.557665 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 697/1379] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:11:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:11:33.673114 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7925c4-82b5-4b12-933d-ce1b7f42b413 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:33.673843 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7925c4-82b5-4b12-933d-ce1b7f42b413 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:33.673843 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7925c4-82b5-4b12-933d-ce1b7f42b413 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:33.676224 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 683/1380] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:11:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:33.683077 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702f100-8b82-4bc6-97f4-9b519eb70eed None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:33.683583 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702f100-8b82-4bc6-97f4-9b519eb70eed None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:33.683677 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702f100-8b82-4bc6-97f4-9b519eb70eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:33.702029 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-6702f100-8b82-4bc6-97f4-9b519eb70eed None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:33.703231 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-6702f100-8b82-4bc6-97f4-9b519eb70eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:33.711176 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 698/1381] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:33.755199 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7925c4-82b5-4b12-933d-ce1b7f42b413 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:11:33.771113 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7925c4-82b5-4b12-933d-ce1b7f42b413 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:11:33.777104 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af4b91-4e2e-4ff9-97b8-6b00b4e01c90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:11:33.777741 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af4b91-4e2e-4ff9-97b8-6b00b4e01c90 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:33.778031 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af4b91-4e2e-4ff9-97b8-6b00b4e01c90 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:33.778309 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af4b91-4e2e-4ff9-97b8-6b00b4e01c90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:33.786596 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af4b91-4e2e-4ff9-97b8-6b00b4e01c90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:11:33.788198 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af4b91-4e2e-4ff9-97b8-6b00b4e01c90 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:11:33.798275 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 684/1382] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:11:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:11:36.325067 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51ad9a-c38d-4b06-8502-0df92046dc87 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:36.325592 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51ad9a-c38d-4b06-8502-0df92046dc87 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:36.325592 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51ad9a-c38d-4b06-8502-0df92046dc87 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:36.327550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 699/1383] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:11:36.332762 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b188e-3901-4422-899e-4c88dfdda781 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:36.333192 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b188e-3901-4422-899e-4c88dfdda781 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:36.333324 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b188e-3901-4422-899e-4c88dfdda781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:36.353451 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-c61b188e-3901-4422-899e-4c88dfdda781 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:36.355043 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c61b188e-3901-4422-899e-4c88dfdda781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:36.376690 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 685/1384] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:36.407630 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51ad9a-c38d-4b06-8502-0df92046dc87 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:11:36.422819 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51ad9a-c38d-4b06-8502-0df92046dc87 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:11:36.428312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c9e5c-7321-47d0-8dac-71e46d233b8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:11:36.429178 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c9e5c-7321-47d0-8dac-71e46d233b8d service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:36.430252 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c9e5c-7321-47d0-8dac-71e46d233b8d service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:36.430715 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c9e5c-7321-47d0-8dac-71e46d233b8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:36.439429 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c9e5c-7321-47d0-8dac-71e46d233b8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:11:36.441293 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c9e5c-7321-47d0-8dac-71e46d233b8d service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:11:36.451524 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 700/1385] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:11:38.953941 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cc382-d1fa-421f-9737-5479c5dc6f6d None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:38.954464 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cc382-d1fa-421f-9737-5479c5dc6f6d None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:38.954464 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cc382-d1fa-421f-9737-5479c5dc6f6d None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:38.956788 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 686/1386] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:38.961858 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25977d56-fdfe-48dc-a746-1520ec979573 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:38.962622 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25977d56-fdfe-48dc-a746-1520ec979573 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:38.963048 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25977d56-fdfe-48dc-a746-1520ec979573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:38.981943 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-25977d56-fdfe-48dc-a746-1520ec979573 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:38.983335 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-25977d56-fdfe-48dc-a746-1520ec979573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:38.991541 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 701/1387] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:39.033934 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cc382-d1fa-421f-9737-5479c5dc6f6d None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:11:39.048373 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cc382-d1fa-421f-9737-5479c5dc6f6d None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:11:39.054033 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cec5f-5194-49a8-98a1-f209a2c1e809 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:11:39.055377 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cec5f-5194-49a8-98a1-f209a2c1e809 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:39.055848 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cec5f-5194-49a8-98a1-f209a2c1e809 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:39.056130 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cec5f-5194-49a8-98a1-f209a2c1e809 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:39.064849 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76cec5f-5194-49a8-98a1-f209a2c1e809 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:11:39.066490 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76cec5f-5194-49a8-98a1-f209a2c1e809 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:11:39.077094 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 687/1388] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:11:41.887473 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73816d73-1211-410e-9480-b7a95228b761 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:41.888383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73816d73-1211-410e-9480-b7a95228b761 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:41.888686 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73816d73-1211-410e-9480-b7a95228b761 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:41.890505 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 702/1389] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:11:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:41.896160 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d631264-63d5-46b9-a77a-c5e2c963724f None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:41.896995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d631264-63d5-46b9-a77a-c5e2c963724f None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:41.896995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d631264-63d5-46b9-a77a-c5e2c963724f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:41.915200 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-3d631264-63d5-46b9-a77a-c5e2c963724f None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:41.916402 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-3d631264-63d5-46b9-a77a-c5e2c963724f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:41.924714 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 688/1390] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:41.999119 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73816d73-1211-410e-9480-b7a95228b761 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:11:42.015055 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73816d73-1211-410e-9480-b7a95228b761 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:11:42.021070 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d2316-bc2c-4b2d-8a86-268e10d41d20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:11:42.021911 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d2316-bc2c-4b2d-8a86-268e10d41d20 service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:42.022263 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d2316-bc2c-4b2d-8a86-268e10d41d20 service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:42.022609 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d2316-bc2c-4b2d-8a86-268e10d41d20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:42.031956 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d2316-bc2c-4b2d-8a86-268e10d41d20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:11:42.033617 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d2316-bc2c-4b2d-8a86-268e10d41d20 service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:11:42.046950 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 703/1391] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:11:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:11:44.633640 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43052e93-5f1a-4c12-b4a3-f57b25c54749 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:44.634329 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43052e93-5f1a-4c12-b4a3-f57b25c54749 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:44.634329 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43052e93-5f1a-4c12-b4a3-f57b25c54749 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:44.635962 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 689/1392] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:44.641702 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa653226-fef4-4ccf-aaad-aa51d3924f0f None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:44.642153 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa653226-fef4-4ccf-aaad-aa51d3924f0f None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:44.642396 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa653226-fef4-4ccf-aaad-aa51d3924f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:44.665022 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-aa653226-fef4-4ccf-aaad-aa51d3924f0f None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:44.666501 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-aa653226-fef4-4ccf-aaad-aa51d3924f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:44.676124 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 704/1393] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:11:44.720741 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43052e93-5f1a-4c12-b4a3-f57b25c54749 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:11:44.734896 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43052e93-5f1a-4c12-b4a3-f57b25c54749 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:11:44.740174 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28d91c-74cf-4103-ac22-82f83ae34fc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:11:44.740839 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28d91c-74cf-4103-ac22-82f83ae34fc0 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:44.741117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28d91c-74cf-4103-ac22-82f83ae34fc0 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:44.741372 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28d91c-74cf-4103-ac22-82f83ae34fc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:44.750214 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28d91c-74cf-4103-ac22-82f83ae34fc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:11:44.751776 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28d91c-74cf-4103-ac22-82f83ae34fc0 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:11:44.762077 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 690/1394] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:11:47.307341 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a879cea-b669-424d-b077-de7570471206 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:47.307928 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a879cea-b669-424d-b077-de7570471206 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:47.307928 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a879cea-b669-424d-b077-de7570471206 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:47.309781 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 705/1395] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:47.315013 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466febe9-d231-4ce2-a633-e8b1391e2f7a None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:47.315441 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466febe9-d231-4ce2-a633-e8b1391e2f7a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:47.315593 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466febe9-d231-4ce2-a633-e8b1391e2f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:47.336965 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-466febe9-d231-4ce2-a633-e8b1391e2f7a None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:47.338139 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-466febe9-d231-4ce2-a633-e8b1391e2f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:47.348748 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 691/1396] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:47.392946 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a879cea-b669-424d-b077-de7570471206 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:11:47.407344 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a879cea-b669-424d-b077-de7570471206 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:11:47.413000 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f02198-f2d2-4d7a-a834-3d2d3cace9c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:11:47.414273 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f02198-f2d2-4d7a-a834-3d2d3cace9c8 service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:47.414561 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f02198-f2d2-4d7a-a834-3d2d3cace9c8 service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:47.414843 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f02198-f2d2-4d7a-a834-3d2d3cace9c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:47.423181 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f02198-f2d2-4d7a-a834-3d2d3cace9c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:11:47.424779 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f02198-f2d2-4d7a-a834-3d2d3cace9c8 service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:11:47.434652 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 706/1397] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:11:48.119894 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3774149-c01d-47a7-a8e6-c09ea74c0b35 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:48.120183 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3774149-c01d-47a7-a8e6-c09ea74c0b35 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:48.120463 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3774149-c01d-47a7-a8e6-c09ea74c0b35 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:48.122321 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 692/1398] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:11:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:48.127586 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4d48f-9e18-4730-b8ff-50a520a542b7 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:48.127877 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4d48f-9e18-4730-b8ff-50a520a542b7 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:48.128157 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4d48f-9e18-4730-b8ff-50a520a542b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:48.147089 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-41d4d48f-9e18-4730-b8ff-50a520a542b7 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:48.148357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-41d4d48f-9e18-4730-b8ff-50a520a542b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:48.156115 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 707/1399] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:48.222796 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa052a0-77f2-4f3b-9fdf-a4b5155d8a3b None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:48.225669 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa052a0-77f2-4f3b-9fdf-a4b5155d8a3b None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:48.225669 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa052a0-77f2-4f3b-9fdf-a4b5155d8a3b None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:48.225669 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 693/1400] 10.222.0.52 () {54 vars in 961 bytes} [Tue Mar 8 13:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:48.230820 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457d2fb-c92d-4bff-9d1d-507528af5998 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:48.231110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457d2fb-c92d-4bff-9d1d-507528af5998 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:48.231387 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457d2fb-c92d-4bff-9d1d-507528af5998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:48.284760 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-3457d2fb-c92d-4bff-9d1d-507528af5998 None None] MFA Rules not processed for user `81124c3324d7427a9f29270b88e88f70`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:48.285960 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-3457d2fb-c92d-4bff-9d1d-507528af5998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:48.352806 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 708/1401] 10.222.0.52 () {58 vars in 1058 bytes} [Tue Mar 8 13:11:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:48.357435 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa052a0-77f2-4f3b-9fdf-a4b5155d8a3b None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:11:48.368886 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa052a0-77f2-4f3b-9fdf-a4b5155d8a3b None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:11:48.372417 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50c429-f6ea-49f5-8a9a-dda545628f5c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81124c3324d7427a9f29270b88e88f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:11:48.373056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50c429-f6ea-49f5-8a9a-dda545628f5c service glance] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:48.373341 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50c429-f6ea-49f5-8a9a-dda545628f5c service glance] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:48.373617 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50c429-f6ea-49f5-8a9a-dda545628f5c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:48.383044 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50c429-f6ea-49f5-8a9a-dda545628f5c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:11:48.385013 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50c429-f6ea-49f5-8a9a-dda545628f5c service glance] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:11:48.394942 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 694/1402] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:11:48.975052 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d97ab-6e82-4e34-8ef1-7d57da03489d None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:48.975388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d97ab-6e82-4e34-8ef1-7d57da03489d None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:48.976175 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d97ab-6e82-4e34-8ef1-7d57da03489d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:49.024395 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-295d97ab-6e82-4e34-8ef1-7d57da03489d None None] MFA Rules not processed for user `556058de7b9f48b8a10188ec64496e72`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:49.025634 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-295d97ab-6e82-4e34-8ef1-7d57da03489d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:49.090375 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 709/1403] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 13:11:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:49.143459 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bbc28-9dea-42a1-b45f-84b0bf6feeb5 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:49.143856 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bbc28-9dea-42a1-b45f-84b0bf6feeb5 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:49.144205 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bbc28-9dea-42a1-b45f-84b0bf6feeb5 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:49.146139 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 695/1404] 10.222.0.52 () {54 vars in 942 bytes} [Tue Mar 8 13:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:49.153072 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bbee5-9ee5-45b5-8c9c-0d6502b15c8c None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:49.153370 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bbee5-9ee5-45b5-8c9c-0d6502b15c8c None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:49.153653 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bbee5-9ee5-45b5-8c9c-0d6502b15c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:49.203750 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-ee8bbee5-9ee5-45b5-8c9c-0d6502b15c8c None None] MFA Rules not processed for user `f375d86747d248fa95f487b073d92d83`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:49.204982 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-ee8bbee5-9ee5-45b5-8c9c-0d6502b15c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:49.278493 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 710/1405] 10.222.0.52 () {58 vars in 1039 bytes} [Tue Mar 8 13:11:49 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:49.287803 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bbc28-9dea-42a1-b45f-84b0bf6feeb5 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:11:49.302180 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bbc28-9dea-42a1-b45f-84b0bf6feeb5 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:11:49.307555 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0d68e-c129-4a18-b396-7f76e9f2a8af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f375d86747d248fa95f487b073d92d83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:11:49.308223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0d68e-c129-4a18-b396-7f76e9f2a8af service swift] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:49.308507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0d68e-c129-4a18-b396-7f76e9f2a8af service swift] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:49.308819 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0d68e-c129-4a18-b396-7f76e9f2a8af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:49.316787 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0d68e-c129-4a18-b396-7f76e9f2a8af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:11:49.318395 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0d68e-c129-4a18-b396-7f76e9f2a8af service swift] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:11:49.327441 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 696/1406] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 13:11:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:11:49.910268 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87222b2d-eca4-4670-bb91-480e06b361c9 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:49.911527 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87222b2d-eca4-4670-bb91-480e06b361c9 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:49.911924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87222b2d-eca4-4670-bb91-480e06b361c9 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:49.914856 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 711/1407] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:11:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:49.921294 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcd10e-91f6-4153-9085-c4e65040cd33 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:49.922168 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcd10e-91f6-4153-9085-c4e65040cd33 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:49.922972 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcd10e-91f6-4153-9085-c4e65040cd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:49.945983 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-35dcd10e-91f6-4153-9085-c4e65040cd33 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:49.947222 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-35dcd10e-91f6-4153-9085-c4e65040cd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:49.955408 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 697/1408] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:50.000798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87222b2d-eca4-4670-bb91-480e06b361c9 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:11:50.017465 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87222b2d-eca4-4670-bb91-480e06b361c9 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:11:50.023708 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d4358-0988-4fdc-a5de-af8976f9a27b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:11:50.027519 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d4358-0988-4fdc-a5de-af8976f9a27b service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:50.027519 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d4358-0988-4fdc-a5de-af8976f9a27b service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:50.027519 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d4358-0988-4fdc-a5de-af8976f9a27b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:50.033921 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d4358-0988-4fdc-a5de-af8976f9a27b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:11:50.035532 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d4358-0988-4fdc-a5de-af8976f9a27b service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:11:50.048197 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 712/1409] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:11:52.546464 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7618d-14f7-48ae-9e5b-1fc6a23ee875 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:52.547013 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7618d-14f7-48ae-9e5b-1fc6a23ee875 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:52.547013 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7618d-14f7-48ae-9e5b-1fc6a23ee875 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:52.548813 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 698/1410] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:11:52.554662 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a38e6f-6a2f-43ba-a9e6-3d1e5cabef8e None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:52.555128 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a38e6f-6a2f-43ba-a9e6-3d1e5cabef8e None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:52.555226 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a38e6f-6a2f-43ba-a9e6-3d1e5cabef8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:52.574604 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-64a38e6f-6a2f-43ba-a9e6-3d1e5cabef8e None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:11:52.575827 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-64a38e6f-6a2f-43ba-a9e6-3d1e5cabef8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:11:52.584614 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 713/1411] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:11:52.629584 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7618d-14f7-48ae-9e5b-1fc6a23ee875 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:11:52.645894 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7618d-14f7-48ae-9e5b-1fc6a23ee875 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:11:52.653562 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743767b-4f10-4bb1-804c-7fb55cbf2f41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:11:52.654289 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743767b-4f10-4bb1-804c-7fb55cbf2f41 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:11:52.654630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743767b-4f10-4bb1-804c-7fb55cbf2f41 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:11:52.654903 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743767b-4f10-4bb1-804c-7fb55cbf2f41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:11:52.664103 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743767b-4f10-4bb1-804c-7fb55cbf2f41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:11:52.665916 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743767b-4f10-4bb1-804c-7fb55cbf2f41 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:11:52.676931 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 699/1412] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:13.867695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302b612-41e4-4c94-9aeb-0c5714a8f49e None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:13.868339 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302b612-41e4-4c94-9aeb-0c5714a8f49e None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:13.868339 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302b612-41e4-4c94-9aeb-0c5714a8f49e None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:13.870038 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 714/1413] 10.222.0.52 () {54 vars in 918 bytes} [Tue Mar 8 13:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:12:13.875252 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89a7a9-1c48-49f9-bb89-5ace1430c4e0 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:13.875716 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89a7a9-1c48-49f9-bb89-5ace1430c4e0 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:13.875822 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89a7a9-1c48-49f9-bb89-5ace1430c4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:13.893847 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-5d89a7a9-1c48-49f9-bb89-5ace1430c4e0 None None] MFA Rules not processed for user `9b917ce4f7f34b289218f7d36a43983e`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:13.895018 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-5d89a7a9-1c48-49f9-bb89-5ace1430c4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:13.903978 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 700/1414] 10.222.0.52 () {58 vars in 1015 bytes} [Tue Mar 8 13:12:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:12:13.918252 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c89a1a-2ee2-43c3-91bf-4fdd2e55c324 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:13.918530 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c89a1a-2ee2-43c3-91bf-4fdd2e55c324 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:13.918806 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c89a1a-2ee2-43c3-91bf-4fdd2e55c324 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:13.920531 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 715/1415] 10.222.0.52 () {54 vars in 918 bytes} [Tue Mar 8 13:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:12:13.925088 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf9947-4dfa-49e7-b885-cd9123dcf539 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:13.925374 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf9947-4dfa-49e7-b885-cd9123dcf539 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:13.925648 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf9947-4dfa-49e7-b885-cd9123dcf539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:13.943677 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-99cf9947-4dfa-49e7-b885-cd9123dcf539 None None] MFA Rules not processed for user `72d4ac44d04943a5b24c7a1d6a31b7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:13.946049 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-99cf9947-4dfa-49e7-b885-cd9123dcf539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:13.954711 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 701/1416] 10.222.0.52 () {58 vars in 1015 bytes} [Tue Mar 8 13:12:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:12:16.718890 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f40520-b80f-40ec-9294-89765c965ea6 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:16.719457 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f40520-b80f-40ec-9294-89765c965ea6 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:16.719457 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f40520-b80f-40ec-9294-89765c965ea6 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:16.721245 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 716/1417] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:12:16.726908 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf343e-3141-4fd1-babb-c2a853d0032a None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:16.727335 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf343e-3141-4fd1-babb-c2a853d0032a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:16.727464 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf343e-3141-4fd1-babb-c2a853d0032a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:16.745403 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-c1bf343e-3141-4fd1-babb-c2a853d0032a None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:16.746605 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c1bf343e-3141-4fd1-babb-c2a853d0032a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:16.754258 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 702/1418] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:12:16.795936 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f40520-b80f-40ec-9294-89765c965ea6 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:12:16.809931 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f40520-b80f-40ec-9294-89765c965ea6 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:12:16.815280 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507d2c4-bdb0-40d9-9126-ff82f3b3784d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:12:16.815899 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507d2c4-bdb0-40d9-9126-ff82f3b3784d service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:16.816180 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507d2c4-bdb0-40d9-9126-ff82f3b3784d service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:16.816451 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507d2c4-bdb0-40d9-9126-ff82f3b3784d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:16.824935 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507d2c4-bdb0-40d9-9126-ff82f3b3784d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:12:16.826498 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507d2c4-bdb0-40d9-9126-ff82f3b3784d service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:12:16.836129 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 717/1419] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:18.214340 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0286f-8639-4c28-a795-0e347d85aa66 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:18.214870 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0286f-8639-4c28-a795-0e347d85aa66 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:18.214980 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0286f-8639-4c28-a795-0e347d85aa66 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:18.216735 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 703/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:12:18.221619 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd528f-51ff-42b5-95b0-24d3bf4e7e8b None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:18.222067 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd528f-51ff-42b5-95b0-24d3bf4e7e8b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:18.222199 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd528f-51ff-42b5-95b0-24d3bf4e7e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:18.240326 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-71bd528f-51ff-42b5-95b0-24d3bf4e7e8b None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:18.241547 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-71bd528f-51ff-42b5-95b0-24d3bf4e7e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:18.249894 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 718/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:12:18.423183 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0286f-8639-4c28-a795-0e347d85aa66 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:12:18.437489 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0286f-8639-4c28-a795-0e347d85aa66 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:12:18.442888 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b23c0-875e-4303-b4bc-7399ba0d3129 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:12:18.443526 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b23c0-875e-4303-b4bc-7399ba0d3129 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:18.443804 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b23c0-875e-4303-b4bc-7399ba0d3129 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:18.444079 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b23c0-875e-4303-b4bc-7399ba0d3129 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:18.452131 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b23c0-875e-4303-b4bc-7399ba0d3129 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:12:18.453733 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b23c0-875e-4303-b4bc-7399ba0d3129 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:12:18.463593 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 704/1422] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:12:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:19.831569 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b025541-9c6f-4349-ac6d-8a3c8983102e None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:19.832141 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b025541-9c6f-4349-ac6d-8a3c8983102e None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:19.832141 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b025541-9c6f-4349-ac6d-8a3c8983102e None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:19.833917 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 719/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:12:19.838945 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169f907-63b0-4c93-b3c2-356ec12357cf None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:19.839331 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169f907-63b0-4c93-b3c2-356ec12357cf None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:19.839500 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169f907-63b0-4c93-b3c2-356ec12357cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:19.857686 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-6169f907-63b0-4c93-b3c2-356ec12357cf None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:19.858881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6169f907-63b0-4c93-b3c2-356ec12357cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:19.867247 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 705/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:12:20.018636 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b025541-9c6f-4349-ac6d-8a3c8983102e None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:12:20.033205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b025541-9c6f-4349-ac6d-8a3c8983102e None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:12:20.038453 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74593f9-b038-4cad-9880-dddc26354318 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:12:20.039739 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74593f9-b038-4cad-9880-dddc26354318 service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:20.040025 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74593f9-b038-4cad-9880-dddc26354318 service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:20.040303 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74593f9-b038-4cad-9880-dddc26354318 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:20.048384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74593f9-b038-4cad-9880-dddc26354318 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:12:20.050007 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74593f9-b038-4cad-9880-dddc26354318 service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:12:20.059382 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 720/1425] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:12:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:21.366323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7e33b-1d22-4905-adb5-311d6737e546 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:21.366915 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7e33b-1d22-4905-adb5-311d6737e546 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:21.366915 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7e33b-1d22-4905-adb5-311d6737e546 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:21.368970 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 706/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:12:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:12:21.373908 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7ded7-307f-46d8-af05-041753b4a322 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:21.374328 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7ded7-307f-46d8-af05-041753b4a322 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:21.374466 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7ded7-307f-46d8-af05-041753b4a322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:21.392804 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-04e7ded7-307f-46d8-af05-041753b4a322 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:21.393987 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-04e7ded7-307f-46d8-af05-041753b4a322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:21.402533 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 721/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:12:21.551874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7e33b-1d22-4905-adb5-311d6737e546 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:12:21.566726 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7e33b-1d22-4905-adb5-311d6737e546 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:12:21.572870 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0d5b4-4ea3-4ecf-88f1-df724cb561e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:12:21.573503 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0d5b4-4ea3-4ecf-88f1-df724cb561e2 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:21.573784 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0d5b4-4ea3-4ecf-88f1-df724cb561e2 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:21.574056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0d5b4-4ea3-4ecf-88f1-df724cb561e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:21.582145 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0d5b4-4ea3-4ecf-88f1-df724cb561e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:12:21.583726 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0d5b4-4ea3-4ecf-88f1-df724cb561e2 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:12:21.593213 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 707/1428] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:22.893690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c5476-2ab5-4863-9680-0154aaf4311d None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:22.894257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c5476-2ab5-4863-9680-0154aaf4311d None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:22.894257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c5476-2ab5-4863-9680-0154aaf4311d None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:22.896028 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 722/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:12:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:12:22.901210 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff8f55-d387-4728-92f6-742193c57df1 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:22.901630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff8f55-d387-4728-92f6-742193c57df1 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:22.901772 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff8f55-d387-4728-92f6-742193c57df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:22.919460 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-c0ff8f55-d387-4728-92f6-742193c57df1 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:22.920630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c0ff8f55-d387-4728-92f6-742193c57df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:22.928230 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 708/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:12:23.078481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c5476-2ab5-4863-9680-0154aaf4311d None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:12:23.092967 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c5476-2ab5-4863-9680-0154aaf4311d None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:12:23.098199 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2b89f-f658-4cda-a215-b0d8f3bdf799 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:12:23.098818 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2b89f-f658-4cda-a215-b0d8f3bdf799 service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:23.099096 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2b89f-f658-4cda-a215-b0d8f3bdf799 service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:23.099365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2b89f-f658-4cda-a215-b0d8f3bdf799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:23.107735 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2b89f-f658-4cda-a215-b0d8f3bdf799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:12:23.109341 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2b89f-f658-4cda-a215-b0d8f3bdf799 service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:12:23.118313 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 723/1431] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:24.428580 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f84597-2a46-405a-9b7d-ebac63436bc8 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:24.429327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f84597-2a46-405a-9b7d-ebac63436bc8 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:24.429327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f84597-2a46-405a-9b7d-ebac63436bc8 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:24.431222 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 709/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:12:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:12:24.436209 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a0e56-1a05-4945-b99a-732516972a46 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:24.436652 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a0e56-1a05-4945-b99a-732516972a46 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:24.436813 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a0e56-1a05-4945-b99a-732516972a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:24.454282 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-7d2a0e56-1a05-4945-b99a-732516972a46 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:24.455463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-7d2a0e56-1a05-4945-b99a-732516972a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:24.463650 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 724/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:12:24.613088 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f84597-2a46-405a-9b7d-ebac63436bc8 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:12:24.627629 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f84597-2a46-405a-9b7d-ebac63436bc8 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:12:24.633813 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf6210-49ea-4144-9a18-e0ccb4a034a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:12:24.634447 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf6210-49ea-4144-9a18-e0ccb4a034a3 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:24.634731 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf6210-49ea-4144-9a18-e0ccb4a034a3 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:24.635008 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf6210-49ea-4144-9a18-e0ccb4a034a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:24.642895 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf6210-49ea-4144-9a18-e0ccb4a034a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:12:24.644473 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf6210-49ea-4144-9a18-e0ccb4a034a3 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:12:24.653945 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 710/1434] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:12:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:25.958810 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d03fbb-2092-47f8-8867-fe74fe28feab None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:25.959351 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d03fbb-2092-47f8-8867-fe74fe28feab None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:25.959351 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d03fbb-2092-47f8-8867-fe74fe28feab None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:25.961501 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 725/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:12:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:12:25.966409 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd20478-7e41-41af-8895-3c48343fffca None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:25.966845 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd20478-7e41-41af-8895-3c48343fffca None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:25.966949 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd20478-7e41-41af-8895-3c48343fffca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:25.984925 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-cdd20478-7e41-41af-8895-3c48343fffca None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:25.986200 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-cdd20478-7e41-41af-8895-3c48343fffca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:25.994613 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 711/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:12:26.154252 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d03fbb-2092-47f8-8867-fe74fe28feab None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:12:26.168517 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d03fbb-2092-47f8-8867-fe74fe28feab None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:12:26.173773 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aaed4c-c288-4524-b1b9-d53c484a3f1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:12:26.174401 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaed4c-c288-4524-b1b9-d53c484a3f1f service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:26.174682 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaed4c-c288-4524-b1b9-d53c484a3f1f service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:26.174959 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaed4c-c288-4524-b1b9-d53c484a3f1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:26.183332 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aaed4c-c288-4524-b1b9-d53c484a3f1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:12:26.184946 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aaed4c-c288-4524-b1b9-d53c484a3f1f service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:12:26.194211 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 726/1437] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:27.529530 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a06061-d94a-4bda-8b99-781a6e46627d None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:27.530069 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a06061-d94a-4bda-8b99-781a6e46627d None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:27.530069 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a06061-d94a-4bda-8b99-781a6e46627d None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:27.531849 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 712/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:12:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:12:27.536794 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33802c-18e6-4a27-a791-534f37f66184 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:27.537263 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33802c-18e6-4a27-a791-534f37f66184 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:27.537391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33802c-18e6-4a27-a791-534f37f66184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:27.555647 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-4e33802c-18e6-4a27-a791-534f37f66184 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:27.556868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-4e33802c-18e6-4a27-a791-534f37f66184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:27.564576 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 727/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:12:27.719378 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a06061-d94a-4bda-8b99-781a6e46627d None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:12:27.735867 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a06061-d94a-4bda-8b99-781a6e46627d None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:12:27.741930 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f61d12-c0f4-41e1-a589-edbb78cb453e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:12:27.742576 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f61d12-c0f4-41e1-a589-edbb78cb453e service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:27.742857 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f61d12-c0f4-41e1-a589-edbb78cb453e service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:27.743130 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f61d12-c0f4-41e1-a589-edbb78cb453e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:27.753218 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f61d12-c0f4-41e1-a589-edbb78cb453e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:12:27.754892 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f61d12-c0f4-41e1-a589-edbb78cb453e service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:12:27.766907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 713/1440] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:12:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:29.644915 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bdfb3-1d59-4b18-b602-6abbade64bf6 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:29.645477 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bdfb3-1d59-4b18-b602-6abbade64bf6 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:29.645477 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bdfb3-1d59-4b18-b602-6abbade64bf6 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:29.647689 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 728/1441] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:12:29.652600 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efaea5-5ec3-48e5-aebf-84cef2adc07c None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:29.653016 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efaea5-5ec3-48e5-aebf-84cef2adc07c None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:29.653183 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efaea5-5ec3-48e5-aebf-84cef2adc07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:29.671615 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-c3efaea5-5ec3-48e5-aebf-84cef2adc07c None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:29.672847 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c3efaea5-5ec3-48e5-aebf-84cef2adc07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:29.680523 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 714/1442] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:12:29.829842 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bdfb3-1d59-4b18-b602-6abbade64bf6 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:12:29.845986 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bdfb3-1d59-4b18-b602-6abbade64bf6 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:12:29.851897 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e49d08-5237-4810-9698-114f598bd9e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:12:29.852513 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e49d08-5237-4810-9698-114f598bd9e1 service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:29.852823 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e49d08-5237-4810-9698-114f598bd9e1 service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:29.853094 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e49d08-5237-4810-9698-114f598bd9e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:29.860902 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e49d08-5237-4810-9698-114f598bd9e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:12:29.862466 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e49d08-5237-4810-9698-114f598bd9e1 service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:12:29.871974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 729/1443] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:12:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:32.141812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5c250-3803-4c5a-a13b-c03fe966cd2f None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:32.142351 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5c250-3803-4c5a-a13b-c03fe966cd2f None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:32.142351 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5c250-3803-4c5a-a13b-c03fe966cd2f None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:32.144440 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 715/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:12:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:12:32.150299 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecf5ee-6d80-4436-bd3f-d8210e299ab4 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:32.157561 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecf5ee-6d80-4436-bd3f-d8210e299ab4 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:32.157561 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecf5ee-6d80-4436-bd3f-d8210e299ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:32.168856 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-d3ecf5ee-6d80-4436-bd3f-d8210e299ab4 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:32.170116 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-d3ecf5ee-6d80-4436-bd3f-d8210e299ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:32.177949 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 730/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:12:32.217113 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5c250-3803-4c5a-a13b-c03fe966cd2f None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:12:32.232508 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5c250-3803-4c5a-a13b-c03fe966cd2f None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:12:32.235944 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af273dea-b64f-4985-9878-34968962fa88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:12:32.236676 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af273dea-b64f-4985-9878-34968962fa88 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:32.236971 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af273dea-b64f-4985-9878-34968962fa88 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:32.237257 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af273dea-b64f-4985-9878-34968962fa88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:32.251570 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af273dea-b64f-4985-9878-34968962fa88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:12:32.253063 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af273dea-b64f-4985-9878-34968962fa88 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:12:32.263790 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 716/1446] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:12:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:34.745860 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf777d-b421-4dc6-a088-70c8b828f2d4 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:34.746481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf777d-b421-4dc6-a088-70c8b828f2d4 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:34.746481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf777d-b421-4dc6-a088-70c8b828f2d4 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:34.748243 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 731/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:12:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:12:34.753412 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edfbc4-eee9-4f84-898e-f37d9d31f26f None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:34.753824 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edfbc4-eee9-4f84-898e-f37d9d31f26f None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:34.753966 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edfbc4-eee9-4f84-898e-f37d9d31f26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:34.772788 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-30edfbc4-eee9-4f84-898e-f37d9d31f26f None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:34.773974 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-30edfbc4-eee9-4f84-898e-f37d9d31f26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:34.781631 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 717/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:12:34.819443 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf777d-b421-4dc6-a088-70c8b828f2d4 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:12:34.829693 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf777d-b421-4dc6-a088-70c8b828f2d4 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:12:34.833074 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fd590-82e0-45bd-9e38-4eddf34f0e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:12:34.833694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fd590-82e0-45bd-9e38-4eddf34f0e4c service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:34.833969 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fd590-82e0-45bd-9e38-4eddf34f0e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:34.834274 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fd590-82e0-45bd-9e38-4eddf34f0e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:34.844727 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fd590-82e0-45bd-9e38-4eddf34f0e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:12:34.846181 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fd590-82e0-45bd-9e38-4eddf34f0e4c service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:12:34.859905 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 732/1449] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:37.545170 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f818ddd-f607-4389-8037-77ccd0883f30 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:37.545705 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f818ddd-f607-4389-8037-77ccd0883f30 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:37.545822 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f818ddd-f607-4389-8037-77ccd0883f30 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:37.547543 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 718/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:12:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:12:37.552960 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf2132-2869-41aa-b7f3-2672991b3ada None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:37.553379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf2132-2869-41aa-b7f3-2672991b3ada None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:37.553498 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf2132-2869-41aa-b7f3-2672991b3ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:37.571261 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-6fcf2132-2869-41aa-b7f3-2672991b3ada None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:37.572448 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-6fcf2132-2869-41aa-b7f3-2672991b3ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:37.580006 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 733/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:12:37.617964 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f818ddd-f607-4389-8037-77ccd0883f30 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:12:37.628790 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f818ddd-f607-4389-8037-77ccd0883f30 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:12:37.633704 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d7307-0ccc-4ec6-a481-3a61fbb84803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:12:37.634374 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d7307-0ccc-4ec6-a481-3a61fbb84803 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:37.634658 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d7307-0ccc-4ec6-a481-3a61fbb84803 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:37.634935 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d7307-0ccc-4ec6-a481-3a61fbb84803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:37.643844 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d7307-0ccc-4ec6-a481-3a61fbb84803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:12:37.645306 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d7307-0ccc-4ec6-a481-3a61fbb84803 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:12:37.655423 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 719/1452] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:40.093618 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326c19d-514a-4283-9ca1-a1fa77167021 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:40.094203 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326c19d-514a-4283-9ca1-a1fa77167021 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:40.094203 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326c19d-514a-4283-9ca1-a1fa77167021 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:40.095947 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 734/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:12:40.101205 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6d763-473b-4395-90ce-d8826b87f8dc None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:40.101598 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6d763-473b-4395-90ce-d8826b87f8dc None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:40.101757 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6d763-473b-4395-90ce-d8826b87f8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:40.119234 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-48d6d763-473b-4395-90ce-d8826b87f8dc None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:40.120411 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-48d6d763-473b-4395-90ce-d8826b87f8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:40.127878 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 720/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:12:40.167016 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326c19d-514a-4283-9ca1-a1fa77167021 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:12:40.177547 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326c19d-514a-4283-9ca1-a1fa77167021 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:12:40.181917 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e004c-690a-4390-96f9-de8f09e78baa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:12:40.182536 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e004c-690a-4390-96f9-de8f09e78baa service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:40.182814 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e004c-690a-4390-96f9-de8f09e78baa service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:40.183082 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e004c-690a-4390-96f9-de8f09e78baa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:40.191647 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e004c-690a-4390-96f9-de8f09e78baa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:12:40.193133 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e004c-690a-4390-96f9-de8f09e78baa service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:12:40.203006 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 735/1455] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:42.548496 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a6bf2-6a69-4f19-bc42-a8def06cbeb7 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:42.549066 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a6bf2-6a69-4f19-bc42-a8def06cbeb7 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:42.549066 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a6bf2-6a69-4f19-bc42-a8def06cbeb7 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:42.550851 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 721/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:12:42.556866 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3015e6-600b-4a18-b4d1-beed21cd891e None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:42.557291 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3015e6-600b-4a18-b4d1-beed21cd891e None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:42.557417 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3015e6-600b-4a18-b4d1-beed21cd891e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:42.575294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-1f3015e6-600b-4a18-b4d1-beed21cd891e None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:42.576471 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-1f3015e6-600b-4a18-b4d1-beed21cd891e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:42.584571 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 736/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:12:42.623526 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a6bf2-6a69-4f19-bc42-a8def06cbeb7 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:12:42.635107 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a6bf2-6a69-4f19-bc42-a8def06cbeb7 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:12:42.638651 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111f85e-bf46-4b91-a3e3-fe914b5564ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:12:42.639287 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111f85e-bf46-4b91-a3e3-fe914b5564ff service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:42.639568 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111f85e-bf46-4b91-a3e3-fe914b5564ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:42.639844 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111f85e-bf46-4b91-a3e3-fe914b5564ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:42.648819 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111f85e-bf46-4b91-a3e3-fe914b5564ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:12:42.650246 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111f85e-bf46-4b91-a3e3-fe914b5564ff service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:12:42.659388 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 722/1458] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:45.017494 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9b9dd-d6bc-4745-bdf1-1add3a77e4c9 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:45.018054 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9b9dd-d6bc-4745-bdf1-1add3a77e4c9 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:45.018054 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9b9dd-d6bc-4745-bdf1-1add3a77e4c9 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:45.019815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 737/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:12:45.025767 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3470a5-ea6a-4aba-b1c3-3250b87189a4 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:45.026151 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3470a5-ea6a-4aba-b1c3-3250b87189a4 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:45.026318 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3470a5-ea6a-4aba-b1c3-3250b87189a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:45.043638 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-1d3470a5-ea6a-4aba-b1c3-3250b87189a4 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:45.044834 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1d3470a5-ea6a-4aba-b1c3-3250b87189a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:45.052365 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 723/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:12:45.090405 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9b9dd-d6bc-4745-bdf1-1add3a77e4c9 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:12:45.100892 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9b9dd-d6bc-4745-bdf1-1add3a77e4c9 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:12:45.104455 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89c7b2-cefb-4e90-aff8-fcba93d06ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:12:45.105201 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89c7b2-cefb-4e90-aff8-fcba93d06ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:45.105480 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89c7b2-cefb-4e90-aff8-fcba93d06ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:45.105754 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89c7b2-cefb-4e90-aff8-fcba93d06ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:45.114746 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89c7b2-cefb-4e90-aff8-fcba93d06ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:12:45.116165 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89c7b2-cefb-4e90-aff8-fcba93d06ed7 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:12:45.125629 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 738/1461] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:12:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:47.510811 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876af7f-9627-42cb-8dc0-186d32916cd3 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:47.511347 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876af7f-9627-42cb-8dc0-186d32916cd3 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:47.511463 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876af7f-9627-42cb-8dc0-186d32916cd3 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:47.513215 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 724/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:12:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:12:47.518489 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18495996-f367-4c4a-8ce2-518ca940d441 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:47.518891 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18495996-f367-4c4a-8ce2-518ca940d441 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:47.519044 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18495996-f367-4c4a-8ce2-518ca940d441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:47.537018 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-18495996-f367-4c4a-8ce2-518ca940d441 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:47.538240 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-18495996-f367-4c4a-8ce2-518ca940d441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:47.546016 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 739/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:12:47.583348 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876af7f-9627-42cb-8dc0-186d32916cd3 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:12:47.600073 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876af7f-9627-42cb-8dc0-186d32916cd3 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:12:47.604973 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c276f-06c0-4f9e-82b1-2add22566b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:12:47.605618 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c276f-06c0-4f9e-82b1-2add22566b47 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:47.606071 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c276f-06c0-4f9e-82b1-2add22566b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:47.606588 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c276f-06c0-4f9e-82b1-2add22566b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:47.619414 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c276f-06c0-4f9e-82b1-2add22566b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:12:47.620887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c276f-06c0-4f9e-82b1-2add22566b47 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:12:47.630618 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 725/1464] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:12:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:49.995825 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61a519-3ce8-46e2-a150-275e611c5305 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:49.996388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61a519-3ce8-46e2-a150-275e611c5305 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:49.996388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61a519-3ce8-46e2-a150-275e611c5305 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:49.998191 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 740/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:12:50.003664 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ed6ce-f64f-4f5e-8aa8-f1bafe31819e None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:50.008384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ed6ce-f64f-4f5e-8aa8-f1bafe31819e None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:50.008384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ed6ce-f64f-4f5e-8aa8-f1bafe31819e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:50.023159 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-167ed6ce-f64f-4f5e-8aa8-f1bafe31819e None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:50.024344 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-167ed6ce-f64f-4f5e-8aa8-f1bafe31819e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:50.032202 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 726/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:12:50.069530 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61a519-3ce8-46e2-a150-275e611c5305 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:12:50.071176 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-7c61a519-3ce8-46e2-a150-275e611c5305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:50.083707 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61a519-3ce8-46e2-a150-275e611c5305 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:12:50.087694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae40728-1444-4e31-be32-ca901dfa9287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:12:50.088318 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae40728-1444-4e31-be32-ca901dfa9287 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:50.088599 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae40728-1444-4e31-be32-ca901dfa9287 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:50.088906 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae40728-1444-4e31-be32-ca901dfa9287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:50.097425 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae40728-1444-4e31-be32-ca901dfa9287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:12:50.098852 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae40728-1444-4e31-be32-ca901dfa9287 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:12:50.108509 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 741/1467] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:52.479706 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78eefd-6f41-408b-a89a-55ec50ce1bd7 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:52.480237 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78eefd-6f41-408b-a89a-55ec50ce1bd7 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:52.480237 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78eefd-6f41-408b-a89a-55ec50ce1bd7 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:52.481966 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 727/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:12:52.487349 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca045c6b-d390-4326-8f18-4cb0b74d5615 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:52.487778 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca045c6b-d390-4326-8f18-4cb0b74d5615 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:52.487918 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca045c6b-d390-4326-8f18-4cb0b74d5615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:52.505887 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-ca045c6b-d390-4326-8f18-4cb0b74d5615 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:52.507634 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-ca045c6b-d390-4326-8f18-4cb0b74d5615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:52.521246 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 742/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:12:52.558011 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78eefd-6f41-408b-a89a-55ec50ce1bd7 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:12:52.568494 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78eefd-6f41-408b-a89a-55ec50ce1bd7 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:12:52.572104 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee6c39-5bb4-4fd6-989b-e84a333fd1ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:12:52.572757 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee6c39-5bb4-4fd6-989b-e84a333fd1ef service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:52.573038 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee6c39-5bb4-4fd6-989b-e84a333fd1ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:52.573308 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee6c39-5bb4-4fd6-989b-e84a333fd1ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:52.581797 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee6c39-5bb4-4fd6-989b-e84a333fd1ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:12:52.583214 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee6c39-5bb4-4fd6-989b-e84a333fd1ef service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:12:52.594753 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 728/1470] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:54.923595 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a7c2d-3128-4301-bbb0-acc6137031b2 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:54.924160 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a7c2d-3128-4301-bbb0-acc6137031b2 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:54.924160 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a7c2d-3128-4301-bbb0-acc6137031b2 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:54.925968 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 743/1471] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:12:54.932039 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fda6ee-db42-4aca-a347-e2abf9879240 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:54.932480 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fda6ee-db42-4aca-a347-e2abf9879240 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:54.932580 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fda6ee-db42-4aca-a347-e2abf9879240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:54.950627 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-a4fda6ee-db42-4aca-a347-e2abf9879240 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:12:54.951931 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-a4fda6ee-db42-4aca-a347-e2abf9879240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:12:54.959464 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 729/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:12:54.996535 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a7c2d-3128-4301-bbb0-acc6137031b2 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:12:55.007230 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a7c2d-3128-4301-bbb0-acc6137031b2 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:12:55.010711 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff8e2a-6ecc-4bdc-bc21-d179b1814bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:12:55.011337 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff8e2a-6ecc-4bdc-bc21-d179b1814bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:12:55.011620 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff8e2a-6ecc-4bdc-bc21-d179b1814bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:12:55.011990 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff8e2a-6ecc-4bdc-bc21-d179b1814bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:12:55.020547 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff8e2a-6ecc-4bdc-bc21-d179b1814bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:12:55.022065 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff8e2a-6ecc-4bdc-bc21-d179b1814bb8 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:12:55.031267 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 744/1473] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:12:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:13:15.933110 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f91bb7-d139-459e-acf3-4d28917b6f10 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:15.933763 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f91bb7-d139-459e-acf3-4d28917b6f10 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:15.933973 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f91bb7-d139-459e-acf3-4d28917b6f10 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:15.936033 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 730/1474] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:13:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:13:15.941550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9359c85-b441-4df8-ae0b-c3a39e59a3d7 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:15.941965 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9359c85-b441-4df8-ae0b-c3a39e59a3d7 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:15.942100 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9359c85-b441-4df8-ae0b-c3a39e59a3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:15.960879 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-c9359c85-b441-4df8-ae0b-c3a39e59a3d7 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:13:15.962050 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-c9359c85-b441-4df8-ae0b-c3a39e59a3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:13:15.969710 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 745/1475] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:13:16.016454 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a8daf-8d32-4329-930e-7d122d6e1e73 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:16.016789 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a8daf-8d32-4329-930e-7d122d6e1e73 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:16.017069 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a8daf-8d32-4329-930e-7d122d6e1e73 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:16.018856 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 731/1476] 10.222.0.52 () {54 vars in 961 bytes} [Tue Mar 8 13:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:13:16.024827 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b463c03-d2bd-45fe-b214-fa2691f984a4 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:16.028806 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b463c03-d2bd-45fe-b214-fa2691f984a4 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:16.028806 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b463c03-d2bd-45fe-b214-fa2691f984a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:16.042985 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-3b463c03-d2bd-45fe-b214-fa2691f984a4 None None] MFA Rules not processed for user `81124c3324d7427a9f29270b88e88f70`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:13:16.044157 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-3b463c03-d2bd-45fe-b214-fa2691f984a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:13:16.050705 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 746/1477] 10.222.0.52 () {58 vars in 1058 bytes} [Tue Mar 8 13:13:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:13:16.057806 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a8daf-8d32-4329-930e-7d122d6e1e73 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:13:16.068806 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a8daf-8d32-4329-930e-7d122d6e1e73 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:13:16.072255 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd094a-c78b-4b6d-9721-38000024828f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81124c3324d7427a9f29270b88e88f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:13:16.072911 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd094a-c78b-4b6d-9721-38000024828f service glance] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:16.073191 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd094a-c78b-4b6d-9721-38000024828f service glance] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:16.073462 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd094a-c78b-4b6d-9721-38000024828f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:16.081990 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd094a-c78b-4b6d-9721-38000024828f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:13:16.084081 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd094a-c78b-4b6d-9721-38000024828f service glance] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:13:16.093133 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 732/1478] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:13:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:13:18.484292 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dcf7d-b711-4b7e-9594-128b98db513b None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:18.484912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dcf7d-b711-4b7e-9594-128b98db513b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:18.484912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dcf7d-b711-4b7e-9594-128b98db513b None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:18.486581 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 747/1479] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:13:18.492579 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc75ef2-da7d-4135-b029-2061368b0337 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:18.493012 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc75ef2-da7d-4135-b029-2061368b0337 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:18.493160 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc75ef2-da7d-4135-b029-2061368b0337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:18.511378 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-8bc75ef2-da7d-4135-b029-2061368b0337 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:13:18.512565 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-8bc75ef2-da7d-4135-b029-2061368b0337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:13:18.520192 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 733/1480] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:13:18.542928 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697dcf7d-b711-4b7e-9594-128b98db513b None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:13:18.555809 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697dcf7d-b711-4b7e-9594-128b98db513b None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:13:18.560127 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67af432-08c8-4e12-8e97-4e4b30c248ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:13:18.560786 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67af432-08c8-4e12-8e97-4e4b30c248ed admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:18.561064 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67af432-08c8-4e12-8e97-4e4b30c248ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:18.561336 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67af432-08c8-4e12-8e97-4e4b30c248ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:18.562058 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67af432-08c8-4e12-8e97-4e4b30c248ed admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:13:18.563730 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING py.warnings [None req-c67af432-08c8-4e12-8e97-4e4b30c248ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:13:18.563730 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: warnings.warn(msg) Mar 08 13:13:18.563730 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: Mar 08 13:13:18.564890 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67af432-08c8-4e12-8e97-4e4b30c248ed admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:13:18.584748 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 748/1481] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 13:13:18 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:13:20.930945 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6f33f-37c0-40af-aba4-103da9364a91 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:20.931531 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6f33f-37c0-40af-aba4-103da9364a91 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:20.931531 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6f33f-37c0-40af-aba4-103da9364a91 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:20.933286 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 734/1482] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:13:20.938428 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cf4aa-1f3a-48de-a564-c4d72f1ad0fb None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:20.938861 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cf4aa-1f3a-48de-a564-c4d72f1ad0fb None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:20.938978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cf4aa-1f3a-48de-a564-c4d72f1ad0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:20.956632 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-b47cf4aa-1f3a-48de-a564-c4d72f1ad0fb None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:13:20.958402 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b47cf4aa-1f3a-48de-a564-c4d72f1ad0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:13:20.966379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 749/1483] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:13:21.010127 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6f33f-37c0-40af-aba4-103da9364a91 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:13:21.023857 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6f33f-37c0-40af-aba4-103da9364a91 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:13:21.029068 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663935f0-22e5-4181-94b5-4dd6ef81744c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:13:21.029689 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663935f0-22e5-4181-94b5-4dd6ef81744c service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:21.029966 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663935f0-22e5-4181-94b5-4dd6ef81744c service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:21.030238 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663935f0-22e5-4181-94b5-4dd6ef81744c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:21.038529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663935f0-22e5-4181-94b5-4dd6ef81744c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:13:21.040094 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663935f0-22e5-4181-94b5-4dd6ef81744c service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:13:21.049187 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 735/1484] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:13:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:13:23.530469 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0246c2-2c93-4fa4-8666-b725628bb2d8 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:23.531010 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0246c2-2c93-4fa4-8666-b725628bb2d8 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:23.531010 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0246c2-2c93-4fa4-8666-b725628bb2d8 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:23.532863 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 750/1485] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:13:23.538522 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8982a90-6bc2-4b4b-8440-143b330535f1 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:23.538955 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8982a90-6bc2-4b4b-8440-143b330535f1 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:23.539056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8982a90-6bc2-4b4b-8440-143b330535f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:23.556836 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-b8982a90-6bc2-4b4b-8440-143b330535f1 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:13:23.558009 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b8982a90-6bc2-4b4b-8440-143b330535f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:13:23.565547 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 736/1486] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:13:23.600834 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0246c2-2c93-4fa4-8666-b725628bb2d8 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:13:23.611322 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0246c2-2c93-4fa4-8666-b725628bb2d8 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:13:23.615651 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b488b7-8cc3-4c31-8a83-3c35b42d65b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:13:23.616274 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b488b7-8cc3-4c31-8a83-3c35b42d65b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:23.616557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b488b7-8cc3-4c31-8a83-3c35b42d65b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:23.616866 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b488b7-8cc3-4c31-8a83-3c35b42d65b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:23.625920 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b488b7-8cc3-4c31-8a83-3c35b42d65b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:13:23.627379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b488b7-8cc3-4c31-8a83-3c35b42d65b4 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:13:23.636883 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 751/1487] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:13:25.990575 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a34c6c-9d26-4e8b-b195-fe9bd228ff84 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:25.991132 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a34c6c-9d26-4e8b-b195-fe9bd228ff84 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:25.991132 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a34c6c-9d26-4e8b-b195-fe9bd228ff84 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:25.997828 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 737/1488] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:13:25.998510 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a7e02-162f-4c19-8a58-3ba15725c4e1 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:25.998911 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a7e02-162f-4c19-8a58-3ba15725c4e1 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:25.999062 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a7e02-162f-4c19-8a58-3ba15725c4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:26.017902 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-e88a7e02-162f-4c19-8a58-3ba15725c4e1 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:13:26.019070 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e88a7e02-162f-4c19-8a58-3ba15725c4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:13:26.027544 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 752/1489] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:13:26.065184 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a34c6c-9d26-4e8b-b195-fe9bd228ff84 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:13:26.076146 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a34c6c-9d26-4e8b-b195-fe9bd228ff84 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:13:26.079536 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b6141-9139-4c36-a26f-2b0a9d67f3a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:13:26.080160 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b6141-9139-4c36-a26f-2b0a9d67f3a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:26.080438 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b6141-9139-4c36-a26f-2b0a9d67f3a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:26.080743 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b6141-9139-4c36-a26f-2b0a9d67f3a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:26.089603 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b6141-9139-4c36-a26f-2b0a9d67f3a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:13:26.091021 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b6141-9139-4c36-a26f-2b0a9d67f3a6 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:13:26.100360 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 738/1490] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:13:28.486210 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6cedc-8a2f-4552-aed7-4a0f1c5612dc None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:28.486717 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6cedc-8a2f-4552-aed7-4a0f1c5612dc None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:28.486717 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6cedc-8a2f-4552-aed7-4a0f1c5612dc None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:28.489088 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 753/1491] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:13:28.494535 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e4794-60b6-48f6-8a90-0f513af96ae0 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:28.494952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e4794-60b6-48f6-8a90-0f513af96ae0 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:28.495115 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e4794-60b6-48f6-8a90-0f513af96ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:28.513885 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-5f4e4794-60b6-48f6-8a90-0f513af96ae0 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:13:28.515087 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-5f4e4794-60b6-48f6-8a90-0f513af96ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:13:28.522957 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 739/1492] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:13:28.563038 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6cedc-8a2f-4552-aed7-4a0f1c5612dc None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:13:28.573443 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6cedc-8a2f-4552-aed7-4a0f1c5612dc None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:13:28.576932 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1d4df-e1a0-4d6a-905e-d2c2a259b483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:13:28.577556 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1d4df-e1a0-4d6a-905e-d2c2a259b483 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:28.577838 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1d4df-e1a0-4d6a-905e-d2c2a259b483 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:28.578113 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1d4df-e1a0-4d6a-905e-d2c2a259b483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:28.586759 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1d4df-e1a0-4d6a-905e-d2c2a259b483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:13:28.588186 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1d4df-e1a0-4d6a-905e-d2c2a259b483 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:13:28.597368 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 754/1493] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:13:31.319618 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fa244-caed-4857-981a-fdf34ba4b5f8 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:31.320156 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fa244-caed-4857-981a-fdf34ba4b5f8 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:31.320156 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fa244-caed-4857-981a-fdf34ba4b5f8 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:31.321970 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 740/1494] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 13:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:13:31.327136 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d40b26-c6ed-4cde-93f9-82959c6c671b None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:31.327564 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d40b26-c6ed-4cde-93f9-82959c6c671b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:31.327782 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d40b26-c6ed-4cde-93f9-82959c6c671b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:31.345999 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-30d40b26-c6ed-4cde-93f9-82959c6c671b None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:13:31.347198 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-30d40b26-c6ed-4cde-93f9-82959c6c671b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:13:31.357121 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 755/1495] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 13:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:13:31.396005 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fa244-caed-4857-981a-fdf34ba4b5f8 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:13:31.406471 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fa244-caed-4857-981a-fdf34ba4b5f8 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:13:31.410259 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80ba2d-2f11-4c80-8fe0-2c077233ecdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:13:31.410886 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80ba2d-2f11-4c80-8fe0-2c077233ecdb service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:13:31.411165 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80ba2d-2f11-4c80-8fe0-2c077233ecdb service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:13:31.411440 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80ba2d-2f11-4c80-8fe0-2c077233ecdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:13:31.420056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80ba2d-2f11-4c80-8fe0-2c077233ecdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:13:31.421527 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80ba2d-2f11-4c80-8fe0-2c077233ecdb service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:13:31.431170 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 741/1496] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:15:01.736496 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129abd28-8ec3-48ed-94b2-43bfb16fbca7 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:15:01.737105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129abd28-8ec3-48ed-94b2-43bfb16fbca7 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:15:01.737105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129abd28-8ec3-48ed-94b2-43bfb16fbca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:15:01.755428 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-129abd28-8ec3-48ed-94b2-43bfb16fbca7 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:15:01.756612 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-129abd28-8ec3-48ed-94b2-43bfb16fbca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:15:01.765342 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 756/1497] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:15:01.774397 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658fdf3-8fbf-430c-a8ee-ff8372e2d53b None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:15:01.774881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658fdf3-8fbf-430c-a8ee-ff8372e2d53b None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:15:01.774987 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658fdf3-8fbf-430c-a8ee-ff8372e2d53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:15:01.792447 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-c658fdf3-8fbf-430c-a8ee-ff8372e2d53b None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:15:01.793862 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c658fdf3-8fbf-430c-a8ee-ff8372e2d53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:15:01.801604 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 742/1498] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:15:01.806027 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129abd28-8ec3-48ed-94b2-43bfb16fbca7 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:15:01.815900 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129abd28-8ec3-48ed-94b2-43bfb16fbca7 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:15:01.820337 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83162a1e-e25f-4b69-a507-035592924d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:15:01.821012 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83162a1e-e25f-4b69-a507-035592924d5b admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:15:01.821291 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83162a1e-e25f-4b69-a507-035592924d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:15:01.821581 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83162a1e-e25f-4b69-a507-035592924d5b admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:15:01.822278 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83162a1e-e25f-4b69-a507-035592924d5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:15:01.822608 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83162a1e-e25f-4b69-a507-035592924d5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:15:01.823623 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING py.warnings [None req-83162a1e-e25f-4b69-a507-035592924d5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:15:01.823623 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: warnings.warn(msg) Mar 08 13:15:01.823623 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: Mar 08 13:15:01.824503 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83162a1e-e25f-4b69-a507-035592924d5b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:15:01.836165 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 757/1499] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:15:01.844198 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658fdf3-8fbf-430c-a8ee-ff8372e2d53b None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:15:01.853534 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658fdf3-8fbf-430c-a8ee-ff8372e2d53b None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:15:01.858879 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84879e-110f-4d50-92fd-7fa4d83c4dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:15:01.859534 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84879e-110f-4d50-92fd-7fa4d83c4dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:15:01.859818 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84879e-110f-4d50-92fd-7fa4d83c4dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:15:01.860091 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84879e-110f-4d50-92fd-7fa4d83c4dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:15:01.860862 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84879e-110f-4d50-92fd-7fa4d83c4dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:15:01.861888 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING py.warnings [None req-1b84879e-110f-4d50-92fd-7fa4d83c4dd0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:15:01.861888 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: warnings.warn(msg) Mar 08 13:15:01.861888 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: Mar 08 13:15:01.863112 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84879e-110f-4d50-92fd-7fa4d83c4dd0 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:15:01.968651 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 743/1500] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:15:01 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:15:01.972867 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83162a1e-e25f-4b69-a507-035592924d5b admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:15:01.983213 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83162a1e-e25f-4b69-a507-035592924d5b admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:15:02.039435 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fc0bd-64b2-4d89-aace-4c9a5f1ddbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:15:02.040022 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fc0bd-64b2-4d89-aace-4c9a5f1ddbcc admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:15:02.040305 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fc0bd-64b2-4d89-aace-4c9a5f1ddbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:15:02.040582 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fc0bd-64b2-4d89-aace-4c9a5f1ddbcc admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:15:02.041300 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fc0bd-64b2-4d89-aace-4c9a5f1ddbcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:15:02.042312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING py.warnings [None req-2f6fc0bd-64b2-4d89-aace-4c9a5f1ddbcc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:15:02.042312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: warnings.warn(msg) Mar 08 13:15:02.042312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: Mar 08 13:15:02.044148 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fc0bd-64b2-4d89-aace-4c9a5f1ddbcc admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:15:02.118790 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 758/1501] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:15:01 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:15:02.124151 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84879e-110f-4d50-92fd-7fa4d83c4dd0 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:15:02.134235 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84879e-110f-4d50-92fd-7fa4d83c4dd0 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:15:02.138909 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e33e4-332e-416c-b600-cc9df2c42fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:15:02.139553 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e33e4-332e-416c-b600-cc9df2c42fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:15:02.139841 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e33e4-332e-416c-b600-cc9df2c42fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:15:02.140117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e33e4-332e-416c-b600-cc9df2c42fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:15:02.140873 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e33e4-332e-416c-b600-cc9df2c42fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:15:02.141894 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING py.warnings [None req-cd2e33e4-332e-416c-b600-cc9df2c42fb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:15:02.141894 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: warnings.warn(msg) Mar 08 13:15:02.141894 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: Mar 08 13:15:02.142779 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e33e4-332e-416c-b600-cc9df2c42fb8 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:15:02.155326 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 744/1502] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:15:02.159473 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fc0bd-64b2-4d89-aace-4c9a5f1ddbcc admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:15:02.170012 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fc0bd-64b2-4d89-aace-4c9a5f1ddbcc admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:15:02.174572 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380d785-b8e0-4de7-8e31-deab19e2fc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:15:02.175236 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380d785-b8e0-4de7-8e31-deab19e2fc61 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:15:02.175547 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380d785-b8e0-4de7-8e31-deab19e2fc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:15:02.175827 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380d785-b8e0-4de7-8e31-deab19e2fc61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:15:02.176564 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380d785-b8e0-4de7-8e31-deab19e2fc61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:15:02.177607 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING py.warnings [None req-d380d785-b8e0-4de7-8e31-deab19e2fc61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:15:02.177607 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: warnings.warn(msg) Mar 08 13:15:02.177607 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: Mar 08 13:15:02.178484 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380d785-b8e0-4de7-8e31-deab19e2fc61 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:15:02.192233 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 759/1503] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:15:02.196290 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e33e4-332e-416c-b600-cc9df2c42fb8 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:15:02.206210 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e33e4-332e-416c-b600-cc9df2c42fb8 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:15:02.210626 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7a75c-4e06-4d8c-b18b-61a6e0953703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:15:02.211489 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7a75c-4e06-4d8c-b18b-61a6e0953703 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:15:02.211774 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7a75c-4e06-4d8c-b18b-61a6e0953703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:15:02.212047 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7a75c-4e06-4d8c-b18b-61a6e0953703 admin admin] PATH_INFO: `/v3/projects/ff08aa6f837142f5901db5eb0b34fed4/users/15e78694d2804981bcfcae8d3a798bdc/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:15:02.226030 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7a75c-4e06-4d8c-b18b-61a6e0953703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff08aa6f837142f5901db5eb0b34fed4, user_id=15e78694d2804981bcfcae8d3a798bdc, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:15:02.227054 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING py.warnings [None req-a1a7a75c-4e06-4d8c-b18b-61a6e0953703 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:15:02.227054 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: warnings.warn(msg) Mar 08 13:15:02.227054 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: Mar 08 13:15:02.229075 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7a75c-4e06-4d8c-b18b-61a6e0953703 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:15:02.327814 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 745/1504] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:15:02 2022] PUT /identity/v3/projects/ff08aa6f837142f5901db5eb0b34fed4/users/15e78694d2804981bcfcae8d3a798bdc/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:15:02.338930 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2ebe8-d282-49d6-9e23-e82f81c81b32 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:15:02.341618 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2ebe8-d282-49d6-9e23-e82f81c81b32 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:15:02.341618 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2ebe8-d282-49d6-9e23-e82f81c81b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:15:02.366582 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-8cb2ebe8-d282-49d6-9e23-e82f81c81b32 None None] MFA Rules not processed for user `15e78694d2804981bcfcae8d3a798bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:15:02.367760 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-8cb2ebe8-d282-49d6-9e23-e82f81c81b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:15:02.428203 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 760/1505] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:15:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:15:02.439319 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7a75c-4e06-4d8c-b18b-61a6e0953703 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:15:02.506287 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7a75c-4e06-4d8c-b18b-61a6e0953703 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:15:02.511608 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af3569-fdb2-42f6-97a8-be39a1f2b711 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:15:02.512268 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af3569-fdb2-42f6-97a8-be39a1f2b711 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:15:02.512552 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af3569-fdb2-42f6-97a8-be39a1f2b711 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:15:02.512869 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af3569-fdb2-42f6-97a8-be39a1f2b711 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:15:02.520437 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af3569-fdb2-42f6-97a8-be39a1f2b711 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:15:02.522059 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af3569-fdb2-42f6-97a8-be39a1f2b711 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:15:02.531129 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 746/1506] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:15:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:15:02.600157 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9343735-b63e-4ca7-8d52-978e8fab0126 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:15:02.600445 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9343735-b63e-4ca7-8d52-978e8fab0126 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:15:02.600759 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9343735-b63e-4ca7-8d52-978e8fab0126 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:15:02.602479 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 761/1507] 10.222.0.52 () {52 vars in 829 bytes} [Tue Mar 8 13:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:15:02.606675 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af3569-fdb2-42f6-97a8-be39a1f2b711 service nova] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:15:02.669178 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af3569-fdb2-42f6-97a8-be39a1f2b711 service nova] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:15:02.673734 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bc3ca-474a-413e-835b-cef31b67e5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:15:02.674593 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bc3ca-474a-413e-835b-cef31b67e5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:15:02.674879 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bc3ca-474a-413e-835b-cef31b67e5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:15:02.675155 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bc3ca-474a-413e-835b-cef31b67e5bd admin admin] PATH_INFO: `/v3/users/15e78694d2804981bcfcae8d3a798bdc` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:15:02.676329 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bc3ca-474a-413e-835b-cef31b67e5bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e78694d2804981bcfcae8d3a798bdc)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:15:02.677458 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING py.warnings [None req-1b4bc3ca-474a-413e-835b-cef31b67e5bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:15:02.677458 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: warnings.warn(msg) Mar 08 13:15:02.677458 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: Mar 08 13:15:02.678671 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bc3ca-474a-413e-835b-cef31b67e5bd admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:15:02.926299 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1b4bc3ca-474a-413e-835b-cef31b67e5bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e78694d2804981bcfcae8d3a798bdc'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:15:02.944645 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1b4bc3ca-474a-413e-835b-cef31b67e5bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e78694d2804981bcfcae8d3a798bdc'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:15:02.945353 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1b4bc3ca-474a-413e-835b-cef31b67e5bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e78694d2804981bcfcae8d3a798bdc'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:15:03.010315 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1b4bc3ca-474a-413e-835b-cef31b67e5bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e78694d2804981bcfcae8d3a798bdc'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:15:03.011013 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1b4bc3ca-474a-413e-835b-cef31b67e5bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e78694d2804981bcfcae8d3a798bdc'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:15:03.031075 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 747/1508] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:15:02 2022] DELETE /identity/v3/users/15e78694d2804981bcfcae8d3a798bdc => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:15:03.035515 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445469c1-0784-4a13-be76-39af11914c30 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:15:03.035991 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445469c1-0784-4a13-be76-39af11914c30 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:15:03.036100 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445469c1-0784-4a13-be76-39af11914c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:15:03.053658 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-445469c1-0784-4a13-be76-39af11914c30 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:15:03.054823 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-445469c1-0784-4a13-be76-39af11914c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:15:03.109643 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 762/1509] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:15:03.119077 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bc3ca-474a-413e-835b-cef31b67e5bd admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:15:03.120543 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1b4bc3ca-474a-413e-835b-cef31b67e5bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:15:03.176806 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bc3ca-474a-413e-835b-cef31b67e5bd admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:15:03.180244 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6183dad-03e8-4af4-94ee-e83c39d222af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:15:03.180911 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6183dad-03e8-4af4-94ee-e83c39d222af service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:15:03.181196 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6183dad-03e8-4af4-94ee-e83c39d222af service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:15:03.181473 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6183dad-03e8-4af4-94ee-e83c39d222af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:15:03.190671 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6183dad-03e8-4af4-94ee-e83c39d222af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:15:03.192114 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6183dad-03e8-4af4-94ee-e83c39d222af service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:15:03.202017 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 748/1510] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:15:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:15:03.690387 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445469c1-0784-4a13-be76-39af11914c30 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:15:03.690387 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-445469c1-0784-4a13-be76-39af11914c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:15:03.696695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445469c1-0784-4a13-be76-39af11914c30 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:15:03.702077 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f9ec7-27e2-4b1f-ba99-f146b78eaecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:15:03.702924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f9ec7-27e2-4b1f-ba99-f146b78eaecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:15:03.703291 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f9ec7-27e2-4b1f-ba99-f146b78eaecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:15:03.703470 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f9ec7-27e2-4b1f-ba99-f146b78eaecc admin admin] PATH_INFO: `/v3/projects/ff08aa6f837142f5901db5eb0b34fed4` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:15:03.704787 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f9ec7-27e2-4b1f-ba99-f146b78eaecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff08aa6f837142f5901db5eb0b34fed4)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:15:03.705829 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING py.warnings [None req-4f1f9ec7-27e2-4b1f-ba99-f146b78eaecc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:15:03.705829 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: warnings.warn(msg) Mar 08 13:15:03.705829 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: Mar 08 13:15:03.707087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f9ec7-27e2-4b1f-ba99-f146b78eaecc admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:15:03.844605 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4f1f9ec7-27e2-4b1f-ba99-f146b78eaecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff08aa6f837142f5901db5eb0b34fed4', 'request_id': 'req-4f1f9ec7-27e2-4b1f-ba99-f146b78eaecc'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:15:03.850315 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4f1f9ec7-27e2-4b1f-ba99-f146b78eaecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff08aa6f837142f5901db5eb0b34fed4', 'request_id': 'req-4f1f9ec7-27e2-4b1f-ba99-f146b78eaecc'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:15:03.865307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4f1f9ec7-27e2-4b1f-ba99-f146b78eaecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff08aa6f837142f5901db5eb0b34fed4', 'request_id': 'req-4f1f9ec7-27e2-4b1f-ba99-f146b78eaecc'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:15:03.943318 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4f1f9ec7-27e2-4b1f-ba99-f146b78eaecc admin admin] The token cache is being invalidate because project ff08aa6f837142f5901db5eb0b34fed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:15:03.943531 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4f1f9ec7-27e2-4b1f-ba99-f146b78eaecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:15:03.944139 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4f1f9ec7-27e2-4b1f-ba99-f146b78eaecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:15:03.945825 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 763/1511] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:15:03 2022] DELETE /identity/v3/projects/ff08aa6f837142f5901db5eb0b34fed4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:16:44.204206 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610342c-379f-4b16-b714-2a3b1c04d4e2 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:16:44.204825 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610342c-379f-4b16-b714-2a3b1c04d4e2 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:16:44.204825 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610342c-379f-4b16-b714-2a3b1c04d4e2 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:16:44.206597 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 749/1512] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:16:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:16:44.211896 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ebfd5-a694-418f-883d-aee439ccf5e5 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:16:44.212342 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ebfd5-a694-418f-883d-aee439ccf5e5 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:16:44.212485 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ebfd5-a694-418f-883d-aee439ccf5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:16:44.235271 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-401ebfd5-a694-418f-883d-aee439ccf5e5 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:16:44.236606 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-401ebfd5-a694-418f-883d-aee439ccf5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:16:44.264318 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8576af0-919e-4ffe-b685-009f213bbba6 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:16:44.264606 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8576af0-919e-4ffe-b685-009f213bbba6 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:16:44.264930 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8576af0-919e-4ffe-b685-009f213bbba6 None None] PATH_INFO: `/v3` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:16:44.266239 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 750/1513] 10.222.0.44 () {54 vars in 925 bytes} [Tue Mar 8 13:16:44 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:16:44.272542 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c0b35-6104-43a4-8465-b881db5f8110 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:16:44.272851 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c0b35-6104-43a4-8465-b881db5f8110 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:16:44.273132 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c0b35-6104-43a4-8465-b881db5f8110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:16:44.292205 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-f62c0b35-6104-43a4-8465-b881db5f8110 None None] MFA Rules not processed for user `9b917ce4f7f34b289218f7d36a43983e`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:16:44.293433 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f62c0b35-6104-43a4-8465-b881db5f8110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:16:44.297830 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 764/1514] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:16:44.358635 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 751/1515] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Mar 8 13:16:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:16:44.453431 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ebfd5-a694-418f-883d-aee439ccf5e5 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:16:44.454842 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-401ebfd5-a694-418f-883d-aee439ccf5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:16:44.532602 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ebfd5-a694-418f-883d-aee439ccf5e5 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:16:44.538080 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a11152-29e1-4a0c-937a-301ba5923f8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:16:44.538724 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a11152-29e1-4a0c-937a-301ba5923f8d service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:16:44.539617 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a11152-29e1-4a0c-937a-301ba5923f8d service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:16:44.539840 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a11152-29e1-4a0c-937a-301ba5923f8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:16:44.548126 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a11152-29e1-4a0c-937a-301ba5923f8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:16:44.549750 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a11152-29e1-4a0c-937a-301ba5923f8d service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:16:44.561862 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 765/1516] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:16:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:16:45.854106 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1a2d6-015c-4e05-8ee6-8c8370faa6c8 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:16:45.854652 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1a2d6-015c-4e05-8ee6-8c8370faa6c8 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:16:45.854652 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1a2d6-015c-4e05-8ee6-8c8370faa6c8 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:16:45.856452 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 752/1517] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:16:45.861363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d117abe-0aef-4ab5-b84f-0b725f4ee3d7 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:16:45.861751 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d117abe-0aef-4ab5-b84f-0b725f4ee3d7 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:16:45.861929 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d117abe-0aef-4ab5-b84f-0b725f4ee3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:16:45.880866 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-2d117abe-0aef-4ab5-b84f-0b725f4ee3d7 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:16:45.882213 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-2d117abe-0aef-4ab5-b84f-0b725f4ee3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:16:45.890827 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 766/1518] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:16:46.045003 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1a2d6-015c-4e05-8ee6-8c8370faa6c8 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:16:46.059853 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1a2d6-015c-4e05-8ee6-8c8370faa6c8 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:16:46.065157 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec50878-56e4-44f9-95d7-3eabf673101b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:16:46.065778 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec50878-56e4-44f9-95d7-3eabf673101b service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:16:46.066056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec50878-56e4-44f9-95d7-3eabf673101b service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:16:46.066327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec50878-56e4-44f9-95d7-3eabf673101b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:16:46.074242 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec50878-56e4-44f9-95d7-3eabf673101b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:16:46.075814 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec50878-56e4-44f9-95d7-3eabf673101b service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:16:46.085172 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 753/1519] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:16:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:16:48.462972 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d212ad-6fbc-480d-a992-b082d2827641 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:16:48.463491 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d212ad-6fbc-480d-a992-b082d2827641 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:16:48.463621 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d212ad-6fbc-480d-a992-b082d2827641 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:16:48.465388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 767/1520] 10.222.0.52 () {54 vars in 960 bytes} [Tue Mar 8 13:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:16:48.470378 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64474ebc-7bf2-4182-8ba6-d0ed5b253719 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:16:48.470806 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64474ebc-7bf2-4182-8ba6-d0ed5b253719 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:16:48.470917 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64474ebc-7bf2-4182-8ba6-d0ed5b253719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:16:48.488917 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-64474ebc-7bf2-4182-8ba6-d0ed5b253719 None None] MFA Rules not processed for user `9b917ce4f7f34b289218f7d36a43983e`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:16:48.490089 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-64474ebc-7bf2-4182-8ba6-d0ed5b253719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:16:48.499289 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 754/1521] 10.222.0.52 () {58 vars in 1057 bytes} [Tue Mar 8 13:16:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:16:48.506689 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d212ad-6fbc-480d-a992-b082d2827641 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:16:48.519795 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d212ad-6fbc-480d-a992-b082d2827641 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:16:48.524702 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70be08b-abee-4f5f-a439-8d642c846ac6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b917ce4f7f34b289218f7d36a43983e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:16:48.525328 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70be08b-abee-4f5f-a439-8d642c846ac6 service placement] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:16:48.525610 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70be08b-abee-4f5f-a439-8d642c846ac6 service placement] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:16:48.525885 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70be08b-abee-4f5f-a439-8d642c846ac6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:16:48.533899 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70be08b-abee-4f5f-a439-8d642c846ac6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:16:48.535482 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70be08b-abee-4f5f-a439-8d642c846ac6 service placement] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:16:48.545532 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 768/1522] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:16:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:16:57.797366 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b80579-ee5a-4d56-b47d-0cf1cd6fd09d None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:16:57.797980 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b80579-ee5a-4d56-b47d-0cf1cd6fd09d None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:16:57.797980 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b80579-ee5a-4d56-b47d-0cf1cd6fd09d None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:16:57.799779 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 755/1523] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:16:57.804712 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140fa8e-cfa1-4ed5-aaba-775108a839ac None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:16:57.805291 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140fa8e-cfa1-4ed5-aaba-775108a839ac None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:16:57.805291 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140fa8e-cfa1-4ed5-aaba-775108a839ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:16:57.822826 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-b140fa8e-cfa1-4ed5-aaba-775108a839ac None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:16:57.823990 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b140fa8e-cfa1-4ed5-aaba-775108a839ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:16:57.831607 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 769/1524] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:16:57.984840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b80579-ee5a-4d56-b47d-0cf1cd6fd09d None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:16:57.999546 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b80579-ee5a-4d56-b47d-0cf1cd6fd09d None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:16:58.004837 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320ec56-9ac8-49ba-9860-56d00d9a6870 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:16:58.005461 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320ec56-9ac8-49ba-9860-56d00d9a6870 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:16:58.005741 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320ec56-9ac8-49ba-9860-56d00d9a6870 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:16:58.006017 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320ec56-9ac8-49ba-9860-56d00d9a6870 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:16:58.014434 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320ec56-9ac8-49ba-9860-56d00d9a6870 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:16:58.016033 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320ec56-9ac8-49ba-9860-56d00d9a6870 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:16:58.025267 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 756/1525] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:16:59.314143 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789f26a-46ef-4220-b85f-5849166b7af3 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:16:59.314720 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789f26a-46ef-4220-b85f-5849166b7af3 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:16:59.314720 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789f26a-46ef-4220-b85f-5849166b7af3 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:16:59.316463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 770/1526] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:16:59.321556 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab74e6-c27c-4c68-b436-78e3a67e13ab None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:16:59.322011 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab74e6-c27c-4c68-b436-78e3a67e13ab None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:16:59.322144 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab74e6-c27c-4c68-b436-78e3a67e13ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:16:59.340311 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-97ab74e6-c27c-4c68-b436-78e3a67e13ab None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:16:59.341535 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-97ab74e6-c27c-4c68-b436-78e3a67e13ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:16:59.349374 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 757/1527] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:16:59.502807 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789f26a-46ef-4220-b85f-5849166b7af3 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:16:59.517142 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789f26a-46ef-4220-b85f-5849166b7af3 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:16:59.522973 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30b513-1d04-44af-90fd-e720a636cb92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:16:59.523590 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30b513-1d04-44af-90fd-e720a636cb92 service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:16:59.523868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30b513-1d04-44af-90fd-e720a636cb92 service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:16:59.524134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30b513-1d04-44af-90fd-e720a636cb92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:16:59.531854 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30b513-1d04-44af-90fd-e720a636cb92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:16:59.533457 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30b513-1d04-44af-90fd-e720a636cb92 service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:16:59.542399 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 771/1528] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:17:04.060077 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54674da-34d9-4376-9338-c412c1cc6826 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:17:04.060705 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54674da-34d9-4376-9338-c412c1cc6826 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:17:04.060705 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54674da-34d9-4376-9338-c412c1cc6826 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:17:04.062427 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 758/1529] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:17:04.067695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfc035-fc4e-40b1-ba7e-017a65e4af1f None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:17:04.068098 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfc035-fc4e-40b1-ba7e-017a65e4af1f None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:17:04.068280 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfc035-fc4e-40b1-ba7e-017a65e4af1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:17:04.086179 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-9fcfc035-fc4e-40b1-ba7e-017a65e4af1f None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:17:04.087345 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9fcfc035-fc4e-40b1-ba7e-017a65e4af1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:17:04.095071 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 772/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:17:04.131285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54674da-34d9-4376-9338-c412c1cc6826 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:17:04.133103 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-a54674da-34d9-4376-9338-c412c1cc6826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:17:04.188681 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54674da-34d9-4376-9338-c412c1cc6826 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:17:04.192174 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29542722-2046-44c0-9de1-3501ffaab4d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:17:04.192839 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29542722-2046-44c0-9de1-3501ffaab4d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:17:04.193121 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29542722-2046-44c0-9de1-3501ffaab4d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:17:04.193425 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29542722-2046-44c0-9de1-3501ffaab4d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:17:04.202238 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29542722-2046-44c0-9de1-3501ffaab4d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:17:04.203663 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29542722-2046-44c0-9de1-3501ffaab4d8 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:17:04.213139 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 759/1531] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:17:06.525815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee85930-a973-421f-ad10-2a8ffdabe6ee None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:17:06.526401 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee85930-a973-421f-ad10-2a8ffdabe6ee None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:17:06.526401 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee85930-a973-421f-ad10-2a8ffdabe6ee None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:17:06.528145 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 773/1532] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:17:06.533287 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a130a20-ac7e-4f0b-a141-470f80f69c7b None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:17:06.533659 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a130a20-ac7e-4f0b-a141-470f80f69c7b None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:17:06.533882 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a130a20-ac7e-4f0b-a141-470f80f69c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:17:06.551721 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-3a130a20-ac7e-4f0b-a141-470f80f69c7b None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:17:06.553011 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-3a130a20-ac7e-4f0b-a141-470f80f69c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:17:06.560691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 760/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:17:06.597267 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee85930-a973-421f-ad10-2a8ffdabe6ee None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:17:06.598882 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9ee85930-a973-421f-ad10-2a8ffdabe6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:17:06.611689 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee85930-a973-421f-ad10-2a8ffdabe6ee None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:17:06.615915 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5907ae2-9f17-426f-ba36-2bd2fef7a192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:17:06.616555 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5907ae2-9f17-426f-ba36-2bd2fef7a192 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:17:06.616856 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5907ae2-9f17-426f-ba36-2bd2fef7a192 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:17:06.617128 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5907ae2-9f17-426f-ba36-2bd2fef7a192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:17:06.625701 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5907ae2-9f17-426f-ba36-2bd2fef7a192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:17:06.627125 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5907ae2-9f17-426f-ba36-2bd2fef7a192 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:17:06.637107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 774/1534] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:17:10.589961 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f67fd-e1aa-4459-bd53-7b740f9ef523 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:17:10.590544 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f67fd-e1aa-4459-bd53-7b740f9ef523 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:17:10.590544 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f67fd-e1aa-4459-bd53-7b740f9ef523 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:17:10.592325 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 761/1535] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:17:10.597574 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233d907-e4f0-43e4-bb64-0b6b78a85fc4 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:17:10.598018 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233d907-e4f0-43e4-bb64-0b6b78a85fc4 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:17:10.598123 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233d907-e4f0-43e4-bb64-0b6b78a85fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:17:10.617057 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-d233d907-e4f0-43e4-bb64-0b6b78a85fc4 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:17:10.618236 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-d233d907-e4f0-43e4-bb64-0b6b78a85fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:17:10.625844 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 775/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:17:10.879767 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f67fd-e1aa-4459-bd53-7b740f9ef523 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:17:10.881676 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-080f67fd-e1aa-4459-bd53-7b740f9ef523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:17:10.936249 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f67fd-e1aa-4459-bd53-7b740f9ef523 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:17:10.939677 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76bc83-d447-47e5-a6da-e5ddf8ce2661 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:17:10.940304 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76bc83-d447-47e5-a6da-e5ddf8ce2661 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:17:10.940585 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76bc83-d447-47e5-a6da-e5ddf8ce2661 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:17:10.940887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76bc83-d447-47e5-a6da-e5ddf8ce2661 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:17:10.950106 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76bc83-d447-47e5-a6da-e5ddf8ce2661 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:17:10.951979 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76bc83-d447-47e5-a6da-e5ddf8ce2661 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:17:10.962791 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 762/1537] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:17:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:17:13.386935 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208deeb8-212f-4c1a-8670-254369cec5c4 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:17:13.387442 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208deeb8-212f-4c1a-8670-254369cec5c4 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:17:13.387577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208deeb8-212f-4c1a-8670-254369cec5c4 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:17:13.389321 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 776/1538] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:17:13.394731 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b03db5-b13e-4396-a0fa-f19287775a59 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:17:13.395137 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b03db5-b13e-4396-a0fa-f19287775a59 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:17:13.395290 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b03db5-b13e-4396-a0fa-f19287775a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:17:13.414318 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-e2b03db5-b13e-4396-a0fa-f19287775a59 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:17:13.415510 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-e2b03db5-b13e-4396-a0fa-f19287775a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:17:13.423279 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 763/1539] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:17:13.684184 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf1004-63cc-4e9c-b8f9-11471b8f03a1 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:17:13.684467 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf1004-63cc-4e9c-b8f9-11471b8f03a1 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:17:13.684773 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf1004-63cc-4e9c-b8f9-11471b8f03a1 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:17:13.686531 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 777/1540] 10.222.0.52 () {54 vars in 963 bytes} [Tue Mar 8 13:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:17:13.691232 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af05447-9f86-44a8-9e36-4ee5a833a0ca None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:17:13.691525 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af05447-9f86-44a8-9e36-4ee5a833a0ca None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:17:13.691809 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af05447-9f86-44a8-9e36-4ee5a833a0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:17:13.710240 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-1af05447-9f86-44a8-9e36-4ee5a833a0ca None None] MFA Rules not processed for user `b9a2746615c14162be82dea409930590`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:17:13.711420 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1af05447-9f86-44a8-9e36-4ee5a833a0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:17:13.717824 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 764/1541] 10.222.0.52 () {58 vars in 1060 bytes} [Tue Mar 8 13:17:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:17:13.725833 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf1004-63cc-4e9c-b8f9-11471b8f03a1 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:17:13.736054 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf1004-63cc-4e9c-b8f9-11471b8f03a1 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:17:13.739730 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3542c35-cc1b-430d-b436-199388426954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:17:13.740355 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3542c35-cc1b-430d-b436-199388426954 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:17:13.740630 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3542c35-cc1b-430d-b436-199388426954 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:17:13.740927 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3542c35-cc1b-430d-b436-199388426954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:17:13.749466 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3542c35-cc1b-430d-b436-199388426954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:17:13.750879 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3542c35-cc1b-430d-b436-199388426954 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:17:13.760519 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 778/1542] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:17:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:18:44.673601 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e2a12-1559-4f17-a2fb-71382756ecd5 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:44.674715 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e2a12-1559-4f17-a2fb-71382756ecd5 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:44.675231 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e2a12-1559-4f17-a2fb-71382756ecd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:44.717614 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-b94e2a12-1559-4f17-a2fb-71382756ecd5 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:44.719387 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b94e2a12-1559-4f17-a2fb-71382756ecd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:44.735514 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 765/1543] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:44.744275 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920a761-11ee-45e6-9188-15fe50487d26 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:44.745945 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920a761-11ee-45e6-9188-15fe50487d26 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:44.746550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920a761-11ee-45e6-9188-15fe50487d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:44.771252 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-9920a761-11ee-45e6-9188-15fe50487d26 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:44.782756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9920a761-11ee-45e6-9188-15fe50487d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:44.782900 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c68f09-eb05-4b53-8858-cef9917e73a0 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:44.782900 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c68f09-eb05-4b53-8858-cef9917e73a0 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:44.782900 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c68f09-eb05-4b53-8858-cef9917e73a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:44.792139 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 779/1544] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:44.799708 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920a761-11ee-45e6-9188-15fe50487d26 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:44.809710 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-20c68f09-eb05-4b53-8858-cef9917e73a0 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:44.811059 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-20c68f09-eb05-4b53-8858-cef9917e73a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:44.818338 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920a761-11ee-45e6-9188-15fe50487d26 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:44.838277 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 766/1545] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:18:44.840260 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227110a7-cc7a-45a4-86dc-e15ebbae8828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:44.840260 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227110a7-cc7a-45a4-86dc-e15ebbae8828 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:44.840260 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227110a7-cc7a-45a4-86dc-e15ebbae8828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:44.840260 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227110a7-cc7a-45a4-86dc-e15ebbae8828 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:44.841009 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227110a7-cc7a-45a4-86dc-e15ebbae8828 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:18:44.841325 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227110a7-cc7a-45a4-86dc-e15ebbae8828 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:44.843990 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227110a7-cc7a-45a4-86dc-e15ebbae8828 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:44.854135 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4354ce-c4ee-442c-b838-e4df9a77105b None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:44.856856 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4354ce-c4ee-442c-b838-e4df9a77105b None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:44.857418 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4354ce-c4ee-442c-b838-e4df9a77105b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:44.883089 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 780/1546] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:18:44.897744 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227110a7-cc7a-45a4-86dc-e15ebbae8828 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:44.915104 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-1c4354ce-c4ee-442c-b838-e4df9a77105b None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:44.915345 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1c4354ce-c4ee-442c-b838-e4df9a77105b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:44.916615 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227110a7-cc7a-45a4-86dc-e15ebbae8828 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:44.929836 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d08c7-d0be-467b-880f-98761ae763d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:44.930931 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d08c7-d0be-467b-880f-98761ae763d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:44.931448 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d08c7-d0be-467b-880f-98761ae763d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:44.932020 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d08c7-d0be-467b-880f-98761ae763d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:44.933703 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d08c7-d0be-467b-880f-98761ae763d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:44.935034 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING py.warnings [None req-ad8d08c7-d0be-467b-880f-98761ae763d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:18:44.935034 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: warnings.warn(msg) Mar 08 13:18:44.935034 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: Mar 08 13:18:44.936694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d08c7-d0be-467b-880f-98761ae763d5 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:44.945376 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 767/1547] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:44.946681 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734e328-60a9-45b4-87c5-b818825b84cf None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:44.947163 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734e328-60a9-45b4-87c5-b818825b84cf None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:44.947612 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734e328-60a9-45b4-87c5-b818825b84cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:44.999775 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-2734e328-60a9-45b4-87c5-b818825b84cf None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:45.007067 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-2734e328-60a9-45b4-87c5-b818825b84cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:45.036323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 768/1548] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:45.037631 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734e328-60a9-45b4-87c5-b818825b84cf None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:45.054880 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 781/1549] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:18:44 2022] POST /identity/v3/projects => generated 391 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:45.060074 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f382f8-cf90-4361-9938-68b2f98678e4 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.060587 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f382f8-cf90-4361-9938-68b2f98678e4 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.060956 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f382f8-cf90-4361-9938-68b2f98678e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.061107 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734e328-60a9-45b4-87c5-b818825b84cf None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:45.105981 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-68f382f8-cf90-4361-9938-68b2f98678e4 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:45.105981 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-68f382f8-cf90-4361-9938-68b2f98678e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:45.185100 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93bf01-2839-4f2c-a5ca-6224a42c27d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:45.185874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93bf01-2839-4f2c-a5ca-6224a42c27d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.186223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93bf01-2839-4f2c-a5ca-6224a42c27d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.186574 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93bf01-2839-4f2c-a5ca-6224a42c27d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.187398 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93bf01-2839-4f2c-a5ca-6224a42c27d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:18:45.187776 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93bf01-2839-4f2c-a5ca-6224a42c27d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:45.188907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING py.warnings [None req-9b93bf01-2839-4f2c-a5ca-6224a42c27d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:18:45.188907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: warnings.warn(msg) Mar 08 13:18:45.188907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: Mar 08 13:18:45.189924 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93bf01-2839-4f2c-a5ca-6224a42c27d0 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:45.208281 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 769/1550] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:18:45.210725 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0a0cd-5276-4779-aa3f-ed71a64dc502 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.215137 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0a0cd-5276-4779-aa3f-ed71a64dc502 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.215542 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0a0cd-5276-4779-aa3f-ed71a64dc502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.224757 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 782/1551] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:45.225608 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f382f8-cf90-4361-9938-68b2f98678e4 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:45.240692 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f382f8-cf90-4361-9938-68b2f98678e4 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:45.246595 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-0ce0a0cd-5276-4779-aa3f-ed71a64dc502 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:45.246850 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ccb63-c716-4c75-9ff1-487d174a14a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:45.247527 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ccb63-c716-4c75-9ff1-487d174a14a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.247814 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ccb63-c716-4c75-9ff1-487d174a14a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.247926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-0ce0a0cd-5276-4779-aa3f-ed71a64dc502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:45.248123 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ccb63-c716-4c75-9ff1-487d174a14a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.248862 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ccb63-c716-4c75-9ff1-487d174a14a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:45.250817 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ccb63-c716-4c75-9ff1-487d174a14a2 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:45.255704 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 770/1552] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:45.256956 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d32157-8999-4e76-8dd7-1547a378d279 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.257251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d32157-8999-4e76-8dd7-1547a378d279 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.257529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d32157-8999-4e76-8dd7-1547a378d279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.275723 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-b2d32157-8999-4e76-8dd7-1547a378d279 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:45.277094 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b2d32157-8999-4e76-8dd7-1547a378d279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:45.284963 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 771/1553] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:45.286253 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef9be9-9dcd-4df3-a0a9-c1ba5740a54d None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.286574 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef9be9-9dcd-4df3-a0a9-c1ba5740a54d None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.286826 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef9be9-9dcd-4df3-a0a9-c1ba5740a54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.304898 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-1bef9be9-9dcd-4df3-a0a9-c1ba5740a54d None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:45.306085 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1bef9be9-9dcd-4df3-a0a9-c1ba5740a54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:45.314679 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 772/1554] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:45.315856 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ef581-67cd-43b4-a052-716d8ed31761 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.316150 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ef581-67cd-43b4-a052-716d8ed31761 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.316429 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ef581-67cd-43b4-a052-716d8ed31761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.334752 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-dc4ef581-67cd-43b4-a052-716d8ed31761 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:45.336003 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-dc4ef581-67cd-43b4-a052-716d8ed31761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:45.345674 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 773/1555] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:45.345674 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339266cc-2d78-417a-a62b-23d5a6d53ca0 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.345674 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339266cc-2d78-417a-a62b-23d5a6d53ca0 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.348701 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339266cc-2d78-417a-a62b-23d5a6d53ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.364752 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-339266cc-2d78-417a-a62b-23d5a6d53ca0 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:45.365985 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-339266cc-2d78-417a-a62b-23d5a6d53ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:45.374735 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 774/1556] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:45.375466 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339266cc-2d78-417a-a62b-23d5a6d53ca0 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:45.384569 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339266cc-2d78-417a-a62b-23d5a6d53ca0 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:45.385955 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 783/1557] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:18:45 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:45.387256 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076e9c9-f334-4066-8090-e4378e9d5fc0 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.387541 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076e9c9-f334-4066-8090-e4378e9d5fc0 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.387958 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076e9c9-f334-4066-8090-e4378e9d5fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.389808 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb87307-7259-48dc-8c8d-245b25d915c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:45.390458 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb87307-7259-48dc-8c8d-245b25d915c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.390743 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb87307-7259-48dc-8c8d-245b25d915c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.391019 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb87307-7259-48dc-8c8d-245b25d915c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.391699 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb87307-7259-48dc-8c8d-245b25d915c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:45.393659 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb87307-7259-48dc-8c8d-245b25d915c6 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:45.406863 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-5076e9c9-f334-4066-8090-e4378e9d5fc0 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:45.408060 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-5076e9c9-f334-4066-8090-e4378e9d5fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:45.415770 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 784/1558] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:45.423132 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076e9c9-f334-4066-8090-e4378e9d5fc0 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:45.426481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076e9c9-f334-4066-8090-e4378e9d5fc0 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:45.430870 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7261f-1ad3-483f-9c5b-e248997013a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:45.431499 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7261f-1ad3-483f-9c5b-e248997013a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.431781 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7261f-1ad3-483f-9c5b-e248997013a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.432053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7261f-1ad3-483f-9c5b-e248997013a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.433439 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7261f-1ad3-483f-9c5b-e248997013a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:18:45.433739 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7261f-1ad3-483f-9c5b-e248997013a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:45.435414 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7261f-1ad3-483f-9c5b-e248997013a9 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:45.446611 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 785/1559] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:18:45.447904 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbdae5-b434-4e00-8fb7-7c36e6a5a7eb None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.448222 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbdae5-b434-4e00-8fb7-7c36e6a5a7eb None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.448491 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbdae5-b434-4e00-8fb7-7c36e6a5a7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.466694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-e5fbdae5-b434-4e00-8fb7-7c36e6a5a7eb None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:45.475943 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e5fbdae5-b434-4e00-8fb7-7c36e6a5a7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:45.476319 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 786/1560] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:45.477628 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02f186-307f-4553-95c8-bc1a531a6fcc None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.477915 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02f186-307f-4553-95c8-bc1a531a6fcc None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.478198 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02f186-307f-4553-95c8-bc1a531a6fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.498548 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-9c02f186-307f-4553-95c8-bc1a531a6fcc None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:45.499755 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9c02f186-307f-4553-95c8-bc1a531a6fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:45.504070 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 775/1561] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:18:45 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:45.504070 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d236d0-aec4-4464-866a-68846e94375a None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.504070 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d236d0-aec4-4464-866a-68846e94375a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.504070 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d236d0-aec4-4464-866a-68846e94375a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.521722 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-82d236d0-aec4-4464-866a-68846e94375a None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:45.522917 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-82d236d0-aec4-4464-866a-68846e94375a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:45.572190 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 787/1562] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:45.573591 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb1ad0-bfb8-4501-b06d-acfa90f73bce None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.573875 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb1ad0-bfb8-4501-b06d-acfa90f73bce None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.574151 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb1ad0-bfb8-4501-b06d-acfa90f73bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.593539 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-7bcb1ad0-bfb8-4501-b06d-acfa90f73bce None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:45.594742 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-7bcb1ad0-bfb8-4501-b06d-acfa90f73bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:45.595157 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 776/1563] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:45.595993 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d236d0-aec4-4464-866a-68846e94375a None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:45.602889 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 788/1564] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:45.603790 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb1ad0-bfb8-4501-b06d-acfa90f73bce None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:45.605714 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d236d0-aec4-4464-866a-68846e94375a None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:45.611966 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e6976-98d7-467e-86d4-8c10063f22c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:45.612689 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e6976-98d7-467e-86d4-8c10063f22c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.612995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e6976-98d7-467e-86d4-8c10063f22c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.613363 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e6976-98d7-467e-86d4-8c10063f22c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.614092 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e6976-98d7-467e-86d4-8c10063f22c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:45.615779 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e6976-98d7-467e-86d4-8c10063f22c4 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:45.617229 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb1ad0-bfb8-4501-b06d-acfa90f73bce None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:45.622033 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c2efb-71ee-488a-99e0-f69d17fb5c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:45.622683 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c2efb-71ee-488a-99e0-f69d17fb5c60 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.622994 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c2efb-71ee-488a-99e0-f69d17fb5c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.623243 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c2efb-71ee-488a-99e0-f69d17fb5c60 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.623964 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c2efb-71ee-488a-99e0-f69d17fb5c60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:18:45.624266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c2efb-71ee-488a-99e0-f69d17fb5c60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:45.625888 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c2efb-71ee-488a-99e0-f69d17fb5c60 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:45.626807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 777/1565] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:45.627666 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e6976-98d7-467e-86d4-8c10063f22c4 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:45.637553 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 789/1566] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:18:45.637859 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e6976-98d7-467e-86d4-8c10063f22c4 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:45.638359 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c2efb-71ee-488a-99e0-f69d17fb5c60 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:45.642856 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce5b2f-b87c-4541-9488-59fc98872830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:45.643508 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce5b2f-b87c-4541-9488-59fc98872830 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.643796 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce5b2f-b87c-4541-9488-59fc98872830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.644076 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce5b2f-b87c-4541-9488-59fc98872830 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.644992 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce5b2f-b87c-4541-9488-59fc98872830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:45.646787 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce5b2f-b87c-4541-9488-59fc98872830 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:45.647847 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c2efb-71ee-488a-99e0-f69d17fb5c60 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:45.653242 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f895d-ed3f-4b51-a179-dbfc7713e519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:45.653879 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f895d-ed3f-4b51-a179-dbfc7713e519 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.654156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f895d-ed3f-4b51-a179-dbfc7713e519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.654427 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f895d-ed3f-4b51-a179-dbfc7713e519 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.655135 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f895d-ed3f-4b51-a179-dbfc7713e519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:18:45.655441 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f895d-ed3f-4b51-a179-dbfc7713e519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:45.657047 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f895d-ed3f-4b51-a179-dbfc7713e519 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:45.669159 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 790/1567] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:18:45.670363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f895d-ed3f-4b51-a179-dbfc7713e519 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:45.679454 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f895d-ed3f-4b51-a179-dbfc7713e519 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:45.684298 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c438c8-f772-4cac-8969-f7de9928f70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:45.684970 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c438c8-f772-4cac-8969-f7de9928f70b admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.685252 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c438c8-f772-4cac-8969-f7de9928f70b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.685579 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c438c8-f772-4cac-8969-f7de9928f70b admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.686213 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c438c8-f772-4cac-8969-f7de9928f70b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:45.688118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c438c8-f772-4cac-8969-f7de9928f70b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:45.728350 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 778/1568] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:18:45 2022] POST /identity/v3/projects => generated 403 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:45.729928 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce5b2f-b87c-4541-9488-59fc98872830 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:45.779588 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 791/1569] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:18:45 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:45.780459 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c438c8-f772-4cac-8969-f7de9928f70b admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:45.788367 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce5b2f-b87c-4541-9488-59fc98872830 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:45.789834 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c438c8-f772-4cac-8969-f7de9928f70b admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:45.793818 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69500607-1a3c-40e1-9a45-6e33ca27bf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:45.794469 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69500607-1a3c-40e1-9a45-6e33ca27bf85 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.794748 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69500607-1a3c-40e1-9a45-6e33ca27bf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.795025 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69500607-1a3c-40e1-9a45-6e33ca27bf85 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.795146 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7264c-ce46-4a1f-bbc7-8625c8110ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:45.795702 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7264c-ce46-4a1f-bbc7-8625c8110ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.795838 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69500607-1a3c-40e1-9a45-6e33ca27bf85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:18:45.795987 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7264c-ce46-4a1f-bbc7-8625c8110ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.796096 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69500607-1a3c-40e1-9a45-6e33ca27bf85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:45.796264 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7264c-ce46-4a1f-bbc7-8625c8110ac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.797015 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7264c-ce46-4a1f-bbc7-8625c8110ac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:18:45.797323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7264c-ce46-4a1f-bbc7-8625c8110ac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:45.797875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69500607-1a3c-40e1-9a45-6e33ca27bf85 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:45.798899 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7264c-ce46-4a1f-bbc7-8625c8110ac9 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:45.809640 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 779/1570] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:18:45.810530 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69500607-1a3c-40e1-9a45-6e33ca27bf85 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:45.817835 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 792/1571] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:18:45.820583 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7264c-ce46-4a1f-bbc7-8625c8110ac9 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:45.821279 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69500607-1a3c-40e1-9a45-6e33ca27bf85 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:45.826931 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01127d99-d8fa-4e6c-9f80-7e30b05dc92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:45.829482 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01127d99-d8fa-4e6c-9f80-7e30b05dc92e admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.829482 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01127d99-d8fa-4e6c-9f80-7e30b05dc92e admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.829482 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01127d99-d8fa-4e6c-9f80-7e30b05dc92e admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.829482 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01127d99-d8fa-4e6c-9f80-7e30b05dc92e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:18:45.829482 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01127d99-d8fa-4e6c-9f80-7e30b05dc92e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:45.830809 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01127d99-d8fa-4e6c-9f80-7e30b05dc92e admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:45.836006 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7264c-ce46-4a1f-bbc7-8625c8110ac9 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:45.841278 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98483e6-9721-4714-860d-a7340b75b8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:45.841933 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98483e6-9721-4714-860d-a7340b75b8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.842214 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98483e6-9721-4714-860d-a7340b75b8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.842489 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98483e6-9721-4714-860d-a7340b75b8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.843231 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98483e6-9721-4714-860d-a7340b75b8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:45.843949 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 780/1572] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:18:45.844645 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01127d99-d8fa-4e6c-9f80-7e30b05dc92e admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:45.845058 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98483e6-9721-4714-860d-a7340b75b8e7 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:45.855493 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 793/1573] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:45.856412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98483e6-9721-4714-860d-a7340b75b8e7 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:45.858270 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01127d99-d8fa-4e6c-9f80-7e30b05dc92e admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:45.863211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a7c79-da7b-4700-a498-658a60b525ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:45.863861 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a7c79-da7b-4700-a498-658a60b525ee admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.864146 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a7c79-da7b-4700-a498-658a60b525ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.864424 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a7c79-da7b-4700-a498-658a60b525ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.865154 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a7c79-da7b-4700-a498-658a60b525ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:45.866070 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98483e6-9721-4714-860d-a7340b75b8e7 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:45.867060 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a7c79-da7b-4700-a498-658a60b525ee admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:45.870766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4aa89d-2170-4914-9d2c-c18e21fb275f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:45.871396 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4aa89d-2170-4914-9d2c-c18e21fb275f admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:45.871681 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4aa89d-2170-4914-9d2c-c18e21fb275f admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:45.872074 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4aa89d-2170-4914-9d2c-c18e21fb275f admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:45.872734 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4aa89d-2170-4914-9d2c-c18e21fb275f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:45.874613 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4aa89d-2170-4914-9d2c-c18e21fb275f admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:45.972308 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 781/1574] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:18:45 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:45.972308 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a7c79-da7b-4700-a498-658a60b525ee admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:45.997590 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 794/1575] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:18:45 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:45.998548 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4aa89d-2170-4914-9d2c-c18e21fb275f admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:46.033129 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a7c79-da7b-4700-a498-658a60b525ee admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:46.059513 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4aa89d-2170-4914-9d2c-c18e21fb275f admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:46.065275 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d64b7-dc79-45fd-9068-3a3141b9f0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:46.065940 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d64b7-dc79-45fd-9068-3a3141b9f0de admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:46.066218 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d64b7-dc79-45fd-9068-3a3141b9f0de admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:46.066492 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d64b7-dc79-45fd-9068-3a3141b9f0de admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:46.067216 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d64b7-dc79-45fd-9068-3a3141b9f0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:46.068877 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d64b7-dc79-45fd-9068-3a3141b9f0de admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:46.080060 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 795/1576] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:46.080414 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d64b7-dc79-45fd-9068-3a3141b9f0de admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:46.090507 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d64b7-dc79-45fd-9068-3a3141b9f0de admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:46.095072 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f51f0c-a1a3-4afc-958a-1e9af7bc37c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:46.095693 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f51f0c-a1a3-4afc-958a-1e9af7bc37c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:46.095813 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973badb5-d58e-4e84-8473-677ccfb662b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:46.095972 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f51f0c-a1a3-4afc-958a-1e9af7bc37c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:46.096244 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f51f0c-a1a3-4afc-958a-1e9af7bc37c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:46.096437 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973badb5-d58e-4e84-8473-677ccfb662b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:46.096747 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973badb5-d58e-4e84-8473-677ccfb662b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:46.096950 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f51f0c-a1a3-4afc-958a-1e9af7bc37c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:46.097061 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973badb5-d58e-4e84-8473-677ccfb662b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:46.097680 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973badb5-d58e-4e84-8473-677ccfb662b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:46.098682 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING py.warnings [None req-973badb5-d58e-4e84-8473-677ccfb662b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:18:46.098682 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: warnings.warn(msg) Mar 08 13:18:46.098682 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: Mar 08 13:18:46.098933 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f51f0c-a1a3-4afc-958a-1e9af7bc37c6 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:46.099878 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973badb5-d58e-4e84-8473-677ccfb662b8 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:46.210319 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 782/1577] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:18:45 2022] POST /identity/v3/users => generated 302 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:46.211275 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973badb5-d58e-4e84-8473-677ccfb662b8 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:46.221323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 796/1578] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:18:46 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:46.223727 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973badb5-d58e-4e84-8473-677ccfb662b8 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:46.223852 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f51f0c-a1a3-4afc-958a-1e9af7bc37c6 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:46.274575 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fd71f-b0ba-41dc-a83a-dc0a6e21ebcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:46.275231 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fd71f-b0ba-41dc-a83a-dc0a6e21ebcf admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:46.275511 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fd71f-b0ba-41dc-a83a-dc0a6e21ebcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:46.275814 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fd71f-b0ba-41dc-a83a-dc0a6e21ebcf admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:46.276898 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fd71f-b0ba-41dc-a83a-dc0a6e21ebcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:46.278847 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fd71f-b0ba-41dc-a83a-dc0a6e21ebcf admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:46.279776 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f51f0c-a1a3-4afc-958a-1e9af7bc37c6 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:46.284158 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21618d7b-75bc-4dd6-b897-a80649d90337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:46.284835 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21618d7b-75bc-4dd6-b897-a80649d90337 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:46.285145 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21618d7b-75bc-4dd6-b897-a80649d90337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:46.285413 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21618d7b-75bc-4dd6-b897-a80649d90337 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:46.286093 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21618d7b-75bc-4dd6-b897-a80649d90337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:46.287969 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21618d7b-75bc-4dd6-b897-a80649d90337 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:46.384240 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 783/1579] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:18:46 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:46.385112 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fd71f-b0ba-41dc-a83a-dc0a6e21ebcf admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:46.411676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 797/1580] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:18:46 2022] POST /identity/v3/projects => generated 405 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:46.411676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21618d7b-75bc-4dd6-b897-a80649d90337 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:46.445647 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fd71f-b0ba-41dc-a83a-dc0a6e21ebcf admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:46.473252 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21618d7b-75bc-4dd6-b897-a80649d90337 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:46.478156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7a56b-c73a-4848-aee0-e08f64077ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:46.478759 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7a56b-c73a-4848-aee0-e08f64077ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:46.479041 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7a56b-c73a-4848-aee0-e08f64077ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:46.479325 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7a56b-c73a-4848-aee0-e08f64077ff2 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:46.480289 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7a56b-c73a-4848-aee0-e08f64077ff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:46.482248 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7a56b-c73a-4848-aee0-e08f64077ff2 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:46.499550 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ace58-a4c6-4a5e-8fcc-2372737720b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:46.500432 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ace58-a4c6-4a5e-8fcc-2372737720b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:46.500742 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ace58-a4c6-4a5e-8fcc-2372737720b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:46.501020 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ace58-a4c6-4a5e-8fcc-2372737720b7 admin admin] PATH_INFO: `/v3/projects/e18e69f500fe484994f99d9e8b599b78/users/658d1271fb264cb59e62a921492457c2/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:46.515335 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ace58-a4c6-4a5e-8fcc-2372737720b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18e69f500fe484994f99d9e8b599b78, user_id=658d1271fb264cb59e62a921492457c2, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:46.518120 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ace58-a4c6-4a5e-8fcc-2372737720b7 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:46.570802 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 798/1581] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:18:46 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:46.571784 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7a56b-c73a-4848-aee0-e08f64077ff2 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:46.581808 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7a56b-c73a-4848-aee0-e08f64077ff2 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:46.586365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175b982-cc94-4fea-944a-05a333fc093a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:46.587100 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175b982-cc94-4fea-944a-05a333fc093a admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:46.587386 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175b982-cc94-4fea-944a-05a333fc093a admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:46.587663 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175b982-cc94-4fea-944a-05a333fc093a admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:46.588379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175b982-cc94-4fea-944a-05a333fc093a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:46.590656 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175b982-cc94-4fea-944a-05a333fc093a admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:46.599285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 784/1582] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:18:46 2022] PUT /identity/v3/projects/e18e69f500fe484994f99d9e8b599b78/users/658d1271fb264cb59e62a921492457c2/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:46.600134 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ace58-a4c6-4a5e-8fcc-2372737720b7 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:46.658312 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ace58-a4c6-4a5e-8fcc-2372737720b7 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:46.662841 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fe0ef-20b6-42b9-9af9-0cabce50beb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:46.663518 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fe0ef-20b6-42b9-9af9-0cabce50beb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:46.663802 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fe0ef-20b6-42b9-9af9-0cabce50beb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:46.664075 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fe0ef-20b6-42b9-9af9-0cabce50beb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:46.664824 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fe0ef-20b6-42b9-9af9-0cabce50beb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:46.666426 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fe0ef-20b6-42b9-9af9-0cabce50beb5 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:46.673763 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 799/1583] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:18:46 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:46.674861 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175b982-cc94-4fea-944a-05a333fc093a admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:46.679923 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 785/1584] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:46.680776 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fe0ef-20b6-42b9-9af9-0cabce50beb5 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:46.685495 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175b982-cc94-4fea-944a-05a333fc093a admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:46.690268 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82530e9e-0fcd-4793-b141-cd8503e90eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:46.690808 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fe0ef-20b6-42b9-9af9-0cabce50beb5 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:46.691166 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82530e9e-0fcd-4793-b141-cd8503e90eca admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:46.691538 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82530e9e-0fcd-4793-b141-cd8503e90eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:46.691914 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82530e9e-0fcd-4793-b141-cd8503e90eca admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:46.692776 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82530e9e-0fcd-4793-b141-cd8503e90eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:46.694531 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82530e9e-0fcd-4793-b141-cd8503e90eca admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:46.695272 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f8262-953c-4d10-bd96-fc45d0c70b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:46.695998 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f8262-953c-4d10-bd96-fc45d0c70b59 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:46.696279 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f8262-953c-4d10-bd96-fc45d0c70b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:46.696549 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f8262-953c-4d10-bd96-fc45d0c70b59 admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:46.697245 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f8262-953c-4d10-bd96-fc45d0c70b59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:46.699250 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f8262-953c-4d10-bd96-fc45d0c70b59 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:46.705356 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 800/1585] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:46.706196 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82530e9e-0fcd-4793-b141-cd8503e90eca admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:46.715774 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82530e9e-0fcd-4793-b141-cd8503e90eca admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:46.721696 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba6d40-702f-47c1-8b65-3f2bd6e697b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:46.721696 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba6d40-702f-47c1-8b65-3f2bd6e697b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:46.721696 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba6d40-702f-47c1-8b65-3f2bd6e697b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:46.721696 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba6d40-702f-47c1-8b65-3f2bd6e697b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:46.722310 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba6d40-702f-47c1-8b65-3f2bd6e697b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:46.724197 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba6d40-702f-47c1-8b65-3f2bd6e697b8 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:46.807323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 786/1586] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:18:46 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:46.808300 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f8262-953c-4d10-bd96-fc45d0c70b59 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:46.817526 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f8262-953c-4d10-bd96-fc45d0c70b59 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:46.822071 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f88f5f-d863-47c0-97c3-14d38b4edaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:46.822696 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f88f5f-d863-47c0-97c3-14d38b4edaec admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:46.823500 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f88f5f-d863-47c0-97c3-14d38b4edaec admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:46.823780 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f88f5f-d863-47c0-97c3-14d38b4edaec admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:46.824477 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f88f5f-d863-47c0-97c3-14d38b4edaec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:46.826433 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f88f5f-d863-47c0-97c3-14d38b4edaec admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:46.847028 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 801/1587] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:18:46 2022] POST /identity/v3/users => generated 290 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:46.850657 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba6d40-702f-47c1-8b65-3f2bd6e697b8 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:46.857445 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba6d40-702f-47c1-8b65-3f2bd6e697b8 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:46.862097 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4228358-ab83-4565-898d-9a9617c1dcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:46.862720 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228358-ab83-4565-898d-9a9617c1dcbb admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:46.862998 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228358-ab83-4565-898d-9a9617c1dcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:46.863266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228358-ab83-4565-898d-9a9617c1dcbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:46.863967 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4228358-ab83-4565-898d-9a9617c1dcbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:46.865568 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4228358-ab83-4565-898d-9a9617c1dcbb admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:46.875511 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 802/1588] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:46.876821 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389468ea-8977-40bf-9de2-889508b6901c None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:46.877105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389468ea-8977-40bf-9de2-889508b6901c None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:46.877379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389468ea-8977-40bf-9de2-889508b6901c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:46.893605 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-389468ea-8977-40bf-9de2-889508b6901c None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:46.894767 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-389468ea-8977-40bf-9de2-889508b6901c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:46.902597 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 803/1589] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:46.903468 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389468ea-8977-40bf-9de2-889508b6901c None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:46.912522 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389468ea-8977-40bf-9de2-889508b6901c None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:46.917310 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00de3e-7251-4bb3-9099-a876004c9546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:46.918013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00de3e-7251-4bb3-9099-a876004c9546 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:46.918958 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00de3e-7251-4bb3-9099-a876004c9546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:46.919280 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00de3e-7251-4bb3-9099-a876004c9546 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:46.920050 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00de3e-7251-4bb3-9099-a876004c9546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:46.921676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00de3e-7251-4bb3-9099-a876004c9546 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:46.931394 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 804/1590] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:46.932136 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00de3e-7251-4bb3-9099-a876004c9546 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:46.941888 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00de3e-7251-4bb3-9099-a876004c9546 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:46.947191 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 787/1591] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:18:46 2022] POST /identity/v3/users => generated 303 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:46.947191 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f88f5f-d863-47c0-97c3-14d38b4edaec admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:46.950347 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff25b43-3ee8-42a7-9e51-8d5719f580fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:46.951216 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff25b43-3ee8-42a7-9e51-8d5719f580fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:46.951494 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff25b43-3ee8-42a7-9e51-8d5719f580fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:46.951770 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff25b43-3ee8-42a7-9e51-8d5719f580fc admin admin] PATH_INFO: `/v3/projects/500118b8b6da4bba959c36961a149a19/users/ced48ea897124de6b874e797b6d74f3d/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:46.957360 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f88f5f-d863-47c0-97c3-14d38b4edaec admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:46.961867 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98660c-20a4-482e-b42f-6e2668dfdcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:46.962507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98660c-20a4-482e-b42f-6e2668dfdcdf admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:46.962785 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98660c-20a4-482e-b42f-6e2668dfdcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:46.963057 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98660c-20a4-482e-b42f-6e2668dfdcdf admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:46.963937 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98660c-20a4-482e-b42f-6e2668dfdcdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:46.965565 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98660c-20a4-482e-b42f-6e2668dfdcdf admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:46.967264 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff25b43-3ee8-42a7-9e51-8d5719f580fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=500118b8b6da4bba959c36961a149a19, user_id=ced48ea897124de6b874e797b6d74f3d, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:46.968295 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING py.warnings [None req-dff25b43-3ee8-42a7-9e51-8d5719f580fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:18:46.968295 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: warnings.warn(msg) Mar 08 13:18:46.968295 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: Mar 08 13:18:46.970293 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff25b43-3ee8-42a7-9e51-8d5719f580fc admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:46.975743 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 788/1592] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:46.976717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98660c-20a4-482e-b42f-6e2668dfdcdf admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:46.986253 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98660c-20a4-482e-b42f-6e2668dfdcdf admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:46.990655 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ee3d3-bacd-4f3f-9bb3-52bd4357beb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:46.991271 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ee3d3-bacd-4f3f-9bb3-52bd4357beb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:46.991553 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ee3d3-bacd-4f3f-9bb3-52bd4357beb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:46.991824 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ee3d3-bacd-4f3f-9bb3-52bd4357beb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:46.992521 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ee3d3-bacd-4f3f-9bb3-52bd4357beb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:46.994146 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ee3d3-bacd-4f3f-9bb3-52bd4357beb5 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:47.004207 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 789/1593] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:47.005154 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ee3d3-bacd-4f3f-9bb3-52bd4357beb5 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:47.015110 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ee3d3-bacd-4f3f-9bb3-52bd4357beb5 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:47.019502 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8b337-195d-4f53-af19-71899a5a23d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:47.020086 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8b337-195d-4f53-af19-71899a5a23d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.020367 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8b337-195d-4f53-af19-71899a5a23d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.020638 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8b337-195d-4f53-af19-71899a5a23d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:47.021338 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8b337-195d-4f53-af19-71899a5a23d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:47.022882 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8b337-195d-4f53-af19-71899a5a23d5 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:47.033072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 790/1594] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:47.033991 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8b337-195d-4f53-af19-71899a5a23d5 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:47.043191 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8b337-195d-4f53-af19-71899a5a23d5 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:47.047974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 805/1595] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:18:46 2022] PUT /identity/v3/projects/500118b8b6da4bba959c36961a149a19/users/ced48ea897124de6b874e797b6d74f3d/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:47.048958 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff25b43-3ee8-42a7-9e51-8d5719f580fc admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:47.098590 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f51f4-9862-4c2c-af52-3643b71bf983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:47.099217 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f51f4-9862-4c2c-af52-3643b71bf983 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.099507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f51f4-9862-4c2c-af52-3643b71bf983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.099785 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f51f4-9862-4c2c-af52-3643b71bf983 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:47.100515 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f51f4-9862-4c2c-af52-3643b71bf983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:47.102286 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f51f4-9862-4c2c-af52-3643b71bf983 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:47.108471 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff25b43-3ee8-42a7-9e51-8d5719f580fc admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:47.111983 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae3368-c2ef-4fdc-81f0-62787ce2ae89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:47.112324 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 791/1596] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:47.112687 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae3368-c2ef-4fdc-81f0-62787ce2ae89 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.116567 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae3368-c2ef-4fdc-81f0-62787ce2ae89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.116705 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f51f4-9862-4c2c-af52-3643b71bf983 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:47.116810 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae3368-c2ef-4fdc-81f0-62787ce2ae89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:47.123258 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae3368-c2ef-4fdc-81f0-62787ce2ae89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:47.124246 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f51f4-9862-4c2c-af52-3643b71bf983 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:47.124722 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae3368-c2ef-4fdc-81f0-62787ce2ae89 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:47.128969 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f18bd-0583-42f8-84b9-d8f9a1a5b827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:47.129608 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f18bd-0583-42f8-84b9-d8f9a1a5b827 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.129886 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f18bd-0583-42f8-84b9-d8f9a1a5b827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.130158 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f18bd-0583-42f8-84b9-d8f9a1a5b827 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:47.130892 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f18bd-0583-42f8-84b9-d8f9a1a5b827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:47.132516 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f18bd-0583-42f8-84b9-d8f9a1a5b827 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:47.133972 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 806/1597] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:18:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:18:47.134816 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae3368-c2ef-4fdc-81f0-62787ce2ae89 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:47.145463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae3368-c2ef-4fdc-81f0-62787ce2ae89 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:47.145590 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 792/1598] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:47.145827 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f18bd-0583-42f8-84b9-d8f9a1a5b827 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:47.155440 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228748da-a3ff-4f4e-812b-31046d68e977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:47.156402 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228748da-a3ff-4f4e-812b-31046d68e977 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.156786 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228748da-a3ff-4f4e-812b-31046d68e977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.157053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228748da-a3ff-4f4e-812b-31046d68e977 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:47.157932 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228748da-a3ff-4f4e-812b-31046d68e977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:47.158471 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f18bd-0583-42f8-84b9-d8f9a1a5b827 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:47.159762 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228748da-a3ff-4f4e-812b-31046d68e977 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:47.163109 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d1786-2029-4508-a82b-abf5f45a4108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:47.164066 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d1786-2029-4508-a82b-abf5f45a4108 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.164250 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d1786-2029-4508-a82b-abf5f45a4108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.164511 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d1786-2029-4508-a82b-abf5f45a4108 admin admin] PATH_INFO: `/v3/projects/8d013f7d765545429b9f5f7204af9e22/users/d3e11eebb9874367bc98012fc546f06f/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:47.173851 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 807/1599] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:47.173851 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228748da-a3ff-4f4e-812b-31046d68e977 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:47.179209 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d1786-2029-4508-a82b-abf5f45a4108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d013f7d765545429b9f5f7204af9e22, user_id=d3e11eebb9874367bc98012fc546f06f, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:47.181925 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d1786-2029-4508-a82b-abf5f45a4108 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:47.184064 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228748da-a3ff-4f4e-812b-31046d68e977 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:47.188707 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60674c94-12d0-4672-8e80-e575e80f4304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:47.189344 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60674c94-12d0-4672-8e80-e575e80f4304 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.189652 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60674c94-12d0-4672-8e80-e575e80f4304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.189926 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60674c94-12d0-4672-8e80-e575e80f4304 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:47.190673 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60674c94-12d0-4672-8e80-e575e80f4304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:47.192217 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60674c94-12d0-4672-8e80-e575e80f4304 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:47.202665 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 808/1600] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:47.203539 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60674c94-12d0-4672-8e80-e575e80f4304 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:47.212908 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60674c94-12d0-4672-8e80-e575e80f4304 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:47.217710 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1419f2-d098-45fd-b9dc-e667ddbc01f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:47.218340 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1419f2-d098-45fd-b9dc-e667ddbc01f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.218616 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1419f2-d098-45fd-b9dc-e667ddbc01f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.218883 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1419f2-d098-45fd-b9dc-e667ddbc01f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:47.219585 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1419f2-d098-45fd-b9dc-e667ddbc01f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:47.221182 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1419f2-d098-45fd-b9dc-e667ddbc01f2 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:47.231879 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 809/1601] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:47.236312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60a68b-c222-4d22-a2a8-7932216545a3 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.236312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60a68b-c222-4d22-a2a8-7932216545a3 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.236312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60a68b-c222-4d22-a2a8-7932216545a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:47.251444 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-8b60a68b-c222-4d22-a2a8-7932216545a3 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:47.252630 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-8b60a68b-c222-4d22-a2a8-7932216545a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:47.261517 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 810/1602] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:47.270983 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60a68b-c222-4d22-a2a8-7932216545a3 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:47.271117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 793/1603] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:18:47 2022] PUT /identity/v3/projects/8d013f7d765545429b9f5f7204af9e22/users/d3e11eebb9874367bc98012fc546f06f/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:47.271117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d1786-2029-4508-a82b-abf5f45a4108 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:47.272496 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60a68b-c222-4d22-a2a8-7932216545a3 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:47.334192 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d1786-2029-4508-a82b-abf5f45a4108 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:47.335426 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474f984-3710-454f-a10c-2fbb2c6848ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:47.336313 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474f984-3710-454f-a10c-2fbb2c6848ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.336592 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474f984-3710-454f-a10c-2fbb2c6848ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.336898 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474f984-3710-454f-a10c-2fbb2c6848ed admin admin] PATH_INFO: `/v3/projects/b1ba32b69cba4ba49a77d7b135efd0d1/users/6d322b32be774f5796557c05626e994e/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:47.338924 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dd4ce-c609-4900-891f-bbd7409c46f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:47.339825 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dd4ce-c609-4900-891f-bbd7409c46f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.340109 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dd4ce-c609-4900-891f-bbd7409c46f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.340384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dd4ce-c609-4900-891f-bbd7409c46f9 admin admin] PATH_INFO: `/v3/projects/754e7f374dfc4e1f9067b86fdc0cb279/users/728607c7138540d69532b0b806b9ccaf/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:47.351995 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474f984-3710-454f-a10c-2fbb2c6848ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ba32b69cba4ba49a77d7b135efd0d1, user_id=6d322b32be774f5796557c05626e994e, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:47.355179 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dd4ce-c609-4900-891f-bbd7409c46f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=754e7f374dfc4e1f9067b86fdc0cb279, user_id=728607c7138540d69532b0b806b9ccaf, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:47.355556 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474f984-3710-454f-a10c-2fbb2c6848ed admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:47.358235 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dd4ce-c609-4900-891f-bbd7409c46f9 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:47.447738 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 811/1604] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:18:47 2022] PUT /identity/v3/projects/b1ba32b69cba4ba49a77d7b135efd0d1/users/6d322b32be774f5796557c05626e994e/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:47.447738 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474f984-3710-454f-a10c-2fbb2c6848ed admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:47.475341 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 794/1605] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:18:47 2022] PUT /identity/v3/projects/754e7f374dfc4e1f9067b86fdc0cb279/users/728607c7138540d69532b0b806b9ccaf/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:47.476403 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dd4ce-c609-4900-891f-bbd7409c46f9 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:47.518002 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474f984-3710-454f-a10c-2fbb2c6848ed admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:47.541305 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dd4ce-c609-4900-891f-bbd7409c46f9 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:47.546599 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38ef17-ad0e-49b3-bf1d-9a1ef8178487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:47.547471 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38ef17-ad0e-49b3-bf1d-9a1ef8178487 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.547753 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38ef17-ad0e-49b3-bf1d-9a1ef8178487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.548027 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38ef17-ad0e-49b3-bf1d-9a1ef8178487 admin admin] PATH_INFO: `/v3/projects/f3766bd5bd4a4b609631e99682227ff6/users/f8237e439aef413b99e5ff0d725c8bce/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:47.562641 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38ef17-ad0e-49b3-bf1d-9a1ef8178487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3766bd5bd4a4b609631e99682227ff6, user_id=f8237e439aef413b99e5ff0d725c8bce, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:47.565380 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38ef17-ad0e-49b3-bf1d-9a1ef8178487 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:47.572540 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec2dae-1e94-4fc2-90c6-00fb6b5644de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:47.573495 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec2dae-1e94-4fc2-90c6-00fb6b5644de admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.573774 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec2dae-1e94-4fc2-90c6-00fb6b5644de admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.574052 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec2dae-1e94-4fc2-90c6-00fb6b5644de admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:47.574777 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec2dae-1e94-4fc2-90c6-00fb6b5644de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:47.576405 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec2dae-1e94-4fc2-90c6-00fb6b5644de admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:47.586215 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 812/1606] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:47.587080 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec2dae-1e94-4fc2-90c6-00fb6b5644de admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:47.597094 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec2dae-1e94-4fc2-90c6-00fb6b5644de admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:47.601854 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ed140-1a24-497b-9a5f-eaaafc42d0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:47.602659 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ed140-1a24-497b-9a5f-eaaafc42d0e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.602938 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ed140-1a24-497b-9a5f-eaaafc42d0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.603208 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ed140-1a24-497b-9a5f-eaaafc42d0e6 admin admin] PATH_INFO: `/v3/projects/30ef500d9ef3421eb59d9ce08761298d/users/8eefbc5ad0b94a8db2878c8e45a2a3e8/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:47.619001 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ed140-1a24-497b-9a5f-eaaafc42d0e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ef500d9ef3421eb59d9ce08761298d, user_id=8eefbc5ad0b94a8db2878c8e45a2a3e8, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:47.622302 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ed140-1a24-497b-9a5f-eaaafc42d0e6 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:47.642721 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 795/1607] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:18:47 2022] PUT /identity/v3/projects/f3766bd5bd4a4b609631e99682227ff6/users/f8237e439aef413b99e5ff0d725c8bce/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:47.644195 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148fc46-ef7e-4f3c-bee5-0ff63ca13fbf None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.644531 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148fc46-ef7e-4f3c-bee5-0ff63ca13fbf None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.645462 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148fc46-ef7e-4f3c-bee5-0ff63ca13fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:47.667080 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-c148fc46-ef7e-4f3c-bee5-0ff63ca13fbf None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:47.668384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c148fc46-ef7e-4f3c-bee5-0ff63ca13fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:47.735778 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 813/1608] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:18:47 2022] PUT /identity/v3/projects/30ef500d9ef3421eb59d9ce08761298d/users/8eefbc5ad0b94a8db2878c8e45a2a3e8/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:47.736536 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ed140-1a24-497b-9a5f-eaaafc42d0e6 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:47.739952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 796/1609] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:47.739952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c488c-2b12-41eb-af24-9de86f5e3acd None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.739952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c488c-2b12-41eb-af24-9de86f5e3acd None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.739952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c488c-2b12-41eb-af24-9de86f5e3acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:47.766244 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-bf7c488c-2b12-41eb-af24-9de86f5e3acd None None] MFA Rules not processed for user `6d322b32be774f5796557c05626e994e`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:47.767442 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-bf7c488c-2b12-41eb-af24-9de86f5e3acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:47.794120 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ed140-1a24-497b-9a5f-eaaafc42d0e6 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:47.797986 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae13c7-d28f-41d7-803d-e9c8b2d8d8fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:47.798774 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae13c7-d28f-41d7-803d-e9c8b2d8d8fd service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.799143 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae13c7-d28f-41d7-803d-e9c8b2d8d8fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.799494 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae13c7-d28f-41d7-803d-e9c8b2d8d8fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:47.834752 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 797/1610] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:47.836072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9caa33f-28e9-4be8-9139-44f1bbb27d95 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.836361 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9caa33f-28e9-4be8-9139-44f1bbb27d95 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.836640 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9caa33f-28e9-4be8-9139-44f1bbb27d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:47.860011 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-d9caa33f-28e9-4be8-9139-44f1bbb27d95 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:47.861267 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-d9caa33f-28e9-4be8-9139-44f1bbb27d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:47.864497 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae13c7-d28f-41d7-803d-e9c8b2d8d8fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:47.867398 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae13c7-d28f-41d7-803d-e9c8b2d8d8fd service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:47.875199 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 798/1611] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:47.875199 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9caa33f-28e9-4be8-9139-44f1bbb27d95 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:47.879354 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 814/1612] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:18:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:18:47.880890 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a27f2-6992-4c88-a3bf-ed84e58985f3 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.881250 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a27f2-6992-4c88-a3bf-ed84e58985f3 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.881639 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a27f2-6992-4c88-a3bf-ed84e58985f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:47.888115 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9caa33f-28e9-4be8-9139-44f1bbb27d95 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:47.893162 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e08e6-8de2-4274-b351-a0c51770ba2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:47.894057 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e08e6-8de2-4274-b351-a0c51770ba2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.894339 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e08e6-8de2-4274-b351-a0c51770ba2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.894616 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e08e6-8de2-4274-b351-a0c51770ba2a admin admin] PATH_INFO: `/v3/projects/899c14c78520495282ef58636b505833/users/9439c28129e54987955e61e9e919ab2d/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:47.911539 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-666a27f2-6992-4c88-a3bf-ed84e58985f3 None None] MFA Rules not processed for user `f8237e439aef413b99e5ff0d725c8bce`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:47.912837 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-666a27f2-6992-4c88-a3bf-ed84e58985f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:47.913318 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e08e6-8de2-4274-b351-a0c51770ba2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=899c14c78520495282ef58636b505833, user_id=9439c28129e54987955e61e9e919ab2d, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:47.916144 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e08e6-8de2-4274-b351-a0c51770ba2a admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:47.979370 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 815/1613] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:47.980941 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c309a-0431-41f1-9d88-822a28350336 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:47.981164 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c309a-0431-41f1-9d88-822a28350336 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:47.981442 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c309a-0431-41f1-9d88-822a28350336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:48.000100 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-495c309a-0431-41f1-9d88-822a28350336 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:48.001353 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-495c309a-0431-41f1-9d88-822a28350336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:48.009106 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 816/1614] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:48.009941 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c309a-0431-41f1-9d88-822a28350336 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:48.022675 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c309a-0431-41f1-9d88-822a28350336 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:48.025597 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 799/1615] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:18:47 2022] PUT /identity/v3/projects/899c14c78520495282ef58636b505833/users/9439c28129e54987955e61e9e919ab2d/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:48.026785 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e08e6-8de2-4274-b351-a0c51770ba2a admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:48.077712 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89649f06-5df1-45f2-b76b-c9b5af3d491a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:48.078531 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89649f06-5df1-45f2-b76b-c9b5af3d491a service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:48.078820 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89649f06-5df1-45f2-b76b-c9b5af3d491a service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:48.079101 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89649f06-5df1-45f2-b76b-c9b5af3d491a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:48.092016 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e08e6-8de2-4274-b351-a0c51770ba2a admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:48.096800 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc82d0a-d768-4c16-9ff8-71c60c0eea72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:48.097461 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc82d0a-d768-4c16-9ff8-71c60c0eea72 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:48.097745 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc82d0a-d768-4c16-9ff8-71c60c0eea72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:48.098025 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc82d0a-d768-4c16-9ff8-71c60c0eea72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:48.098714 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc82d0a-d768-4c16-9ff8-71c60c0eea72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:48.100756 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc82d0a-d768-4c16-9ff8-71c60c0eea72 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:48.141286 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89649f06-5df1-45f2-b76b-c9b5af3d491a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:48.142763 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89649f06-5df1-45f2-b76b-c9b5af3d491a service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:48.152383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 817/1616] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:18:48.153235 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89649f06-5df1-45f2-b76b-c9b5af3d491a service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:48.161069 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89649f06-5df1-45f2-b76b-c9b5af3d491a service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:48.165008 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2829450-80c4-4665-ad44-615e24fb5a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:48.165630 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2829450-80c4-4665-ad44-615e24fb5a7f service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:48.165912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2829450-80c4-4665-ad44-615e24fb5a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:48.166183 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2829450-80c4-4665-ad44-615e24fb5a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:48.176213 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2829450-80c4-4665-ad44-615e24fb5a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:48.177603 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2829450-80c4-4665-ad44-615e24fb5a7f service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:48.188910 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 818/1617] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:18:48.190073 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c1181-9e07-44de-be21-8bb5ebef9a7a None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:48.190364 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c1181-9e07-44de-be21-8bb5ebef9a7a None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:48.190633 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c1181-9e07-44de-be21-8bb5ebef9a7a None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:48.194301 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 819/1618] 10.222.0.52 () {54 vars in 961 bytes} [Tue Mar 8 13:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:18:48.194301 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c1181-9e07-44de-be21-8bb5ebef9a7a None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:48.215543 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c1181-9e07-44de-be21-8bb5ebef9a7a None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:48.215703 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 800/1619] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:18:48 2022] POST /identity/v3/projects => generated 381 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:48.215703 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d4e0a-64c6-46e8-9306-be55cf9409cd None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:48.215703 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d4e0a-64c6-46e8-9306-be55cf9409cd None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:48.215703 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d4e0a-64c6-46e8-9306-be55cf9409cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:48.248351 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-510d4e0a-64c6-46e8-9306-be55cf9409cd None None] MFA Rules not processed for user `9439c28129e54987955e61e9e919ab2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:48.251293 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-510d4e0a-64c6-46e8-9306-be55cf9409cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:48.265315 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c847bf-09db-4389-aa93-ff5ed328e7bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:48.265967 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c847bf-09db-4389-aa93-ff5ed328e7bb service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:48.266294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c847bf-09db-4389-aa93-ff5ed328e7bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:48.266565 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c847bf-09db-4389-aa93-ff5ed328e7bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:48.330440 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 801/1620] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:48 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:48.330440 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9447a38-454c-4b56-890b-2ccd739c8b1b None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:48.330440 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9447a38-454c-4b56-890b-2ccd739c8b1b None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:48.330440 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9447a38-454c-4b56-890b-2ccd739c8b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:48.349595 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-b9447a38-454c-4b56-890b-2ccd739c8b1b None None] MFA Rules not processed for user `72d4ac44d04943a5b24c7a1d6a31b7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:48.350770 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b9447a38-454c-4b56-890b-2ccd739c8b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:48.352368 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c847bf-09db-4389-aa93-ff5ed328e7bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:48.353855 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c847bf-09db-4389-aa93-ff5ed328e7bb service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:48.365829 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 820/1621] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:18:48.366666 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c847bf-09db-4389-aa93-ff5ed328e7bb service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:48.377588 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c847bf-09db-4389-aa93-ff5ed328e7bb service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:48.393383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e872c9-d2c5-42d1-964d-c0d8c9b7b968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:48.394467 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e872c9-d2c5-42d1-964d-c0d8c9b7b968 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:48.394801 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e872c9-d2c5-42d1-964d-c0d8c9b7b968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:48.395080 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e872c9-d2c5-42d1-964d-c0d8c9b7b968 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:48.396110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e872c9-d2c5-42d1-964d-c0d8c9b7b968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:48.404599 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e872c9-d2c5-42d1-964d-c0d8c9b7b968 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:48.476987 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 802/1622] 10.222.0.52 () {58 vars in 1058 bytes} [Tue Mar 8 13:18:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:48.477991 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9447a38-454c-4b56-890b-2ccd739c8b1b None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:48.489396 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9447a38-454c-4b56-890b-2ccd739c8b1b None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:48.494461 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393c981-8c82-4cea-b840-5f07b737dcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:48.495667 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393c981-8c82-4cea-b840-5f07b737dcba admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:48.496074 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393c981-8c82-4cea-b840-5f07b737dcba admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:48.496336 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393c981-8c82-4cea-b840-5f07b737dcba admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:48.497321 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393c981-8c82-4cea-b840-5f07b737dcba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:48.499248 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393c981-8c82-4cea-b840-5f07b737dcba admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:48.505467 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 821/1623] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:18:48 2022] POST /identity/v3/users => generated 297 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:48.514956 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e872c9-d2c5-42d1-964d-c0d8c9b7b968 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:48.522705 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e872c9-d2c5-42d1-964d-c0d8c9b7b968 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:48.528549 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44caed-cf08-428d-af39-a75817da286b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:48.529228 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44caed-cf08-428d-af39-a75817da286b service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:48.529535 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44caed-cf08-428d-af39-a75817da286b service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:48.529810 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44caed-cf08-428d-af39-a75817da286b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:48.625830 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44caed-cf08-428d-af39-a75817da286b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:48.628289 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44caed-cf08-428d-af39-a75817da286b service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:48.642115 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 822/1624] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:18:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:18:48.646719 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44caed-cf08-428d-af39-a75817da286b service nova] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:48.662696 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44caed-cf08-428d-af39-a75817da286b service nova] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:48.669621 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422783a-f542-4801-9a0d-8f6f9589744f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:48.670722 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422783a-f542-4801-9a0d-8f6f9589744f admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:48.671013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422783a-f542-4801-9a0d-8f6f9589744f admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:48.671288 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422783a-f542-4801-9a0d-8f6f9589744f admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:48.672649 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422783a-f542-4801-9a0d-8f6f9589744f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:48.675118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422783a-f542-4801-9a0d-8f6f9589744f admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:48.691722 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 823/1625] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:48.691962 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 803/1626] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:18:48 2022] POST /identity/v3/projects => generated 405 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:48.692065 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422783a-f542-4801-9a0d-8f6f9589744f admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:48.692931 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393c981-8c82-4cea-b840-5f07b737dcba admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:48.704751 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422783a-f542-4801-9a0d-8f6f9589744f admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:48.799176 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393c981-8c82-4cea-b840-5f07b737dcba admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:48.814308 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ba521-450c-4c84-9623-ae3dff374296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:48.822121 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ba521-450c-4c84-9623-ae3dff374296 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:48.822121 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ba521-450c-4c84-9623-ae3dff374296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:48.822121 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ba521-450c-4c84-9623-ae3dff374296 admin admin] PATH_INFO: `/v3/projects/dad479aec9dc46ffab9fcd852eaa941c/users/4409781b00104156bc43e14cca414277/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:48.823518 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001eadf3-fa5c-4997-aafc-88073173874b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:48.824304 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001eadf3-fa5c-4997-aafc-88073173874b admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:48.824728 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001eadf3-fa5c-4997-aafc-88073173874b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:48.825111 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001eadf3-fa5c-4997-aafc-88073173874b admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:48.826236 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001eadf3-fa5c-4997-aafc-88073173874b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:48.828281 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001eadf3-fa5c-4997-aafc-88073173874b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:48.869611 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ba521-450c-4c84-9623-ae3dff374296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad479aec9dc46ffab9fcd852eaa941c, user_id=4409781b00104156bc43e14cca414277, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:48.873047 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ba521-450c-4c84-9623-ae3dff374296 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:48.965783 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 824/1627] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:18:48 2022] POST /identity/v3/users => generated 309 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:48.970446 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001eadf3-fa5c-4997-aafc-88073173874b admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:48.981550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001eadf3-fa5c-4997-aafc-88073173874b admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:48.987386 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285588d3-ce31-4869-bbf2-4a1a65ae0c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:48.988056 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285588d3-ce31-4869-bbf2-4a1a65ae0c1f admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:48.988343 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285588d3-ce31-4869-bbf2-4a1a65ae0c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:48.988723 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285588d3-ce31-4869-bbf2-4a1a65ae0c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:48.989415 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285588d3-ce31-4869-bbf2-4a1a65ae0c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:48.991769 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285588d3-ce31-4869-bbf2-4a1a65ae0c1f admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:49.008165 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 804/1628] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:18:48 2022] PUT /identity/v3/projects/dad479aec9dc46ffab9fcd852eaa941c/users/4409781b00104156bc43e14cca414277/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:49.011484 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ba521-450c-4c84-9623-ae3dff374296 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:49.035324 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 825/1629] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:18:49.036226 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285588d3-ce31-4869-bbf2-4a1a65ae0c1f admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:49.062048 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285588d3-ce31-4869-bbf2-4a1a65ae0c1f admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:49.138957 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ba521-450c-4c84-9623-ae3dff374296 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:49.168229 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdcb8a-0773-404f-9d23-16c522b08bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:49.169405 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdcb8a-0773-404f-9d23-16c522b08bed admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:49.169685 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdcb8a-0773-404f-9d23-16c522b08bed admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:49.169957 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdcb8a-0773-404f-9d23-16c522b08bed admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:49.175528 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdcb8a-0773-404f-9d23-16c522b08bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:49.175528 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdcb8a-0773-404f-9d23-16c522b08bed admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:49.196702 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03fe54-22c4-4ae1-a00e-6a312800068a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:49.200164 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03fe54-22c4-4ae1-a00e-6a312800068a admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:49.201229 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03fe54-22c4-4ae1-a00e-6a312800068a admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:49.201229 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03fe54-22c4-4ae1-a00e-6a312800068a admin admin] PATH_INFO: `/v3/projects/e8616ec7833f42479c29f2e294175376/users/51e772c41cba47cbbc984bf97dfd4999/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:49.206392 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 805/1630] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:18:49.208600 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdcb8a-0773-404f-9d23-16c522b08bed admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:49.232050 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdcb8a-0773-404f-9d23-16c522b08bed admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:49.237547 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03fe54-22c4-4ae1-a00e-6a312800068a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8616ec7833f42479c29f2e294175376, user_id=51e772c41cba47cbbc984bf97dfd4999, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:49.240244 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03fe54-22c4-4ae1-a00e-6a312800068a admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:49.245943 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41432508-8e21-422f-a6a1-5b4afb5ae94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:49.247013 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41432508-8e21-422f-a6a1-5b4afb5ae94a admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:49.247295 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41432508-8e21-422f-a6a1-5b4afb5ae94a admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:49.247569 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41432508-8e21-422f-a6a1-5b4afb5ae94a admin admin] PATH_INFO: `/v3/projects/dad479aec9dc46ffab9fcd852eaa941c/users/4409781b00104156bc43e14cca414277/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:49.250751 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41432508-8e21-422f-a6a1-5b4afb5ae94a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad479aec9dc46ffab9fcd852eaa941c, user_id=4409781b00104156bc43e14cca414277, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:49.253606 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41432508-8e21-422f-a6a1-5b4afb5ae94a admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:49.266450 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 806/1631] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:18:49 2022] PUT /identity/v3/projects/dad479aec9dc46ffab9fcd852eaa941c/users/4409781b00104156bc43e14cca414277/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:49.277226 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619a74d-3e87-408e-8c5e-4157f4d8c015 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:49.277226 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619a74d-3e87-408e-8c5e-4157f4d8c015 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:49.277509 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619a74d-3e87-408e-8c5e-4157f4d8c015 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:49.279484 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 807/1632] 10.222.0.52 () {54 vars in 961 bytes} [Tue Mar 8 13:18:49 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:18:49.280639 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef9a54-01fe-43c3-a2c0-61a6b382cc97 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:49.280944 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef9a54-01fe-43c3-a2c0-61a6b382cc97 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:49.281222 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef9a54-01fe-43c3-a2c0-61a6b382cc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:49.323556 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-3aef9a54-01fe-43c3-a2c0-61a6b382cc97 None None] MFA Rules not processed for user `4409781b00104156bc43e14cca414277`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:49.325124 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-3aef9a54-01fe-43c3-a2c0-61a6b382cc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:49.413991 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 826/1633] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:18:49 2022] PUT /identity/v3/projects/e8616ec7833f42479c29f2e294175376/users/51e772c41cba47cbbc984bf97dfd4999/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:49.414907 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a559f71-3436-42b8-bc16-e7c30770cd07 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:49.415268 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a559f71-3436-42b8-bc16-e7c30770cd07 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:49.415543 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a559f71-3436-42b8-bc16-e7c30770cd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:49.437129 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 808/1634] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:49.438191 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef9a54-01fe-43c3-a2c0-61a6b382cc97 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:49.461265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-0a559f71-3436-42b8-bc16-e7c30770cd07 None None] MFA Rules not processed for user `72d4ac44d04943a5b24c7a1d6a31b7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:49.462767 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0a559f71-3436-42b8-bc16-e7c30770cd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:49.541422 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef9a54-01fe-43c3-a2c0-61a6b382cc97 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:49.598187 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 827/1635] 10.222.0.52 () {58 vars in 1058 bytes} [Tue Mar 8 13:18:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:49.599296 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a559f71-3436-42b8-bc16-e7c30770cd07 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:49.638702 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236f425-6bc1-41bb-a9f9-da978a31f448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:49.642107 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f425-6bc1-41bb-a9f9-da978a31f448 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:49.642482 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f425-6bc1-41bb-a9f9-da978a31f448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:49.642653 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f425-6bc1-41bb-a9f9-da978a31f448 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:49.643466 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236f425-6bc1-41bb-a9f9-da978a31f448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:49.646667 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236f425-6bc1-41bb-a9f9-da978a31f448 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:49.666498 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 809/1636] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:49.667957 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba8219-1d99-4456-8081-d8b9c1d6ab8f None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:49.668288 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba8219-1d99-4456-8081-d8b9c1d6ab8f None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:49.668685 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba8219-1d99-4456-8081-d8b9c1d6ab8f None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:49.671198 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 810/1637] 10.222.0.52 () {54 vars in 912 bytes} [Tue Mar 8 13:18:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:18:49.672679 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba8219-1d99-4456-8081-d8b9c1d6ab8f None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:49.686598 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba8219-1d99-4456-8081-d8b9c1d6ab8f None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:49.691964 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a559f71-3436-42b8-bc16-e7c30770cd07 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:49.692134 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9a9a6-49dc-4f44-9ff1-b71b7fd19cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:49.693367 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9a9a6-49dc-4f44-9ff1-b71b7fd19cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:49.693639 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9a9a6-49dc-4f44-9ff1-b71b7fd19cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:49.693913 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9a9a6-49dc-4f44-9ff1-b71b7fd19cdf admin admin] PATH_INFO: `/v3/projects/e8616ec7833f42479c29f2e294175376/users/51e772c41cba47cbbc984bf97dfd4999/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:49.697352 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9a9a6-49dc-4f44-9ff1-b71b7fd19cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8616ec7833f42479c29f2e294175376, user_id=51e772c41cba47cbbc984bf97dfd4999, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:49.698221 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd0a34-84cd-4bf1-9e03-2a005d84586e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:49.699655 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd0a34-84cd-4bf1-9e03-2a005d84586e service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:49.699655 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd0a34-84cd-4bf1-9e03-2a005d84586e service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:49.700723 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd0a34-84cd-4bf1-9e03-2a005d84586e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:49.701718 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9a9a6-49dc-4f44-9ff1-b71b7fd19cdf admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:49.735390 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 811/1638] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:18:49 2022] PUT /identity/v3/projects/e8616ec7833f42479c29f2e294175376/users/51e772c41cba47cbbc984bf97dfd4999/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:49.737825 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a156e-faa1-4b20-a6e0-51e1f771ba33 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:49.738278 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a156e-faa1-4b20-a6e0-51e1f771ba33 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:49.738833 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a156e-faa1-4b20-a6e0-51e1f771ba33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:49.776639 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-c92a156e-faa1-4b20-a6e0-51e1f771ba33 None None] MFA Rules not processed for user `72d4ac44d04943a5b24c7a1d6a31b7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:49.780529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c92a156e-faa1-4b20-a6e0-51e1f771ba33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:49.788778 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd0a34-84cd-4bf1-9e03-2a005d84586e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:49.790553 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd0a34-84cd-4bf1-9e03-2a005d84586e service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:49.804441 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 828/1639] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:18:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:18:49.806247 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a610ab-ffba-4d87-8bd5-02bf220040e4 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:49.806876 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a610ab-ffba-4d87-8bd5-02bf220040e4 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:49.807346 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a610ab-ffba-4d87-8bd5-02bf220040e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:49.843002 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-74a610ab-ffba-4d87-8bd5-02bf220040e4 None None] MFA Rules not processed for user `51e772c41cba47cbbc984bf97dfd4999`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:49.844601 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-74a610ab-ffba-4d87-8bd5-02bf220040e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:49.890104 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 812/1640] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 13:18:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:49.913193 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a156e-faa1-4b20-a6e0-51e1f771ba33 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:49.929146 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 829/1641] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:49 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:49.968927 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a610ab-ffba-4d87-8bd5-02bf220040e4 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:50.005546 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a156e-faa1-4b20-a6e0-51e1f771ba33 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:50.011039 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfcb76-e8df-4f8e-8753-522ac4467bfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:50.011817 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfcb76-e8df-4f8e-8753-522ac4467bfe service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:50.012292 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfcb76-e8df-4f8e-8753-522ac4467bfe service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:50.012565 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfcb76-e8df-4f8e-8753-522ac4467bfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:50.024165 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfcb76-e8df-4f8e-8753-522ac4467bfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:50.025640 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfcb76-e8df-4f8e-8753-522ac4467bfe service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:50.038281 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 813/1642] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:18:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:18:50.046193 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a610ab-ffba-4d87-8bd5-02bf220040e4 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:50.047185 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ecda9-a11e-42af-b05e-5433e927f6fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:50.048050 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ecda9-a11e-42af-b05e-5433e927f6fc service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:50.048615 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ecda9-a11e-42af-b05e-5433e927f6fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:50.049019 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ecda9-a11e-42af-b05e-5433e927f6fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:50.060277 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ecda9-a11e-42af-b05e-5433e927f6fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:50.061924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ecda9-a11e-42af-b05e-5433e927f6fc service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:50.075096 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 830/1643] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:18:49 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:18:50.242880 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3f4f8-e53f-4ce2-8078-032c19ce0f5c None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:50.243160 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3f4f8-e53f-4ce2-8078-032c19ce0f5c None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:50.243497 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3f4f8-e53f-4ce2-8078-032c19ce0f5c None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:50.246313 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 814/1644] 10.222.0.52 () {54 vars in 912 bytes} [Tue Mar 8 13:18:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:18:50.259934 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7da61-ba06-456b-8b3e-09c649cf6a47 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:50.265456 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7da61-ba06-456b-8b3e-09c649cf6a47 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:50.265456 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7da61-ba06-456b-8b3e-09c649cf6a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:50.286348 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-2dc7da61-ba06-456b-8b3e-09c649cf6a47 None None] MFA Rules not processed for user `72d4ac44d04943a5b24c7a1d6a31b7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:50.287977 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-2dc7da61-ba06-456b-8b3e-09c649cf6a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:50.306896 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 831/1645] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 13:18:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:50.313166 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3f4f8-e53f-4ce2-8078-032c19ce0f5c None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:50.337049 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3f4f8-e53f-4ce2-8078-032c19ce0f5c None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:50.341545 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7cae8-3d42-4cd1-b443-8bc5c4ed2a4e None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:50.341835 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7cae8-3d42-4cd1-b443-8bc5c4ed2a4e None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:50.342116 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7cae8-3d42-4cd1-b443-8bc5c4ed2a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:50.349309 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24164460-1f54-40db-84a0-8a48a0448603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:50.349722 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24164460-1f54-40db-84a0-8a48a0448603 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:50.350007 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24164460-1f54-40db-84a0-8a48a0448603 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:50.350286 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24164460-1f54-40db-84a0-8a48a0448603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:50.379262 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-3ec7cae8-3d42-4cd1-b443-8bc5c4ed2a4e None None] MFA Rules not processed for user `d3e11eebb9874367bc98012fc546f06f`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:50.381245 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-3ec7cae8-3d42-4cd1-b443-8bc5c4ed2a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:50.430624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24164460-1f54-40db-84a0-8a48a0448603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:50.432241 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24164460-1f54-40db-84a0-8a48a0448603 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:50.443230 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 815/1646] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:18:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:18:50.444011 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24164460-1f54-40db-84a0-8a48a0448603 service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:50.458581 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24164460-1f54-40db-84a0-8a48a0448603 service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:50.467381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48547d7-c0a9-4231-bbef-43dfbb283b28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:50.468046 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48547d7-c0a9-4231-bbef-43dfbb283b28 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:50.468475 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48547d7-c0a9-4231-bbef-43dfbb283b28 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:50.470475 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48547d7-c0a9-4231-bbef-43dfbb283b28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:50.499551 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48547d7-c0a9-4231-bbef-43dfbb283b28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:50.504005 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48547d7-c0a9-4231-bbef-43dfbb283b28 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:50.531028 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 832/1647] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:50.531922 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7cae8-3d42-4cd1-b443-8bc5c4ed2a4e None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:50.565381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 816/1648] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:18:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:18:50.687932 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7cae8-3d42-4cd1-b443-8bc5c4ed2a4e None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:50.707948 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b46533-090e-433f-aace-aa09530d7725 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:50.708483 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b46533-090e-433f-aace-aa09530d7725 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:50.708970 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b46533-090e-433f-aace-aa09530d7725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:50.709114 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485f05f-3816-49fd-b30f-1c55e87f8456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:50.709696 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485f05f-3816-49fd-b30f-1c55e87f8456 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:50.709983 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485f05f-3816-49fd-b30f-1c55e87f8456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:50.710259 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485f05f-3816-49fd-b30f-1c55e87f8456 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:50.711016 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485f05f-3816-49fd-b30f-1c55e87f8456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:50.713128 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485f05f-3816-49fd-b30f-1c55e87f8456 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:50.748691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-f9b46533-090e-433f-aace-aa09530d7725 None None] MFA Rules not processed for user `8eefbc5ad0b94a8db2878c8e45a2a3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:50.750230 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f9b46533-090e-433f-aace-aa09530d7725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:50.850586 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 833/1649] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:18:50 2022] POST /identity/v3/projects => generated 403 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:50.852127 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485f05f-3816-49fd-b30f-1c55e87f8456 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:50.882587 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 817/1650] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:18:50.884899 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b46533-090e-433f-aace-aa09530d7725 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:50.903636 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b46533-090e-433f-aace-aa09530d7725 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:50.945945 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485f05f-3816-49fd-b30f-1c55e87f8456 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:50.951721 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0baae-18b8-4649-b19f-a6ab5c8b33ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:50.953741 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0baae-18b8-4649-b19f-a6ab5c8b33ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:50.954271 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0baae-18b8-4649-b19f-a6ab5c8b33ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:50.954691 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0baae-18b8-4649-b19f-a6ab5c8b33ba admin admin] PATH_INFO: `/v3/users/9439c28129e54987955e61e9e919ab2d` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:50.956248 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0baae-18b8-4649-b19f-a6ab5c8b33ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=9439c28129e54987955e61e9e919ab2d)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:50.957496 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: WARNING py.warnings [None req-24e0baae-18b8-4649-b19f-a6ab5c8b33ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:18:50.957496 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: warnings.warn(msg) Mar 08 13:18:50.957496 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: Mar 08 13:18:50.959068 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0baae-18b8-4649-b19f-a6ab5c8b33ba admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:50.976545 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2938c4-5650-4c54-b683-cb2faddc3dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:50.977532 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2938c4-5650-4c54-b683-cb2faddc3dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:50.977819 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2938c4-5650-4c54-b683-cb2faddc3dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:50.978099 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2938c4-5650-4c54-b683-cb2faddc3dfb admin admin] PATH_INFO: `/v3/users/f8237e439aef413b99e5ff0d725c8bce` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:50.980396 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2938c4-5650-4c54-b683-cb2faddc3dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8237e439aef413b99e5ff0d725c8bce)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:50.982764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2938c4-5650-4c54-b683-cb2faddc3dfb admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:51.221338 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-24e0baae-18b8-4649-b19f-a6ab5c8b33ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9439c28129e54987955e61e9e919ab2d'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:51.246528 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-24e0baae-18b8-4649-b19f-a6ab5c8b33ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9439c28129e54987955e61e9e919ab2d'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:51.247361 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-24e0baae-18b8-4649-b19f-a6ab5c8b33ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9439c28129e54987955e61e9e919ab2d'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:51.247979 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-24e0baae-18b8-4649-b19f-a6ab5c8b33ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9439c28129e54987955e61e9e919ab2d'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:51.257786 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-24e0baae-18b8-4649-b19f-a6ab5c8b33ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9439c28129e54987955e61e9e919ab2d'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:51.280846 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4a2938c4-5650-4c54-b683-cb2faddc3dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8237e439aef413b99e5ff0d725c8bce'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:51.311302 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4a2938c4-5650-4c54-b683-cb2faddc3dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8237e439aef413b99e5ff0d725c8bce'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:51.312124 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4a2938c4-5650-4c54-b683-cb2faddc3dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8237e439aef413b99e5ff0d725c8bce'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:51.433008 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 834/1651] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:18:50 2022] DELETE /identity/v3/users/9439c28129e54987955e61e9e919ab2d => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:51.436549 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0baae-18b8-4649-b19f-a6ab5c8b33ba admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:51.439106 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-24e0baae-18b8-4649-b19f-a6ab5c8b33ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:51.527859 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4a2938c4-5650-4c54-b683-cb2faddc3dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8237e439aef413b99e5ff0d725c8bce'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:51.528907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4a2938c4-5650-4c54-b683-cb2faddc3dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8237e439aef413b99e5ff0d725c8bce'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:51.552022 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 818/1652] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:18:50 2022] DELETE /identity/v3/users/f8237e439aef413b99e5ff0d725c8bce => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:51.554989 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105702d0-4bb6-4091-9d35-54eae8f4e0ab None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:51.556862 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105702d0-4bb6-4091-9d35-54eae8f4e0ab None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:51.560240 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105702d0-4bb6-4091-9d35-54eae8f4e0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:51.565599 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0baae-18b8-4649-b19f-a6ab5c8b33ba admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:51.609765 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-105702d0-4bb6-4091-9d35-54eae8f4e0ab None None] MFA Rules not processed for user `8eefbc5ad0b94a8db2878c8e45a2a3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:51.617379 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-105702d0-4bb6-4091-9d35-54eae8f4e0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:51.714498 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85636df-f154-40ca-9509-0103411e27da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:51.715626 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85636df-f154-40ca-9509-0103411e27da admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:51.716277 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85636df-f154-40ca-9509-0103411e27da admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:51.716877 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85636df-f154-40ca-9509-0103411e27da admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:51.717853 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85636df-f154-40ca-9509-0103411e27da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:51.720687 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85636df-f154-40ca-9509-0103411e27da admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:51.730443 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 819/1653] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:51.733028 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fae7de-f18e-4bde-b8f1-c971b6954889 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:51.733028 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fae7de-f18e-4bde-b8f1-c971b6954889 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:51.733028 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fae7de-f18e-4bde-b8f1-c971b6954889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:51.772127 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-e1fae7de-f18e-4bde-b8f1-c971b6954889 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:51.774224 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-e1fae7de-f18e-4bde-b8f1-c971b6954889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:51.795049 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 820/1654] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:51.795049 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b04f6-abc3-4664-b10b-19b368442841 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:51.795049 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b04f6-abc3-4664-b10b-19b368442841 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:51.795049 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b04f6-abc3-4664-b10b-19b368442841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:51.826244 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 835/1655] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:18:51 2022] POST /identity/v3/users => generated 308 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:51.827327 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85636df-f154-40ca-9509-0103411e27da admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:51.830382 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b85636df-f154-40ca-9509-0103411e27da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:51.854606 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-ee6b04f6-abc3-4664-b10b-19b368442841 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:51.855876 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-ee6b04f6-abc3-4664-b10b-19b368442841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:51.881139 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 821/1656] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:51.881139 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b04f6-abc3-4664-b10b-19b368442841 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:51.881630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-ee6b04f6-abc3-4664-b10b-19b368442841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:51.974764 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85636df-f154-40ca-9509-0103411e27da admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:51.981586 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cee62b-731f-4a12-a2dd-4292b098c05d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:51.982497 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cee62b-731f-4a12-a2dd-4292b098c05d service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:51.982787 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cee62b-731f-4a12-a2dd-4292b098c05d service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:51.983061 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cee62b-731f-4a12-a2dd-4292b098c05d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:51.985194 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b0cee62b-731f-4a12-a2dd-4292b098c05d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:51.997871 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cee62b-731f-4a12-a2dd-4292b098c05d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:51.999830 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cee62b-731f-4a12-a2dd-4292b098c05d service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:52.006059 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b04f6-abc3-4664-b10b-19b368442841 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:52.009680 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 836/1657] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:18:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:18:52.010572 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cee62b-731f-4a12-a2dd-4292b098c05d service nova] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:52.012018 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b0cee62b-731f-4a12-a2dd-4292b098c05d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:52.023235 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc66bbc-281d-4fff-9445-3892255b7a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:52.026811 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc66bbc-281d-4fff-9445-3892255b7a52 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:52.027360 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc66bbc-281d-4fff-9445-3892255b7a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:52.027474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cee62b-731f-4a12-a2dd-4292b098c05d service nova] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:52.028159 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc66bbc-281d-4fff-9445-3892255b7a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:52.038938 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb9504-2672-4bb7-bcdc-50dfa847a1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:52.039896 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb9504-2672-4bb7-bcdc-50dfa847a1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:52.039896 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb9504-2672-4bb7-bcdc-50dfa847a1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:52.044519 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb9504-2672-4bb7-bcdc-50dfa847a1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:52.045544 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb9504-2672-4bb7-bcdc-50dfa847a1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:52.047353 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb9504-2672-4bb7-bcdc-50dfa847a1e5 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:52.057613 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc66bbc-281d-4fff-9445-3892255b7a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:52.063432 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc66bbc-281d-4fff-9445-3892255b7a52 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:52.073963 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 837/1658] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:52.075051 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb9504-2672-4bb7-bcdc-50dfa847a1e5 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:52.076924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-23eb9504-2672-4bb7-bcdc-50dfa847a1e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:52.089777 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb9504-2672-4bb7-bcdc-50dfa847a1e5 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:52.091285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 822/1659] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:18:52.094064 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc66bbc-281d-4fff-9445-3892255b7a52 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:52.096560 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cf0d0-5a19-47c6-96ae-38013b92f575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:52.097258 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cf0d0-5a19-47c6-96ae-38013b92f575 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:52.097551 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cf0d0-5a19-47c6-96ae-38013b92f575 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:52.098201 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cf0d0-5a19-47c6-96ae-38013b92f575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:52.117024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736cf0d0-5a19-47c6-96ae-38013b92f575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:52.118695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736cf0d0-5a19-47c6-96ae-38013b92f575 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:52.120190 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc66bbc-281d-4fff-9445-3892255b7a52 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:52.134653 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc66b2-09ca-4abb-aceb-cde0fc684acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:52.136330 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc66b2-09ca-4abb-aceb-cde0fc684acb admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:52.137247 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc66b2-09ca-4abb-aceb-cde0fc684acb admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:52.137632 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc66b2-09ca-4abb-aceb-cde0fc684acb admin admin] PATH_INFO: `/v3/projects/6f8aa6a9fe2d4a3a90c5604382bbbb31/users/de8944439f6a4010bc293b6790e5092a/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:52.144345 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 838/1660] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:18:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:18:52.174609 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc66b2-09ca-4abb-aceb-cde0fc684acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8aa6a9fe2d4a3a90c5604382bbbb31, user_id=de8944439f6a4010bc293b6790e5092a, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:52.177692 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc66b2-09ca-4abb-aceb-cde0fc684acb admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:52.526183 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 823/1661] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:18:52 2022] PUT /identity/v3/projects/6f8aa6a9fe2d4a3a90c5604382bbbb31/users/de8944439f6a4010bc293b6790e5092a/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:52.537304 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cf0d0-5a19-47c6-96ae-38013b92f575 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:52.537304 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cf0d0-5a19-47c6-96ae-38013b92f575 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:52.609768 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2506a-279d-4afb-ab3e-decccc590719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:52.611314 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2506a-279d-4afb-ab3e-decccc590719 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:52.611608 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2506a-279d-4afb-ab3e-decccc590719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:52.611889 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2506a-279d-4afb-ab3e-decccc590719 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:52.612885 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2506a-279d-4afb-ab3e-decccc590719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:52.614573 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2506a-279d-4afb-ab3e-decccc590719 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:52.647851 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 839/1662] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:52.653207 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc66b2-09ca-4abb-aceb-cde0fc684acb admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:52.668895 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc66b2-09ca-4abb-aceb-cde0fc684acb admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:52.694880 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab9c73-8b37-4c89-98ef-4d8f7b600bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:52.695976 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab9c73-8b37-4c89-98ef-4d8f7b600bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:52.696267 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab9c73-8b37-4c89-98ef-4d8f7b600bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:52.700953 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab9c73-8b37-4c89-98ef-4d8f7b600bd6 admin admin] PATH_INFO: `/v3/projects/6f8aa6a9fe2d4a3a90c5604382bbbb31/users/de8944439f6a4010bc293b6790e5092a/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:52.705737 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab9c73-8b37-4c89-98ef-4d8f7b600bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8aa6a9fe2d4a3a90c5604382bbbb31, user_id=de8944439f6a4010bc293b6790e5092a, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:52.714080 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab9c73-8b37-4c89-98ef-4d8f7b600bd6 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:52.756102 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 824/1663] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:18:52 2022] PUT /identity/v3/projects/6f8aa6a9fe2d4a3a90c5604382bbbb31/users/de8944439f6a4010bc293b6790e5092a/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:18:53.289136 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c547d99-9b3b-47c6-907f-bb1067fd3ce2 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:53.289427 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c547d99-9b3b-47c6-907f-bb1067fd3ce2 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:53.290130 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c547d99-9b3b-47c6-907f-bb1067fd3ce2 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:53.292492 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 840/1664] 10.222.0.52 () {54 vars in 912 bytes} [Tue Mar 8 13:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:18:53.299358 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f583c7-cea9-412a-823b-5c9de6ecc074 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:53.299844 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f583c7-cea9-412a-823b-5c9de6ecc074 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:53.299969 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f583c7-cea9-412a-823b-5c9de6ecc074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:53.381795 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-a4f583c7-cea9-412a-823b-5c9de6ecc074 None None] MFA Rules not processed for user `22bf06400d8f47f4bb3badd7f65bc205`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:53.383082 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-a4f583c7-cea9-412a-823b-5c9de6ecc074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:53.486094 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 825/1665] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 13:18:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:53.495076 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c547d99-9b3b-47c6-907f-bb1067fd3ce2 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:53.498775 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-2c547d99-9b3b-47c6-907f-bb1067fd3ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:53.596208 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c547d99-9b3b-47c6-907f-bb1067fd3ce2 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:53.610814 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb14de7-1d7f-42a7-bf37-16ca03f5ed68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:53.612329 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb14de7-1d7f-42a7-bf37-16ca03f5ed68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:53.613818 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb14de7-1d7f-42a7-bf37-16ca03f5ed68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:53.614370 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb14de7-1d7f-42a7-bf37-16ca03f5ed68 admin admin] PATH_INFO: `/v3/projects/f3766bd5bd4a4b609631e99682227ff6` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:53.617427 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb14de7-1d7f-42a7-bf37-16ca03f5ed68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3766bd5bd4a4b609631e99682227ff6)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:53.623772 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb14de7-1d7f-42a7-bf37-16ca03f5ed68 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:53.745702 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f583c7-cea9-412a-823b-5c9de6ecc074 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:53.758492 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f583c7-cea9-412a-823b-5c9de6ecc074 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:53.813365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9bb14de7-1d7f-42a7-bf37-16ca03f5ed68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3766bd5bd4a4b609631e99682227ff6', 'request_id': 'req-9bb14de7-1d7f-42a7-bf37-16ca03f5ed68'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:53.838046 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9bb14de7-1d7f-42a7-bf37-16ca03f5ed68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3766bd5bd4a4b609631e99682227ff6', 'request_id': 'req-9bb14de7-1d7f-42a7-bf37-16ca03f5ed68'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:53.870365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9bb14de7-1d7f-42a7-bf37-16ca03f5ed68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3766bd5bd4a4b609631e99682227ff6', 'request_id': 'req-9bb14de7-1d7f-42a7-bf37-16ca03f5ed68'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:53.890795 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ebb28-d8aa-4df9-bac4-902506ea8247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:53.891463 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ebb28-d8aa-4df9-bac4-902506ea8247 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:53.891738 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ebb28-d8aa-4df9-bac4-902506ea8247 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:53.893050 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ebb28-d8aa-4df9-bac4-902506ea8247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:53.923327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ebb28-d8aa-4df9-bac4-902506ea8247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:53.924688 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ebb28-d8aa-4df9-bac4-902506ea8247 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:53.940347 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 826/1666] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:18:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:18:53.976787 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9bb14de7-1d7f-42a7-bf37-16ca03f5ed68 admin admin] The token cache is being invalidate because project f3766bd5bd4a4b609631e99682227ff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:18:53.977104 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9bb14de7-1d7f-42a7-bf37-16ca03f5ed68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:53.985525 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9bb14de7-1d7f-42a7-bf37-16ca03f5ed68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:53.985525 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 841/1667] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:18:53 2022] DELETE /identity/v3/projects/f3766bd5bd4a4b609631e99682227ff6 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:53.986351 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2430b3-f774-4d27-8acb-093205f5f2df None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:53.986351 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2430b3-f774-4d27-8acb-093205f5f2df None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:53.986351 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2430b3-f774-4d27-8acb-093205f5f2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:54.018148 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-da2430b3-f774-4d27-8acb-093205f5f2df None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:54.021912 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-da2430b3-f774-4d27-8acb-093205f5f2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:54.203055 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5084f8-0247-490a-951d-3b601f81e0fb None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:54.203339 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5084f8-0247-490a-951d-3b601f81e0fb None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:54.203701 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5084f8-0247-490a-951d-3b601f81e0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:54.206440 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 827/1668] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:54.244813 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-7e5084f8-0247-490a-951d-3b601f81e0fb None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:54.250170 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-7e5084f8-0247-490a-951d-3b601f81e0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:54.273269 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2430b3-f774-4d27-8acb-093205f5f2df None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:54.280784 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 842/1669] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:54.287067 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2430b3-f774-4d27-8acb-093205f5f2df None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:54.310448 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ea2e7-e6af-4f69-acde-5fa17e7ea864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:54.311832 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ea2e7-e6af-4f69-acde-5fa17e7ea864 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:54.312384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ea2e7-e6af-4f69-acde-5fa17e7ea864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:54.312901 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ea2e7-e6af-4f69-acde-5fa17e7ea864 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:54.314005 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ea2e7-e6af-4f69-acde-5fa17e7ea864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:18:54.314505 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ea2e7-e6af-4f69-acde-5fa17e7ea864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:54.316887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ea2e7-e6af-4f69-acde-5fa17e7ea864 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:54.366116 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 828/1670] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:18:54.370240 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5084f8-0247-490a-951d-3b601f81e0fb None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:54.389657 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5084f8-0247-490a-951d-3b601f81e0fb None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:54.407515 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25f389-cc6e-4e53-9763-847d1a8835bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:54.408491 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25f389-cc6e-4e53-9763-847d1a8835bb admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:54.408977 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25f389-cc6e-4e53-9763-847d1a8835bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:54.409400 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25f389-cc6e-4e53-9763-847d1a8835bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:54.423059 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25f389-cc6e-4e53-9763-847d1a8835bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:54.427389 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25f389-cc6e-4e53-9763-847d1a8835bb admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:54.795247 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ea2e7-e6af-4f69-acde-5fa17e7ea864 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:54.796610 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 843/1671] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:18:54 2022] POST /identity/v3/projects => generated 373 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:54.830228 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ea2e7-e6af-4f69-acde-5fa17e7ea864 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:54.865086 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434714dd-0de5-44d2-8045-cd4a043a949b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:54.866567 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434714dd-0de5-44d2-8045-cd4a043a949b admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:54.866989 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434714dd-0de5-44d2-8045-cd4a043a949b admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:54.867412 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434714dd-0de5-44d2-8045-cd4a043a949b admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:54.868518 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434714dd-0de5-44d2-8045-cd4a043a949b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:54.871628 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434714dd-0de5-44d2-8045-cd4a043a949b admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:55.044111 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 829/1672] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:18:54 2022] POST /identity/v3/users => generated 287 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:55.048393 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25f389-cc6e-4e53-9763-847d1a8835bb admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:55.063535 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25f389-cc6e-4e53-9763-847d1a8835bb admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:55.077465 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760d541-5113-46cf-ba7c-2378b938c0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:55.078162 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760d541-5113-46cf-ba7c-2378b938c0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:55.081131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760d541-5113-46cf-ba7c-2378b938c0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:55.081131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760d541-5113-46cf-ba7c-2378b938c0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:55.081131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0760d541-5113-46cf-ba7c-2378b938c0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:55.081131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0760d541-5113-46cf-ba7c-2378b938c0d5 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:55.118236 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 844/1673] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:55.122534 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434714dd-0de5-44d2-8045-cd4a043a949b admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:55.139873 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434714dd-0de5-44d2-8045-cd4a043a949b admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:55.149398 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125e3ce-b799-4cab-9f83-f9bda87f746e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:55.151059 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125e3ce-b799-4cab-9f83-f9bda87f746e admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:55.151511 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125e3ce-b799-4cab-9f83-f9bda87f746e admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:55.151918 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125e3ce-b799-4cab-9f83-f9bda87f746e admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:55.154847 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125e3ce-b799-4cab-9f83-f9bda87f746e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:55.156190 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125e3ce-b799-4cab-9f83-f9bda87f746e admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:55.182329 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 830/1674] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:18:55.182457 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760d541-5113-46cf-ba7c-2378b938c0d5 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:55.200887 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760d541-5113-46cf-ba7c-2378b938c0d5 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:55.208616 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226018c-e4d2-4e01-8981-354251239a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:55.211636 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226018c-e4d2-4e01-8981-354251239a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:55.212139 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226018c-e4d2-4e01-8981-354251239a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:55.213475 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226018c-e4d2-4e01-8981-354251239a8f admin admin] PATH_INFO: `/v3/projects/f58d67c33b504b549ab1fa60c2208359/users/95f7b835b72d4a79b5b35d4dd85d5519/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:55.256151 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226018c-e4d2-4e01-8981-354251239a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f58d67c33b504b549ab1fa60c2208359, user_id=95f7b835b72d4a79b5b35d4dd85d5519, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:55.259005 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226018c-e4d2-4e01-8981-354251239a8f admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:55.293749 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125e3ce-b799-4cab-9f83-f9bda87f746e admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:55.299626 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-5125e3ce-b799-4cab-9f83-f9bda87f746e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:55.327628 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125e3ce-b799-4cab-9f83-f9bda87f746e admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:55.337407 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c77e63-002e-4c56-a41e-649e51b6dec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:55.338933 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c77e63-002e-4c56-a41e-649e51b6dec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:55.339008 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c77e63-002e-4c56-a41e-649e51b6dec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:55.340845 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c77e63-002e-4c56-a41e-649e51b6dec2 admin admin] PATH_INFO: `/v3/projects/899c14c78520495282ef58636b505833` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:55.346322 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c77e63-002e-4c56-a41e-649e51b6dec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=899c14c78520495282ef58636b505833)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:55.348404 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: WARNING py.warnings [None req-f7c77e63-002e-4c56-a41e-649e51b6dec2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:18:55.348404 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: warnings.warn(msg) Mar 08 13:18:55.348404 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: Mar 08 13:18:55.349760 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c77e63-002e-4c56-a41e-649e51b6dec2 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:55.368784 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 845/1675] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:18:55 2022] PUT /identity/v3/projects/f58d67c33b504b549ab1fa60c2208359/users/95f7b835b72d4a79b5b35d4dd85d5519/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:55.389196 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6efe5-47a1-4852-ba24-afd6c38fdf27 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:55.390081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6efe5-47a1-4852-ba24-afd6c38fdf27 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:55.391146 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6efe5-47a1-4852-ba24-afd6c38fdf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:55.475092 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-6fb6efe5-47a1-4852-ba24-afd6c38fdf27 None None] MFA Rules not processed for user `95f7b835b72d4a79b5b35d4dd85d5519`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:55.480365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-6fb6efe5-47a1-4852-ba24-afd6c38fdf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:55.565419 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f7c77e63-002e-4c56-a41e-649e51b6dec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '899c14c78520495282ef58636b505833', 'request_id': 'req-f7c77e63-002e-4c56-a41e-649e51b6dec2'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:55.610268 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 846/1676] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:55.611908 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6e1e4-4778-4dd2-9a7c-b10d4f33dd1b None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:55.616096 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6e1e4-4778-4dd2-9a7c-b10d4f33dd1b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:55.616096 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6e1e4-4778-4dd2-9a7c-b10d4f33dd1b None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:55.616096 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 847/1677] 10.222.0.52 () {54 vars in 960 bytes} [Tue Mar 8 13:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:18:55.621406 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6e1e4-4778-4dd2-9a7c-b10d4f33dd1b None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:55.641266 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f7c77e63-002e-4c56-a41e-649e51b6dec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '899c14c78520495282ef58636b505833', 'request_id': 'req-f7c77e63-002e-4c56-a41e-649e51b6dec2'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:55.648506 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f7c77e63-002e-4c56-a41e-649e51b6dec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '899c14c78520495282ef58636b505833', 'request_id': 'req-f7c77e63-002e-4c56-a41e-649e51b6dec2'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:55.703302 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f7c77e63-002e-4c56-a41e-649e51b6dec2 admin admin] The token cache is being invalidate because project 899c14c78520495282ef58636b505833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:18:55.703591 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f7c77e63-002e-4c56-a41e-649e51b6dec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:55.704372 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f7c77e63-002e-4c56-a41e-649e51b6dec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:55.708885 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 831/1678] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:18:55 2022] DELETE /identity/v3/projects/899c14c78520495282ef58636b505833 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:55.710286 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf62601-0f40-40a5-9bda-6ee177297aaf None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:55.710580 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf62601-0f40-40a5-9bda-6ee177297aaf None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:55.710863 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf62601-0f40-40a5-9bda-6ee177297aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:55.736959 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6e1e4-4778-4dd2-9a7c-b10d4f33dd1b None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:55.751936 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302f4ff-4117-47df-ab43-4280af4b353d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:55.753270 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302f4ff-4117-47df-ab43-4280af4b353d admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:55.753621 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302f4ff-4117-47df-ab43-4280af4b353d admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:55.753974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302f4ff-4117-47df-ab43-4280af4b353d admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:55.754757 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302f4ff-4117-47df-ab43-4280af4b353d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:55.757326 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302f4ff-4117-47df-ab43-4280af4b353d admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:55.769400 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-fcf62601-0f40-40a5-9bda-6ee177297aaf None None] MFA Rules not processed for user `9b917ce4f7f34b289218f7d36a43983e`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:55.770644 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-fcf62601-0f40-40a5-9bda-6ee177297aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:55.899249 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 848/1679] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:18:55 2022] POST /identity/v3/projects => generated 371 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:55.900765 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302f4ff-4117-47df-ab43-4280af4b353d admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:55.925182 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-6302f4ff-4117-47df-ab43-4280af4b353d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:55.929634 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 832/1680] 10.222.0.52 () {58 vars in 1057 bytes} [Tue Mar 8 13:18:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:55.931528 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf62601-0f40-40a5-9bda-6ee177297aaf None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:55.934046 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-fcf62601-0f40-40a5-9bda-6ee177297aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:55.957981 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf62601-0f40-40a5-9bda-6ee177297aaf None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:56.045098 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302f4ff-4117-47df-ab43-4280af4b353d admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:56.052794 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e696e21-24c8-4604-b72f-e56d1c8dd5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:56.053706 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e696e21-24c8-4604-b72f-e56d1c8dd5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:56.053997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e696e21-24c8-4604-b72f-e56d1c8dd5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:56.054273 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e696e21-24c8-4604-b72f-e56d1c8dd5ee admin admin] PATH_INFO: `/v3/users/51e772c41cba47cbbc984bf97dfd4999` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:56.057126 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e696e21-24c8-4604-b72f-e56d1c8dd5ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=51e772c41cba47cbbc984bf97dfd4999)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:56.059353 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e696e21-24c8-4604-b72f-e56d1c8dd5ee admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:56.065748 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d26cf-065f-44a8-81b6-efbc4316d18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:56.066445 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d26cf-065f-44a8-81b6-efbc4316d18e admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:56.067325 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d26cf-065f-44a8-81b6-efbc4316d18e admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:56.067612 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d26cf-065f-44a8-81b6-efbc4316d18e admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:56.068323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d26cf-065f-44a8-81b6-efbc4316d18e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:56.071077 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d26cf-065f-44a8-81b6-efbc4316d18e admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:56.162548 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 833/1681] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:18:55 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:56.163410 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d26cf-065f-44a8-81b6-efbc4316d18e admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:56.286773 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-2e696e21-24c8-4604-b72f-e56d1c8dd5ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51e772c41cba47cbbc984bf97dfd4999'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:56.295413 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d26cf-065f-44a8-81b6-efbc4316d18e admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:56.303845 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c909931-5f7a-4580-963f-06cb1a2cc440 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b917ce4f7f34b289218f7d36a43983e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:56.304038 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-2e696e21-24c8-4604-b72f-e56d1c8dd5ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51e772c41cba47cbbc984bf97dfd4999'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:56.304615 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-2e696e21-24c8-4604-b72f-e56d1c8dd5ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51e772c41cba47cbbc984bf97dfd4999'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:56.305059 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c909931-5f7a-4580-963f-06cb1a2cc440 service placement] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:56.305422 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c909931-5f7a-4580-963f-06cb1a2cc440 service placement] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:56.305525 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-2e696e21-24c8-4604-b72f-e56d1c8dd5ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51e772c41cba47cbbc984bf97dfd4999'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:56.305911 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c909931-5f7a-4580-963f-06cb1a2cc440 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:56.314304 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-2e696e21-24c8-4604-b72f-e56d1c8dd5ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51e772c41cba47cbbc984bf97dfd4999'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:56.321359 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-5c909931-5f7a-4580-963f-06cb1a2cc440 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:56.350211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c909931-5f7a-4580-963f-06cb1a2cc440 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:56.356386 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c909931-5f7a-4580-963f-06cb1a2cc440 service placement] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:56.400223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 834/1682] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:18:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:18:56.403045 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c909931-5f7a-4580-963f-06cb1a2cc440 service placement] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:56.405586 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-5c909931-5f7a-4580-963f-06cb1a2cc440 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:56.439149 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 849/1683] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:18:55 2022] DELETE /identity/v3/users/51e772c41cba47cbbc984bf97dfd4999 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:56.440705 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558981e-bdb2-4056-badc-e7032b15d817 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:56.446149 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c909931-5f7a-4580-963f-06cb1a2cc440 service placement] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:56.450488 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558981e-bdb2-4056-badc-e7032b15d817 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:56.454784 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558981e-bdb2-4056-badc-e7032b15d817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:56.520528 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ff11b-fd25-4aae-a66b-ab0040395252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:56.521249 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ff11b-fd25-4aae-a66b-ab0040395252 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:56.521536 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ff11b-fd25-4aae-a66b-ab0040395252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:56.521815 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ff11b-fd25-4aae-a66b-ab0040395252 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:56.522561 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ff11b-fd25-4aae-a66b-ab0040395252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:56.524288 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ff11b-fd25-4aae-a66b-ab0040395252 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:56.537031 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 835/1684] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:56.542575 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ff11b-fd25-4aae-a66b-ab0040395252 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:56.554910 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ff11b-fd25-4aae-a66b-ab0040395252 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:56.564488 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464550f-f7f1-48c6-9a55-b72294e4085a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:56.565081 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464550f-f7f1-48c6-9a55-b72294e4085a admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:56.565433 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464550f-f7f1-48c6-9a55-b72294e4085a admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:56.565819 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464550f-f7f1-48c6-9a55-b72294e4085a admin admin] PATH_INFO: `/v3/projects/201e99f4b0ec4ea19916b3a14ea7e33f/users/227992e178d444ca82f29ddf08a8e7b7/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:56.587224 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464550f-f7f1-48c6-9a55-b72294e4085a admin admin] RBAC: Authorizing `identity:create_grant(project_id=201e99f4b0ec4ea19916b3a14ea7e33f, user_id=227992e178d444ca82f29ddf08a8e7b7, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:56.591732 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464550f-f7f1-48c6-9a55-b72294e4085a admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:56.606597 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-d558981e-bdb2-4056-badc-e7032b15d817 None None] MFA Rules not processed for user `de8944439f6a4010bc293b6790e5092a`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:56.609110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-d558981e-bdb2-4056-badc-e7032b15d817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:56.688691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 836/1685] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:18:56 2022] PUT /identity/v3/projects/201e99f4b0ec4ea19916b3a14ea7e33f/users/227992e178d444ca82f29ddf08a8e7b7/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:56.697333 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464550f-f7f1-48c6-9a55-b72294e4085a admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:56.796572 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 850/1686] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:56 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:56.893991 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464550f-f7f1-48c6-9a55-b72294e4085a admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:56.900900 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918ac0b-5aa0-4d7a-bd9d-98d9006fedc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:56.901710 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918ac0b-5aa0-4d7a-bd9d-98d9006fedc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:56.902731 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918ac0b-5aa0-4d7a-bd9d-98d9006fedc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:56.903084 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918ac0b-5aa0-4d7a-bd9d-98d9006fedc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:56.905079 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918ac0b-5aa0-4d7a-bd9d-98d9006fedc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:56.915736 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918ac0b-5aa0-4d7a-bd9d-98d9006fedc3 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:56.926523 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 837/1687] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:18:56.931084 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558981e-bdb2-4056-badc-e7032b15d817 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:56.943902 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558981e-bdb2-4056-badc-e7032b15d817 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:56.981653 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50921fb-3318-4fb0-8154-aea5c14e5b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:56.984676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50921fb-3318-4fb0-8154-aea5c14e5b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:56.985061 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50921fb-3318-4fb0-8154-aea5c14e5b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:56.985341 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50921fb-3318-4fb0-8154-aea5c14e5b55 admin admin] PATH_INFO: `/v3/projects/201e99f4b0ec4ea19916b3a14ea7e33f/users/227992e178d444ca82f29ddf08a8e7b7/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:56.989207 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50921fb-3318-4fb0-8154-aea5c14e5b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=201e99f4b0ec4ea19916b3a14ea7e33f, user_id=227992e178d444ca82f29ddf08a8e7b7, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:56.993255 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50921fb-3318-4fb0-8154-aea5c14e5b55 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:57.009124 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 851/1688] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:18:56 2022] PUT /identity/v3/projects/201e99f4b0ec4ea19916b3a14ea7e33f/users/227992e178d444ca82f29ddf08a8e7b7/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:57.023880 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67612d1c-0f75-48b8-85c5-e31ce6f211c6 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:57.024174 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67612d1c-0f75-48b8-85c5-e31ce6f211c6 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:57.024455 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67612d1c-0f75-48b8-85c5-e31ce6f211c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:57.070821 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-67612d1c-0f75-48b8-85c5-e31ce6f211c6 None None] MFA Rules not processed for user `227992e178d444ca82f29ddf08a8e7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:57.073259 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-67612d1c-0f75-48b8-85c5-e31ce6f211c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:57.195355 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 838/1689] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:57 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:57.218224 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50921fb-3318-4fb0-8154-aea5c14e5b55 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:57.220119 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e50921fb-3318-4fb0-8154-aea5c14e5b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:57.346465 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50921fb-3318-4fb0-8154-aea5c14e5b55 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:57.348558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f759cd-681e-4a53-92b6-362c9ab044cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:57.350078 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f759cd-681e-4a53-92b6-362c9ab044cd service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:57.350078 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f759cd-681e-4a53-92b6-362c9ab044cd service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:57.350259 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f759cd-681e-4a53-92b6-362c9ab044cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:57.368307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f759cd-681e-4a53-92b6-362c9ab044cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:57.374151 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f759cd-681e-4a53-92b6-362c9ab044cd service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:57.397134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 852/1690] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:18:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:18:58.733808 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67612d1c-0f75-48b8-85c5-e31ce6f211c6 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:58.735456 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-67612d1c-0f75-48b8-85c5-e31ce6f211c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:58.813838 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f759cd-681e-4a53-92b6-362c9ab044cd service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:58.864970 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67612d1c-0f75-48b8-85c5-e31ce6f211c6 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:58.871577 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cf03d-a8c8-4d29-935d-0467ad461b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:58.872716 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cf03d-a8c8-4d29-935d-0467ad461b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:58.873162 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cf03d-a8c8-4d29-935d-0467ad461b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:58.873577 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cf03d-a8c8-4d29-935d-0467ad461b60 admin admin] PATH_INFO: `/v3/projects/e8616ec7833f42479c29f2e294175376` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:58.875077 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cf03d-a8c8-4d29-935d-0467ad461b60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8616ec7833f42479c29f2e294175376)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:58.877292 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cf03d-a8c8-4d29-935d-0467ad461b60 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:58.968696 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f759cd-681e-4a53-92b6-362c9ab044cd service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:58.978093 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91756c6-15ac-40c7-80e3-e29f4864437c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:58.979710 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91756c6-15ac-40c7-80e3-e29f4864437c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:58.980903 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91756c6-15ac-40c7-80e3-e29f4864437c admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:58.981328 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91756c6-15ac-40c7-80e3-e29f4864437c admin admin] PATH_INFO: `/v3/users/95f7b835b72d4a79b5b35d4dd85d5519` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:58.983015 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91756c6-15ac-40c7-80e3-e29f4864437c admin admin] RBAC: Authorizing `identity:delete_user(user_id=95f7b835b72d4a79b5b35d4dd85d5519)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:58.985191 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91756c6-15ac-40c7-80e3-e29f4864437c admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:59.052190 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-c96cf03d-a8c8-4d29-935d-0467ad461b60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8616ec7833f42479c29f2e294175376', 'request_id': 'req-c96cf03d-a8c8-4d29-935d-0467ad461b60'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:59.141536 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-c96cf03d-a8c8-4d29-935d-0467ad461b60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8616ec7833f42479c29f2e294175376', 'request_id': 'req-c96cf03d-a8c8-4d29-935d-0467ad461b60'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:59.147857 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-c96cf03d-a8c8-4d29-935d-0467ad461b60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8616ec7833f42479c29f2e294175376', 'request_id': 'req-c96cf03d-a8c8-4d29-935d-0467ad461b60'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:59.189552 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-c96cf03d-a8c8-4d29-935d-0467ad461b60 admin admin] The token cache is being invalidate because project e8616ec7833f42479c29f2e294175376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:18:59.189909 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-c96cf03d-a8c8-4d29-935d-0467ad461b60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:59.190514 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-c96cf03d-a8c8-4d29-935d-0467ad461b60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:59.192627 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 839/1691] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:18:58 2022] DELETE /identity/v3/projects/e8616ec7833f42479c29f2e294175376 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:18:59.197898 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4c155-7d4d-45b9-b60b-4ef2e783ba9d None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:59.198181 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4c155-7d4d-45b9-b60b-4ef2e783ba9d None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:59.198512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4c155-7d4d-45b9-b60b-4ef2e783ba9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:59.219505 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-c91756c6-15ac-40c7-80e3-e29f4864437c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95f7b835b72d4a79b5b35d4dd85d5519'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:59.245955 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-c91756c6-15ac-40c7-80e3-e29f4864437c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95f7b835b72d4a79b5b35d4dd85d5519'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:59.246888 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-c91756c6-15ac-40c7-80e3-e29f4864437c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95f7b835b72d4a79b5b35d4dd85d5519'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:59.250456 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-71f4c155-7d4d-45b9-b60b-4ef2e783ba9d None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:59.251013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-c91756c6-15ac-40c7-80e3-e29f4864437c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95f7b835b72d4a79b5b35d4dd85d5519'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:59.256142 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-71f4c155-7d4d-45b9-b60b-4ef2e783ba9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:59.273997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-c91756c6-15ac-40c7-80e3-e29f4864437c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95f7b835b72d4a79b5b35d4dd85d5519'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:18:59.383468 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 840/1692] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:59.393917 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c13ebd-c1c6-403c-8875-315238908156 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:59.394207 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c13ebd-c1c6-403c-8875-315238908156 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:59.394490 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c13ebd-c1c6-403c-8875-315238908156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:59.416276 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 853/1693] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:18:58 2022] DELETE /identity/v3/users/95f7b835b72d4a79b5b35d4dd85d5519 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:18:59.428780 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c640d4f-2b9d-4c4b-8eae-f11e66ddea8c None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:59.429725 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c640d4f-2b9d-4c4b-8eae-f11e66ddea8c None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:59.430277 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c640d4f-2b9d-4c4b-8eae-f11e66ddea8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:59.433719 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-d4c13ebd-c1c6-403c-8875-315238908156 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:59.434858 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-d4c13ebd-c1c6-403c-8875-315238908156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:59.496723 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-5c640d4f-2b9d-4c4b-8eae-f11e66ddea8c None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:18:59.500017 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-5c640d4f-2b9d-4c4b-8eae-f11e66ddea8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:59.570004 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 841/1694] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:18:59.575565 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c13ebd-c1c6-403c-8875-315238908156 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:59.590899 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c13ebd-c1c6-403c-8875-315238908156 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:59.599460 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d3f98-9f82-4dc3-8dc4-a707c94eed50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:59.600644 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d3f98-9f82-4dc3-8dc4-a707c94eed50 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:59.601155 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d3f98-9f82-4dc3-8dc4-a707c94eed50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:59.601641 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d3f98-9f82-4dc3-8dc4-a707c94eed50 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:59.602893 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d3f98-9f82-4dc3-8dc4-a707c94eed50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:18:59.603442 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d3f98-9f82-4dc3-8dc4-a707c94eed50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:59.605348 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d3f98-9f82-4dc3-8dc4-a707c94eed50 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:59.618490 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 842/1695] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:18:59.624720 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d3f98-9f82-4dc3-8dc4-a707c94eed50 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:59.644119 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d3f98-9f82-4dc3-8dc4-a707c94eed50 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:59.660116 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ac561-e263-4a0f-961e-dc7d80b3f99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:59.661294 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ac561-e263-4a0f-961e-dc7d80b3f99d admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:59.661803 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ac561-e263-4a0f-961e-dc7d80b3f99d admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:59.662292 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ac561-e263-4a0f-961e-dc7d80b3f99d admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:18:59.663751 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ac561-e263-4a0f-961e-dc7d80b3f99d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:18:59.667053 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ac561-e263-4a0f-961e-dc7d80b3f99d admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:18:59.674078 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 854/1696] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:18:59.690853 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c640d4f-2b9d-4c4b-8eae-f11e66ddea8c None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:59.692304 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-5c640d4f-2b9d-4c4b-8eae-f11e66ddea8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:18:59.802704 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 843/1697] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:18:59 2022] POST /identity/v3/projects => generated 363 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:18:59.804520 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ac561-e263-4a0f-961e-dc7d80b3f99d admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:18:59.842453 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c640d4f-2b9d-4c4b-8eae-f11e66ddea8c None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:18:59.921516 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d97cf3-abfa-4786-b4da-8a83773d5e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:18:59.922193 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d97cf3-abfa-4786-b4da-8a83773d5e5d service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:18:59.922473 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d97cf3-abfa-4786-b4da-8a83773d5e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:18:59.922755 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d97cf3-abfa-4786-b4da-8a83773d5e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:00.012967 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ac561-e263-4a0f-961e-dc7d80b3f99d admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:00.030030 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7c844-4529-4e21-8c51-e714f473d8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:00.033737 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7c844-4529-4e21-8c51-e714f473d8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:00.034995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7c844-4529-4e21-8c51-e714f473d8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:00.035410 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7c844-4529-4e21-8c51-e714f473d8a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:00.037500 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7c844-4529-4e21-8c51-e714f473d8a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:00.045679 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7c844-4529-4e21-8c51-e714f473d8a7 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:00.116609 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d97cf3-abfa-4786-b4da-8a83773d5e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:00.118540 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d97cf3-abfa-4786-b4da-8a83773d5e5d service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:00.151947 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 855/1698] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:18:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:00.210332 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a8ac9-6f89-4302-b379-02a73cd77d52 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:00.210808 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a8ac9-6f89-4302-b379-02a73cd77d52 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:00.215441 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 844/1699] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:18:59 2022] POST /identity/v3/users => generated 282 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:19:00.216518 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7c844-4529-4e21-8c51-e714f473d8a7 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:00.217502 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a8ac9-6f89-4302-b379-02a73cd77d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:00.234009 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7c844-4529-4e21-8c51-e714f473d8a7 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:00.240354 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75ab31-fb14-4433-be88-44d1080c4fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:00.241277 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75ab31-fb14-4433-be88-44d1080c4fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:00.242181 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75ab31-fb14-4433-be88-44d1080c4fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:00.242619 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75ab31-fb14-4433-be88-44d1080c4fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:00.243480 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75ab31-fb14-4433-be88-44d1080c4fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:00.246044 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75ab31-fb14-4433-be88-44d1080c4fd9 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:00.268328 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 845/1700] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:00.273711 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75ab31-fb14-4433-be88-44d1080c4fd9 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:00.289251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75ab31-fb14-4433-be88-44d1080c4fd9 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:00.306565 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-fe5a8ac9-6f89-4302-b379-02a73cd77d52 None None] MFA Rules not processed for user `658d1271fb264cb59e62a921492457c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:00.307810 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-fe5a8ac9-6f89-4302-b379-02a73cd77d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:00.312960 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edc451-3029-444c-aaa1-ca46715cfaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:00.313658 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edc451-3029-444c-aaa1-ca46715cfaaf admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:00.313939 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edc451-3029-444c-aaa1-ca46715cfaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:00.314218 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edc451-3029-444c-aaa1-ca46715cfaaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:00.314960 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edc451-3029-444c-aaa1-ca46715cfaaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:00.320349 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edc451-3029-444c-aaa1-ca46715cfaaf admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:00.351567 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 846/1701] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:00.352427 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edc451-3029-444c-aaa1-ca46715cfaaf admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:00.382773 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edc451-3029-444c-aaa1-ca46715cfaaf admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:00.402343 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d33e9-2763-457a-a5ac-81966f00294a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:00.407180 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d33e9-2763-457a-a5ac-81966f00294a admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:00.407573 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d33e9-2763-457a-a5ac-81966f00294a admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:00.407815 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d33e9-2763-457a-a5ac-81966f00294a admin admin] PATH_INFO: `/v3/projects/4b7081174074414d937202d39ab81689/users/e932a66e996c48ba94a159755a1a1d05/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:00.450043 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d33e9-2763-457a-a5ac-81966f00294a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b7081174074414d937202d39ab81689, user_id=e932a66e996c48ba94a159755a1a1d05, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:00.452828 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d33e9-2763-457a-a5ac-81966f00294a admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:00.559966 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 856/1702] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:00.570209 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a0e2a-2c4a-404c-b175-3718924fee4b None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:00.570704 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a0e2a-2c4a-404c-b175-3718924fee4b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:00.575506 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a0e2a-2c4a-404c-b175-3718924fee4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:00.607578 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 847/1703] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:00 2022] PUT /identity/v3/projects/4b7081174074414d937202d39ab81689/users/e932a66e996c48ba94a159755a1a1d05/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:00.622316 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868ac67-e233-4731-a889-ad8813539292 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:00.622879 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868ac67-e233-4731-a889-ad8813539292 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:00.625201 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868ac67-e233-4731-a889-ad8813539292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:00.656476 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-646a0e2a-2c4a-404c-b175-3718924fee4b None None] MFA Rules not processed for user `658d1271fb264cb59e62a921492457c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:00.657741 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-646a0e2a-2c4a-404c-b175-3718924fee4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:00.721822 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-5868ac67-e233-4731-a889-ad8813539292 None None] MFA Rules not processed for user `e932a66e996c48ba94a159755a1a1d05`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:00.723075 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-5868ac67-e233-4731-a889-ad8813539292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:00.921152 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 857/1704] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:19:00.938367 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a0e2a-2c4a-404c-b175-3718924fee4b None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:00.940875 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-646a0e2a-2c4a-404c-b175-3718924fee4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:00.964541 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 848/1705] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:00.968966 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868ac67-e233-4731-a889-ad8813539292 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:01.155100 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868ac67-e233-4731-a889-ad8813539292 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:01.176485 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d373ce-c479-4d0a-833c-275872535058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:01.177606 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d373ce-c479-4d0a-833c-275872535058 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:01.178032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d373ce-c479-4d0a-833c-275872535058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:01.178477 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d373ce-c479-4d0a-833c-275872535058 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:01.178894 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a0e2a-2c4a-404c-b175-3718924fee4b None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:01.179484 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d373ce-c479-4d0a-833c-275872535058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:01.196638 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf53246-0f66-4453-af4a-e949ad4388f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:01.199834 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf53246-0f66-4453-af4a-e949ad4388f0 service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:01.199834 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf53246-0f66-4453-af4a-e949ad4388f0 service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:01.199834 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf53246-0f66-4453-af4a-e949ad4388f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:01.215572 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d373ce-c479-4d0a-833c-275872535058 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:01.222469 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf53246-0f66-4453-af4a-e949ad4388f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:01.224160 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf53246-0f66-4453-af4a-e949ad4388f0 service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:01.261804 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 858/1706] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:19:01.348538 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b16b2-2a32-4595-a767-708a895c43f9 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:01.348831 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b16b2-2a32-4595-a767-708a895c43f9 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:01.349110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b16b2-2a32-4595-a767-708a895c43f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:01.395084 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 849/1707] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:00 2022] POST /identity/v3/projects => generated 365 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:19:01.405024 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d373ce-c479-4d0a-833c-275872535058 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:01.410041 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-f58b16b2-2a32-4595-a767-708a895c43f9 None None] MFA Rules not processed for user `728607c7138540d69532b0b806b9ccaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:01.411414 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f58b16b2-2a32-4595-a767-708a895c43f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:01.583103 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d373ce-c479-4d0a-833c-275872535058 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:01.593432 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49093a4c-6cf1-4367-b0d9-71c764f696f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:01.608027 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 859/1708] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:01.610904 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49093a4c-6cf1-4367-b0d9-71c764f696f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:01.612065 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49093a4c-6cf1-4367-b0d9-71c764f696f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:01.613162 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49093a4c-6cf1-4367-b0d9-71c764f696f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:01.619548 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49093a4c-6cf1-4367-b0d9-71c764f696f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:01.622879 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49093a4c-6cf1-4367-b0d9-71c764f696f5 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:01.726593 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 850/1709] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:01 2022] POST /identity/v3/users => generated 289 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:01.728671 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b16b2-2a32-4595-a767-708a895c43f9 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:01.746599 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b16b2-2a32-4595-a767-708a895c43f9 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:01.757119 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3957116-df11-4c09-a383-109511e8c5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:01.757913 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3957116-df11-4c09-a383-109511e8c5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:01.758297 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3957116-df11-4c09-a383-109511e8c5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:01.758668 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3957116-df11-4c09-a383-109511e8c5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:01.767035 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3957116-df11-4c09-a383-109511e8c5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:01.769070 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3957116-df11-4c09-a383-109511e8c5c2 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:01.800261 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 860/1710] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:01.802145 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49093a4c-6cf1-4367-b0d9-71c764f696f5 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:01.854092 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49093a4c-6cf1-4367-b0d9-71c764f696f5 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:01.894338 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5560078-1663-470b-a935-398250a000e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:01.894577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3957116-df11-4c09-a383-109511e8c5c2 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:01.896470 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e3957116-df11-4c09-a383-109511e8c5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:01.897440 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5560078-1663-470b-a935-398250a000e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:01.897792 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5560078-1663-470b-a935-398250a000e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:01.898087 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5560078-1663-470b-a935-398250a000e0 admin admin] PATH_INFO: `/v3/projects/604164d22cd940f7bd51232035ff19be/users/a6977611c4f74c6fad2eba744c5cbc37/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:01.928041 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5560078-1663-470b-a935-398250a000e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=604164d22cd940f7bd51232035ff19be, user_id=a6977611c4f74c6fad2eba744c5cbc37, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:01.932560 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5560078-1663-470b-a935-398250a000e0 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:02.064351 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 851/1711] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:01 2022] PUT /identity/v3/projects/604164d22cd940f7bd51232035ff19be/users/a6977611c4f74c6fad2eba744c5cbc37/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:02.079757 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5560078-1663-470b-a935-398250a000e0 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:02.170733 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3957116-df11-4c09-a383-109511e8c5c2 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:02.199362 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5560078-1663-470b-a935-398250a000e0 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:02.205448 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f87d2-a398-4e12-8594-74c2e7a585d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:02.209689 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f87d2-a398-4e12-8594-74c2e7a585d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:02.209689 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f87d2-a398-4e12-8594-74c2e7a585d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:02.209689 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f87d2-a398-4e12-8594-74c2e7a585d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:02.209689 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f87d2-a398-4e12-8594-74c2e7a585d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:02.211127 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f87d2-a398-4e12-8594-74c2e7a585d5 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:02.225000 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 852/1712] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:02.229751 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f87d2-a398-4e12-8594-74c2e7a585d5 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:02.242781 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f87d2-a398-4e12-8594-74c2e7a585d5 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:02.255652 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6a642-bc47-4d0c-a890-8581250e65cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:02.256948 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6a642-bc47-4d0c-a890-8581250e65cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:02.259900 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6a642-bc47-4d0c-a890-8581250e65cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:02.260521 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6a642-bc47-4d0c-a890-8581250e65cd admin admin] PATH_INFO: `/v3/projects/604164d22cd940f7bd51232035ff19be/users/a6977611c4f74c6fad2eba744c5cbc37/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:02.265842 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6a642-bc47-4d0c-a890-8581250e65cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=604164d22cd940f7bd51232035ff19be, user_id=a6977611c4f74c6fad2eba744c5cbc37, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:02.270340 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6a642-bc47-4d0c-a890-8581250e65cd admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:02.296733 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 853/1713] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:02 2022] PUT /identity/v3/projects/604164d22cd940f7bd51232035ff19be/users/a6977611c4f74c6fad2eba744c5cbc37/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:02.306887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ff057-54bc-4aa0-8125-c598c7fd1c4a None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:02.307320 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ff057-54bc-4aa0-8125-c598c7fd1c4a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:02.307705 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ff057-54bc-4aa0-8125-c598c7fd1c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:02.373110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed9149-383e-4d2d-a968-88ee92c5be7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:02.373875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-962ff057-54bc-4aa0-8125-c598c7fd1c4a None None] MFA Rules not processed for user `a6977611c4f74c6fad2eba744c5cbc37`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:02.373990 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed9149-383e-4d2d-a968-88ee92c5be7d service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:02.375406 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-962ff057-54bc-4aa0-8125-c598c7fd1c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:02.377023 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed9149-383e-4d2d-a968-88ee92c5be7d service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:02.377023 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed9149-383e-4d2d-a968-88ee92c5be7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:02.502052 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed9149-383e-4d2d-a968-88ee92c5be7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:02.506246 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed9149-383e-4d2d-a968-88ee92c5be7d service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:02.532253 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 861/1714] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:19:02.534346 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed9149-383e-4d2d-a968-88ee92c5be7d service nova] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:02.540317 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-6eed9149-383e-4d2d-a968-88ee92c5be7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:02.581466 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed9149-383e-4d2d-a968-88ee92c5be7d service nova] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:02.626657 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 854/1715] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:02.629707 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8f514-2f51-4da3-ab49-4f211cc09ce6 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:02.629999 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8f514-2f51-4da3-ab49-4f211cc09ce6 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:02.630280 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8f514-2f51-4da3-ab49-4f211cc09ce6 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:02.639171 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 855/1716] 10.222.0.52 () {54 vars in 912 bytes} [Tue Mar 8 13:19:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:19:02.640092 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8f514-2f51-4da3-ab49-4f211cc09ce6 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:02.644092 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b6d8f514-2f51-4da3-ab49-4f211cc09ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:02.767124 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6605b-f26a-4134-b01f-4f3adcb71d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:02.768209 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6605b-f26a-4134-b01f-4f3adcb71d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:02.768500 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6605b-f26a-4134-b01f-4f3adcb71d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:02.769317 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6605b-f26a-4134-b01f-4f3adcb71d3c admin admin] PATH_INFO: `/v3/projects/f58d67c33b504b549ab1fa60c2208359` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:02.773783 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6605b-f26a-4134-b01f-4f3adcb71d3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f58d67c33b504b549ab1fa60c2208359)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:02.780274 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6605b-f26a-4134-b01f-4f3adcb71d3c admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:02.816198 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8f514-2f51-4da3-ab49-4f211cc09ce6 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:02.837437 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d3406-4743-4c6e-91d1-729e71b5a385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:02.838112 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d3406-4743-4c6e-91d1-729e71b5a385 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:02.838467 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d3406-4743-4c6e-91d1-729e71b5a385 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:02.840526 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d3406-4743-4c6e-91d1-729e71b5a385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:02.863209 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d3406-4743-4c6e-91d1-729e71b5a385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:02.869711 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d3406-4743-4c6e-91d1-729e71b5a385 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:02.905550 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 856/1717] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:02.921875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6821dc3-a98d-4af4-8176-1d48ebe4ecc4 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:02.924648 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6821dc3-a98d-4af4-8176-1d48ebe4ecc4 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:02.924648 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6821dc3-a98d-4af4-8176-1d48ebe4ecc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:02.951058 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-c6821dc3-a98d-4af4-8176-1d48ebe4ecc4 None None] MFA Rules not processed for user `22bf06400d8f47f4bb3badd7f65bc205`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:02.952868 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c6821dc3-a98d-4af4-8176-1d48ebe4ecc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:02.970491 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9bd6605b-f26a-4134-b01f-4f3adcb71d3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f58d67c33b504b549ab1fa60c2208359', 'request_id': 'req-9bd6605b-f26a-4134-b01f-4f3adcb71d3c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:02.990897 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9bd6605b-f26a-4134-b01f-4f3adcb71d3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f58d67c33b504b549ab1fa60c2208359', 'request_id': 'req-9bd6605b-f26a-4134-b01f-4f3adcb71d3c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:02.990897 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9bd6605b-f26a-4134-b01f-4f3adcb71d3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f58d67c33b504b549ab1fa60c2208359', 'request_id': 'req-9bd6605b-f26a-4134-b01f-4f3adcb71d3c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:03.109173 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9bd6605b-f26a-4134-b01f-4f3adcb71d3c admin admin] The token cache is being invalidate because project f58d67c33b504b549ab1fa60c2208359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:19:03.109460 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9bd6605b-f26a-4134-b01f-4f3adcb71d3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:03.110469 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9bd6605b-f26a-4134-b01f-4f3adcb71d3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:03.116229 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 862/1718] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:19:02 2022] DELETE /identity/v3/projects/f58d67c33b504b549ab1fa60c2208359 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:03.125003 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6605b-f26a-4134-b01f-4f3adcb71d3c admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:03.131253 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9bd6605b-f26a-4134-b01f-4f3adcb71d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:03.186230 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 857/1719] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 13:19:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:03.196209 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66507f-cfaf-4d4f-8c0e-84842dba0a8a None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:03.198107 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66507f-cfaf-4d4f-8c0e-84842dba0a8a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:03.198409 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66507f-cfaf-4d4f-8c0e-84842dba0a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:03.259436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-1b66507f-cfaf-4d4f-8c0e-84842dba0a8a None None] MFA Rules not processed for user `556058de7b9f48b8a10188ec64496e72`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:03.260959 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1b66507f-cfaf-4d4f-8c0e-84842dba0a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:03.358584 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6605b-f26a-4134-b01f-4f3adcb71d3c admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:03.376285 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3350f-cfdf-4dc3-8c5a-c05a2ebe170f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:03.377493 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3350f-cfdf-4dc3-8c5a-c05a2ebe170f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:03.377834 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3350f-cfdf-4dc3-8c5a-c05a2ebe170f admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:03.378119 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3350f-cfdf-4dc3-8c5a-c05a2ebe170f admin admin] PATH_INFO: `/v3/users/227992e178d444ca82f29ddf08a8e7b7` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:03.381574 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3350f-cfdf-4dc3-8c5a-c05a2ebe170f admin admin] RBAC: Authorizing `identity:delete_user(user_id=227992e178d444ca82f29ddf08a8e7b7)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:03.386969 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3350f-cfdf-4dc3-8c5a-c05a2ebe170f admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:03.427478 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 858/1720] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 13:19:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:03.428484 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66507f-cfaf-4d4f-8c0e-84842dba0a8a None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:03.430244 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1b66507f-cfaf-4d4f-8c0e-84842dba0a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:03.472706 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66507f-cfaf-4d4f-8c0e-84842dba0a8a None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:03.505264 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2714c-805f-469b-bad1-73ce36516800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:03.517311 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2714c-805f-469b-bad1-73ce36516800 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:03.521405 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2714c-805f-469b-bad1-73ce36516800 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:03.522729 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2714c-805f-469b-bad1-73ce36516800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:03.546997 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2714c-805f-469b-bad1-73ce36516800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:03.558422 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2714c-805f-469b-bad1-73ce36516800 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:03.596626 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 859/1721] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:03.597813 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2714c-805f-469b-bad1-73ce36516800 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:03.607937 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-9eb2714c-805f-469b-bad1-73ce36516800 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:03.765171 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2714c-805f-469b-bad1-73ce36516800 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:03.783602 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0da49e-934e-4f16-9324-bb50d628ba32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:03.788047 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1af3350f-cfdf-4dc3-8c5a-c05a2ebe170f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '227992e178d444ca82f29ddf08a8e7b7'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:03.788215 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0da49e-934e-4f16-9324-bb50d628ba32 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:03.788215 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0da49e-934e-4f16-9324-bb50d628ba32 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:03.788215 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0da49e-934e-4f16-9324-bb50d628ba32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:03.795666 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1a0da49e-934e-4f16-9324-bb50d628ba32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:03.848580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1af3350f-cfdf-4dc3-8c5a-c05a2ebe170f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '227992e178d444ca82f29ddf08a8e7b7'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:03.850030 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1af3350f-cfdf-4dc3-8c5a-c05a2ebe170f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '227992e178d444ca82f29ddf08a8e7b7'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:03.850721 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1af3350f-cfdf-4dc3-8c5a-c05a2ebe170f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '227992e178d444ca82f29ddf08a8e7b7'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:03.873038 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1af3350f-cfdf-4dc3-8c5a-c05a2ebe170f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '227992e178d444ca82f29ddf08a8e7b7'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:03.925484 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0da49e-934e-4f16-9324-bb50d628ba32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:03.927467 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0da49e-934e-4f16-9324-bb50d628ba32 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:03.947033 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 860/1722] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:03 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:03.948288 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0da49e-934e-4f16-9324-bb50d628ba32 service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:03.949938 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1a0da49e-934e-4f16-9324-bb50d628ba32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:03.970001 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0da49e-934e-4f16-9324-bb50d628ba32 service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:03.976556 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b4ae3-484b-4e80-96a8-83327907e186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:03.978709 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4ae3-484b-4e80-96a8-83327907e186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:03.979301 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4ae3-484b-4e80-96a8-83327907e186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:03.979772 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4ae3-484b-4e80-96a8-83327907e186 admin admin] PATH_INFO: `/v3/users/d3e11eebb9874367bc98012fc546f06f` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:03.981786 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b4ae3-484b-4e80-96a8-83327907e186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3e11eebb9874367bc98012fc546f06f)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:03.984647 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b4ae3-484b-4e80-96a8-83327907e186 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:04.011377 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 863/1723] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:19:03 2022] DELETE /identity/v3/users/227992e178d444ca82f29ddf08a8e7b7 => generated 0 bytes in 880 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:04.047607 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3350f-cfdf-4dc3-8c5a-c05a2ebe170f admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:04.049297 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-1af3350f-cfdf-4dc3-8c5a-c05a2ebe170f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:04.272705 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f01b4ae3-484b-4e80-96a8-83327907e186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3e11eebb9874367bc98012fc546f06f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:04.275300 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3350f-cfdf-4dc3-8c5a-c05a2ebe170f admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:04.296286 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0ff87-54aa-45c1-82d8-b032fb81b37e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f375d86747d248fa95f487b073d92d83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:04.296286 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0ff87-54aa-45c1-82d8-b032fb81b37e service swift] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:04.296286 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0ff87-54aa-45c1-82d8-b032fb81b37e service swift] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:04.296286 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0ff87-54aa-45c1-82d8-b032fb81b37e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:04.299677 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-5fe0ff87-54aa-45c1-82d8-b032fb81b37e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:04.301841 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f01b4ae3-484b-4e80-96a8-83327907e186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3e11eebb9874367bc98012fc546f06f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:04.305046 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f01b4ae3-484b-4e80-96a8-83327907e186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3e11eebb9874367bc98012fc546f06f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:04.384553 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0ff87-54aa-45c1-82d8-b032fb81b37e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:04.386404 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0ff87-54aa-45c1-82d8-b032fb81b37e service swift] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:04.395600 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 864/1724] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 13:19:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 08 13:19:04.398011 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25262b-7910-44b1-a7b5-7b6bca683559 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:04.398640 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25262b-7910-44b1-a7b5-7b6bca683559 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:04.400790 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25262b-7910-44b1-a7b5-7b6bca683559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:04.403500 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f01b4ae3-484b-4e80-96a8-83327907e186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3e11eebb9874367bc98012fc546f06f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:04.404103 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f01b4ae3-484b-4e80-96a8-83327907e186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3e11eebb9874367bc98012fc546f06f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:04.440853 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 861/1725] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:19:03 2022] DELETE /identity/v3/users/d3e11eebb9874367bc98012fc546f06f => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:04.443277 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-be25262b-7910-44b1-a7b5-7b6bca683559 None None] MFA Rules not processed for user `ced48ea897124de6b874e797b6d74f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:04.444902 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-be25262b-7910-44b1-a7b5-7b6bca683559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:04.607082 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 865/1726] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:04.769185 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b4ae3-484b-4e80-96a8-83327907e186 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:04.774718 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f01b4ae3-484b-4e80-96a8-83327907e186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:05.037399 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b4ae3-484b-4e80-96a8-83327907e186 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:05.061869 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8536d-9371-472f-942c-12d089cd89c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:05.065875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8536d-9371-472f-942c-12d089cd89c3 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:05.066699 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8536d-9371-472f-942c-12d089cd89c3 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:05.067754 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8536d-9371-472f-942c-12d089cd89c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:05.104414 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8536d-9371-472f-942c-12d089cd89c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:05.106232 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8536d-9371-472f-942c-12d089cd89c3 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:05.136615 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 862/1727] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:05.194869 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25262b-7910-44b1-a7b5-7b6bca683559 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:05.196774 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-be25262b-7910-44b1-a7b5-7b6bca683559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:05.320444 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25262b-7910-44b1-a7b5-7b6bca683559 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:05.334337 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2efa1-5352-42ce-93ec-68d6858e5ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:05.337015 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2efa1-5352-42ce-93ec-68d6858e5ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:05.340300 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2efa1-5352-42ce-93ec-68d6858e5ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:05.341263 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2efa1-5352-42ce-93ec-68d6858e5ee6 admin admin] PATH_INFO: `/v3/projects/8d013f7d765545429b9f5f7204af9e22` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:05.346442 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2efa1-5352-42ce-93ec-68d6858e5ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d013f7d765545429b9f5f7204af9e22)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:05.348637 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2efa1-5352-42ce-93ec-68d6858e5ee6 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:05.595616 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-15d2efa1-5352-42ce-93ec-68d6858e5ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d013f7d765545429b9f5f7204af9e22', 'request_id': 'req-15d2efa1-5352-42ce-93ec-68d6858e5ee6'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:05.612238 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-15d2efa1-5352-42ce-93ec-68d6858e5ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d013f7d765545429b9f5f7204af9e22', 'request_id': 'req-15d2efa1-5352-42ce-93ec-68d6858e5ee6'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:05.625680 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-15d2efa1-5352-42ce-93ec-68d6858e5ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d013f7d765545429b9f5f7204af9e22', 'request_id': 'req-15d2efa1-5352-42ce-93ec-68d6858e5ee6'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:05.734054 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-15d2efa1-5352-42ce-93ec-68d6858e5ee6 admin admin] The token cache is being invalidate because project 8d013f7d765545429b9f5f7204af9e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:19:05.734350 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-15d2efa1-5352-42ce-93ec-68d6858e5ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:05.741377 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-15d2efa1-5352-42ce-93ec-68d6858e5ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:05.742944 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 866/1728] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:19:05 2022] DELETE /identity/v3/projects/8d013f7d765545429b9f5f7204af9e22 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:05.747708 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8536d-9371-472f-942c-12d089cd89c3 service nova] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:05.765228 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8536d-9371-472f-942c-12d089cd89c3 service nova] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:05.871036 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3940b-c77c-42d3-b09c-58e92f69011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:05.871925 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3940b-c77c-42d3-b09c-58e92f69011b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:05.872205 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3940b-c77c-42d3-b09c-58e92f69011b admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:05.872651 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3940b-c77c-42d3-b09c-58e92f69011b admin admin] PATH_INFO: `/v3/users/de8944439f6a4010bc293b6790e5092a` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:05.897215 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3940b-c77c-42d3-b09c-58e92f69011b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de8944439f6a4010bc293b6790e5092a)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:05.902840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3940b-c77c-42d3-b09c-58e92f69011b admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:06.323793 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f7f28-be17-4054-9c56-da39d2240ba6 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:06.323793 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f7f28-be17-4054-9c56-da39d2240ba6 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:06.323793 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f7f28-be17-4054-9c56-da39d2240ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:06.323793 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-ca8f7f28-be17-4054-9c56-da39d2240ba6 None None] MFA Rules not processed for user `22bf06400d8f47f4bb3badd7f65bc205`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:06.323793 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-ca8f7f28-be17-4054-9c56-da39d2240ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:06.323793 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 867/1729] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Mar 8 13:19:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:06.324813 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f7f28-be17-4054-9c56-da39d2240ba6 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:06.324813 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-ca8f7f28-be17-4054-9c56-da39d2240ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:06.342907 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f7f28-be17-4054-9c56-da39d2240ba6 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:06.376542 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120c7d7-0faf-4b5b-99de-3d6e0c6d8ff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:06.377185 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120c7d7-0faf-4b5b-99de-3d6e0c6d8ff3 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:06.377469 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120c7d7-0faf-4b5b-99de-3d6e0c6d8ff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:06.377754 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120c7d7-0faf-4b5b-99de-3d6e0c6d8ff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:06.396717 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120c7d7-0faf-4b5b-99de-3d6e0c6d8ff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:06.399312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120c7d7-0faf-4b5b-99de-3d6e0c6d8ff3 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:06.449467 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 868/1730] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:19:06.599338 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-d8a3940b-c77c-42d3-b09c-58e92f69011b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de8944439f6a4010bc293b6790e5092a'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:06.648349 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-d8a3940b-c77c-42d3-b09c-58e92f69011b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de8944439f6a4010bc293b6790e5092a'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:06.651620 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-d8a3940b-c77c-42d3-b09c-58e92f69011b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de8944439f6a4010bc293b6790e5092a'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:06.674302 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120c7d7-0faf-4b5b-99de-3d6e0c6d8ff3 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:06.683451 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-c120c7d7-0faf-4b5b-99de-3d6e0c6d8ff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:06.711286 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120c7d7-0faf-4b5b-99de-3d6e0c6d8ff3 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:06.743530 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-d8a3940b-c77c-42d3-b09c-58e92f69011b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de8944439f6a4010bc293b6790e5092a'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:06.744391 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-d8a3940b-c77c-42d3-b09c-58e92f69011b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de8944439f6a4010bc293b6790e5092a'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:06.768122 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceafd51-e415-402d-af0c-5ee43ec46e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:06.768841 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceafd51-e415-402d-af0c-5ee43ec46e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:06.769127 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceafd51-e415-402d-af0c-5ee43ec46e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:06.769404 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceafd51-e415-402d-af0c-5ee43ec46e5f admin admin] PATH_INFO: `/v3/projects/201e99f4b0ec4ea19916b3a14ea7e33f` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:06.772013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceafd51-e415-402d-af0c-5ee43ec46e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=201e99f4b0ec4ea19916b3a14ea7e33f)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:06.774015 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceafd51-e415-402d-af0c-5ee43ec46e5f admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:06.797990 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 863/1731] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:19:05 2022] DELETE /identity/v3/users/de8944439f6a4010bc293b6790e5092a => generated 0 bytes in 1043 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:06.927567 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3940b-c77c-42d3-b09c-58e92f69011b admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:06.929318 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-d8a3940b-c77c-42d3-b09c-58e92f69011b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:06.988853 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dceafd51-e415-402d-af0c-5ee43ec46e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '201e99f4b0ec4ea19916b3a14ea7e33f', 'request_id': 'req-dceafd51-e415-402d-af0c-5ee43ec46e5f'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:07.003776 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dceafd51-e415-402d-af0c-5ee43ec46e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '201e99f4b0ec4ea19916b3a14ea7e33f', 'request_id': 'req-dceafd51-e415-402d-af0c-5ee43ec46e5f'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:07.041771 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dceafd51-e415-402d-af0c-5ee43ec46e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '201e99f4b0ec4ea19916b3a14ea7e33f', 'request_id': 'req-dceafd51-e415-402d-af0c-5ee43ec46e5f'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:07.175748 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3940b-c77c-42d3-b09c-58e92f69011b admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:07.176285 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dceafd51-e415-402d-af0c-5ee43ec46e5f admin admin] The token cache is being invalidate because project 201e99f4b0ec4ea19916b3a14ea7e33f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:19:07.176285 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dceafd51-e415-402d-af0c-5ee43ec46e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:07.176285 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dceafd51-e415-402d-af0c-5ee43ec46e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:07.177611 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 869/1732] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:19:06 2022] DELETE /identity/v3/projects/201e99f4b0ec4ea19916b3a14ea7e33f => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:07.181166 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a2f3c-2b13-4598-80a4-91fd1b725851 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:07.181477 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a2f3c-2b13-4598-80a4-91fd1b725851 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:07.181756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a2f3c-2b13-4598-80a4-91fd1b725851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:07.295271 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-627a2f3c-2b13-4598-80a4-91fd1b725851 None None] MFA Rules not processed for user `658d1271fb264cb59e62a921492457c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:07.297391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-627a2f3c-2b13-4598-80a4-91fd1b725851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:07.375186 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54835365-593c-4c83-9dd4-9097609afc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:07.381788 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54835365-593c-4c83-9dd4-9097609afc12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:07.381788 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54835365-593c-4c83-9dd4-9097609afc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:07.381788 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54835365-593c-4c83-9dd4-9097609afc12 admin admin] PATH_INFO: `/v3/users/6d322b32be774f5796557c05626e994e` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:07.381788 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54835365-593c-4c83-9dd4-9097609afc12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d322b32be774f5796557c05626e994e)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:07.382499 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54835365-593c-4c83-9dd4-9097609afc12 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:07.564535 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 870/1733] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:07.572857 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42210e9e-c9e2-40ca-9621-72282a9d06b0 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:07.573311 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42210e9e-c9e2-40ca-9621-72282a9d06b0 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:07.579083 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42210e9e-c9e2-40ca-9621-72282a9d06b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:07.647749 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-42210e9e-c9e2-40ca-9621-72282a9d06b0 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:07.649218 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-42210e9e-c9e2-40ca-9621-72282a9d06b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:07.679564 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 871/1734] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:07.689690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744145be-8883-48b3-9354-4b5b7d9ccef7 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:07.689907 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744145be-8883-48b3-9354-4b5b7d9ccef7 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:07.690193 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744145be-8883-48b3-9354-4b5b7d9ccef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:07.719333 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-54835365-593c-4c83-9dd4-9097609afc12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d322b32be774f5796557c05626e994e'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:07.759664 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-744145be-8883-48b3-9354-4b5b7d9ccef7 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:07.769076 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-744145be-8883-48b3-9354-4b5b7d9ccef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:07.794405 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-54835365-593c-4c83-9dd4-9097609afc12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d322b32be774f5796557c05626e994e'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:07.794609 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 872/1735] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:07.795544 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744145be-8883-48b3-9354-4b5b7d9ccef7 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:07.800686 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-54835365-593c-4c83-9dd4-9097609afc12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d322b32be774f5796557c05626e994e'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:07.820217 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744145be-8883-48b3-9354-4b5b7d9ccef7 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:07.842960 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f27612-6e3e-4125-a035-8ab0e56930b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:07.844372 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f27612-6e3e-4125-a035-8ab0e56930b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:07.844372 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f27612-6e3e-4125-a035-8ab0e56930b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:07.853397 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f27612-6e3e-4125-a035-8ab0e56930b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:07.854667 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f27612-6e3e-4125-a035-8ab0e56930b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:19:07.858473 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f27612-6e3e-4125-a035-8ab0e56930b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:07.860404 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f27612-6e3e-4125-a035-8ab0e56930b9 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:07.885992 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 873/1736] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:19:07.887791 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f27612-6e3e-4125-a035-8ab0e56930b9 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:07.897577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b9f27612-6e3e-4125-a035-8ab0e56930b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:07.940863 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f27612-6e3e-4125-a035-8ab0e56930b9 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:07.954884 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b0d8b-9ef8-42a6-8358-46a637b27716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:07.955794 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b0d8b-9ef8-42a6-8358-46a637b27716 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:07.956282 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b0d8b-9ef8-42a6-8358-46a637b27716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:07.956818 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b0d8b-9ef8-42a6-8358-46a637b27716 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:07.958866 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b0d8b-9ef8-42a6-8358-46a637b27716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:07.961187 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b0d8b-9ef8-42a6-8358-46a637b27716 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:07.962607 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-54835365-593c-4c83-9dd4-9097609afc12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d322b32be774f5796557c05626e994e'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:07.963681 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-54835365-593c-4c83-9dd4-9097609afc12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d322b32be774f5796557c05626e994e'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:07.999869 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 864/1737] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:19:06 2022] DELETE /identity/v3/users/6d322b32be774f5796557c05626e994e => generated 0 bytes in 1073 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:08.004309 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb8c3c-ee71-436c-b2f7-52551832d6b2 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:08.007789 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb8c3c-ee71-436c-b2f7-52551832d6b2 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:08.007789 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb8c3c-ee71-436c-b2f7-52551832d6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:08.042493 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-79bb8c3c-ee71-436c-b2f7-52551832d6b2 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:08.044787 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-79bb8c3c-ee71-436c-b2f7-52551832d6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:08.104519 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 874/1738] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:07 2022] POST /identity/v3/projects => generated 363 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:08.109307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b0d8b-9ef8-42a6-8358-46a637b27716 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:08.195840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 865/1739] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:19:08.266073 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb8c3c-ee71-436c-b2f7-52551832d6b2 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:08.275546 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-79bb8c3c-ee71-436c-b2f7-52551832d6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:08.355526 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b0d8b-9ef8-42a6-8358-46a637b27716 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:08.390790 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c848a-251a-4d03-8b2b-9bbabfb52250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:08.392112 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c848a-251a-4d03-8b2b-9bbabfb52250 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:08.392623 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c848a-251a-4d03-8b2b-9bbabfb52250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:08.393142 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c848a-251a-4d03-8b2b-9bbabfb52250 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:08.394325 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c848a-251a-4d03-8b2b-9bbabfb52250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:08.397435 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c848a-251a-4d03-8b2b-9bbabfb52250 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:08.535626 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb8c3c-ee71-436c-b2f7-52551832d6b2 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:08.563633 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 875/1740] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:08 2022] POST /identity/v3/users => generated 282 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:08.563633 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c848a-251a-4d03-8b2b-9bbabfb52250 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:08.616725 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c848a-251a-4d03-8b2b-9bbabfb52250 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:08.631638 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb894c-21f7-4f7c-b67d-ae6d981a629a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:08.632451 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb894c-21f7-4f7c-b67d-ae6d981a629a admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:08.632877 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb894c-21f7-4f7c-b67d-ae6d981a629a admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:08.633300 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb894c-21f7-4f7c-b67d-ae6d981a629a admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:08.637094 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb894c-21f7-4f7c-b67d-ae6d981a629a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:08.643264 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb894c-21f7-4f7c-b67d-ae6d981a629a admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:08.659664 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 876/1741] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:19:08.667467 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb894c-21f7-4f7c-b67d-ae6d981a629a admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:08.684953 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb894c-21f7-4f7c-b67d-ae6d981a629a admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:08.711645 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb540e4a-cfbc-410e-8191-f3e3897e1141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:08.712614 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb540e4a-cfbc-410e-8191-f3e3897e1141 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:08.712895 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb540e4a-cfbc-410e-8191-f3e3897e1141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:08.713177 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb540e4a-cfbc-410e-8191-f3e3897e1141 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:08.715256 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb540e4a-cfbc-410e-8191-f3e3897e1141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:08.717864 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb540e4a-cfbc-410e-8191-f3e3897e1141 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:08.737895 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 877/1742] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:08.741454 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb540e4a-cfbc-410e-8191-f3e3897e1141 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:08.763868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb540e4a-cfbc-410e-8191-f3e3897e1141 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:08.768024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e6d60-d844-4159-82c8-bfd8f623d1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:08.769845 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6d60-d844-4159-82c8-bfd8f623d1b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:08.774316 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6d60-d844-4159-82c8-bfd8f623d1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:08.774316 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6d60-d844-4159-82c8-bfd8f623d1b2 admin admin] PATH_INFO: `/v3/projects/3ca0447aef3648b582fcbdfbc07ec994/users/4ac0d033f80147fab976673ba0633958/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:08.800123 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c58cf5-bcad-4552-8641-0505bdb161f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:08.800861 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c58cf5-bcad-4552-8641-0505bdb161f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:08.801398 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c58cf5-bcad-4552-8641-0505bdb161f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:08.801398 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c58cf5-bcad-4552-8641-0505bdb161f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:08.815822 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e6d60-d844-4159-82c8-bfd8f623d1b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca0447aef3648b582fcbdfbc07ec994, user_id=4ac0d033f80147fab976673ba0633958, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:08.835584 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e6d60-d844-4159-82c8-bfd8f623d1b2 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:08.849134 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c58cf5-bcad-4552-8641-0505bdb161f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:08.850733 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c58cf5-bcad-4552-8641-0505bdb161f9 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:08.910858 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 866/1743] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:19:09.051688 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 878/1744] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:08 2022] PUT /identity/v3/projects/3ca0447aef3648b582fcbdfbc07ec994/users/4ac0d033f80147fab976673ba0633958/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:09.056293 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0497d-04a5-4c66-8c81-0eb5c0e02955 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:09.056839 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0497d-04a5-4c66-8c81-0eb5c0e02955 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:09.057319 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0497d-04a5-4c66-8c81-0eb5c0e02955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:09.094698 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e6d60-d844-4159-82c8-bfd8f623d1b2 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:09.096600 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-d37e6d60-d844-4159-82c8-bfd8f623d1b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:09.204104 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-d0e0497d-04a5-4c66-8c81-0eb5c0e02955 None None] MFA Rules not processed for user `4ac0d033f80147fab976673ba0633958`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:09.214830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-d0e0497d-04a5-4c66-8c81-0eb5c0e02955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:09.356374 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e6d60-d844-4159-82c8-bfd8f623d1b2 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:09.364373 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747332e-ae9c-4883-b9aa-271d10d6c8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:09.366307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747332e-ae9c-4883-b9aa-271d10d6c8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:09.366808 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747332e-ae9c-4883-b9aa-271d10d6c8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:09.367416 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747332e-ae9c-4883-b9aa-271d10d6c8f0 admin admin] PATH_INFO: `/v3/projects/6f8aa6a9fe2d4a3a90c5604382bbbb31` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:09.371676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747332e-ae9c-4883-b9aa-271d10d6c8f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f8aa6a9fe2d4a3a90c5604382bbbb31)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:09.375572 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747332e-ae9c-4883-b9aa-271d10d6c8f0 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:09.432834 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 867/1745] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:09 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:09.436257 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0497d-04a5-4c66-8c81-0eb5c0e02955 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:09.440929 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-d0e0497d-04a5-4c66-8c81-0eb5c0e02955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:09.475389 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0497d-04a5-4c66-8c81-0eb5c0e02955 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:09.493091 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106caa6-fae5-4d27-bcd8-c3a8ac2a52ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:09.495891 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106caa6-fae5-4d27-bcd8-c3a8ac2a52ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:09.498306 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106caa6-fae5-4d27-bcd8-c3a8ac2a52ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:09.499830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106caa6-fae5-4d27-bcd8-c3a8ac2a52ad admin admin] PATH_INFO: `/v3/users/e932a66e996c48ba94a159755a1a1d05` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:09.503982 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106caa6-fae5-4d27-bcd8-c3a8ac2a52ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=e932a66e996c48ba94a159755a1a1d05)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:09.507472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106caa6-fae5-4d27-bcd8-c3a8ac2a52ad admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:09.567381 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a747332e-ae9c-4883-b9aa-271d10d6c8f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f8aa6a9fe2d4a3a90c5604382bbbb31', 'request_id': 'req-a747332e-ae9c-4883-b9aa-271d10d6c8f0'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:09.578383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a747332e-ae9c-4883-b9aa-271d10d6c8f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f8aa6a9fe2d4a3a90c5604382bbbb31', 'request_id': 'req-a747332e-ae9c-4883-b9aa-271d10d6c8f0'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:09.600303 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a747332e-ae9c-4883-b9aa-271d10d6c8f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f8aa6a9fe2d4a3a90c5604382bbbb31', 'request_id': 'req-a747332e-ae9c-4883-b9aa-271d10d6c8f0'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:09.699732 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a747332e-ae9c-4883-b9aa-271d10d6c8f0 admin admin] The token cache is being invalidate because project 6f8aa6a9fe2d4a3a90c5604382bbbb31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:19:09.700387 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a747332e-ae9c-4883-b9aa-271d10d6c8f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:09.702705 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a747332e-ae9c-4883-b9aa-271d10d6c8f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:09.705715 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 879/1746] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:19:09 2022] DELETE /identity/v3/projects/6f8aa6a9fe2d4a3a90c5604382bbbb31 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:09.706780 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747332e-ae9c-4883-b9aa-271d10d6c8f0 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:09.711453 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a747332e-ae9c-4883-b9aa-271d10d6c8f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:09.906794 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-6106caa6-fae5-4d27-bcd8-c3a8ac2a52ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e932a66e996c48ba94a159755a1a1d05'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:09.958794 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-6106caa6-fae5-4d27-bcd8-c3a8ac2a52ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e932a66e996c48ba94a159755a1a1d05'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:09.962324 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-6106caa6-fae5-4d27-bcd8-c3a8ac2a52ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e932a66e996c48ba94a159755a1a1d05'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:09.971296 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747332e-ae9c-4883-b9aa-271d10d6c8f0 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:10.011780 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7362d53-14ca-40d9-b95e-983b43eae63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:10.012564 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7362d53-14ca-40d9-b95e-983b43eae63b admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:10.012811 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7362d53-14ca-40d9-b95e-983b43eae63b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:10.013091 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7362d53-14ca-40d9-b95e-983b43eae63b admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:10.017586 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7362d53-14ca-40d9-b95e-983b43eae63b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:10.017586 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7362d53-14ca-40d9-b95e-983b43eae63b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:10.137942 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-6106caa6-fae5-4d27-bcd8-c3a8ac2a52ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e932a66e996c48ba94a159755a1a1d05'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:10.138685 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-6106caa6-fae5-4d27-bcd8-c3a8ac2a52ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e932a66e996c48ba94a159755a1a1d05'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:10.158201 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 868/1747] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:19:09 2022] DELETE /identity/v3/users/e932a66e996c48ba94a159755a1a1d05 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:10.159805 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdad46f-aa7f-4bd3-8462-349d25b0e90a None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:10.160416 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdad46f-aa7f-4bd3-8462-349d25b0e90a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:10.160887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdad46f-aa7f-4bd3-8462-349d25b0e90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:10.266134 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-8fdad46f-aa7f-4bd3-8462-349d25b0e90a None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:10.266230 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 880/1748] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:09 2022] POST /identity/v3/projects => generated 365 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:10.266881 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f3eae-7804-4678-9e41-3558bd3f73a1 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:10.267178 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f3eae-7804-4678-9e41-3558bd3f73a1 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:10.267457 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f3eae-7804-4678-9e41-3558bd3f73a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:10.275626 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-8fdad46f-aa7f-4bd3-8462-349d25b0e90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:10.348240 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-7b3f3eae-7804-4678-9e41-3558bd3f73a1 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:10.351750 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-7b3f3eae-7804-4678-9e41-3558bd3f73a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:10.471371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 869/1749] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:10.473318 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdad46f-aa7f-4bd3-8462-349d25b0e90a None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:10.490334 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-8fdad46f-aa7f-4bd3-8462-349d25b0e90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:10.530151 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdad46f-aa7f-4bd3-8462-349d25b0e90a None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:10.534185 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 881/1750] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:10.535672 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f6862-0ee5-436a-be54-0987cea3c0de None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:10.536307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f6862-0ee5-436a-be54-0987cea3c0de None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:10.536620 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f6862-0ee5-436a-be54-0987cea3c0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:10.545884 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646383cc-d0e7-4908-ac0e-15e9fd0ff3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:10.546907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646383cc-d0e7-4908-ac0e-15e9fd0ff3be admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:10.547336 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646383cc-d0e7-4908-ac0e-15e9fd0ff3be admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:10.547798 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646383cc-d0e7-4908-ac0e-15e9fd0ff3be admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:10.548892 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646383cc-d0e7-4908-ac0e-15e9fd0ff3be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:10.551246 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646383cc-d0e7-4908-ac0e-15e9fd0ff3be admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:10.597775 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-eb2f6862-0ee5-436a-be54-0987cea3c0de None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:10.599890 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-eb2f6862-0ee5-436a-be54-0987cea3c0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:10.616584 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 882/1751] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:10.617630 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f6862-0ee5-436a-be54-0987cea3c0de None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:10.619741 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-eb2f6862-0ee5-436a-be54-0987cea3c0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:10.669797 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 870/1752] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:10 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:10.670726 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646383cc-d0e7-4908-ac0e-15e9fd0ff3be admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:10.716184 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646383cc-d0e7-4908-ac0e-15e9fd0ff3be admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:10.736805 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d650a18-28bc-43ba-bb65-994cc3a901ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:10.737577 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d650a18-28bc-43ba-bb65-994cc3a901ad admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:10.738334 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d650a18-28bc-43ba-bb65-994cc3a901ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:10.740700 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d650a18-28bc-43ba-bb65-994cc3a901ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:10.741578 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d650a18-28bc-43ba-bb65-994cc3a901ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:19:10.742679 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d650a18-28bc-43ba-bb65-994cc3a901ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:10.757510 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d650a18-28bc-43ba-bb65-994cc3a901ad admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:10.801669 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 871/1753] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:19:10.805106 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f6862-0ee5-436a-be54-0987cea3c0de None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:10.807388 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6f66b-860f-4cb9-9392-a5fef9f5aeb1 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:10.807660 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6f66b-860f-4cb9-9392-a5fef9f5aeb1 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:10.807918 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6f66b-860f-4cb9-9392-a5fef9f5aeb1 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:10.822052 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 872/1754] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 13:19:10 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:19:10.823794 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6f66b-860f-4cb9-9392-a5fef9f5aeb1 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:10.824688 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f2178-416b-48fd-abd9-3b98774304de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:10.829698 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f2178-416b-48fd-abd9-3b98774304de service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:10.832086 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f2178-416b-48fd-abd9-3b98774304de service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:10.832191 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f2178-416b-48fd-abd9-3b98774304de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:10.860421 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6f66b-860f-4cb9-9392-a5fef9f5aeb1 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:10.866900 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f2178-416b-48fd-abd9-3b98774304de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:10.872216 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f2178-416b-48fd-abd9-3b98774304de service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:10.918306 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 883/1755] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:10.919176 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f2178-416b-48fd-abd9-3b98774304de service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:10.922668 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9971d03-464b-4c9b-a327-e81681b201e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:10.923373 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9971d03-464b-4c9b-a327-e81681b201e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:10.923658 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9971d03-464b-4c9b-a327-e81681b201e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:10.928957 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9971d03-464b-4c9b-a327-e81681b201e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:10.928957 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9971d03-464b-4c9b-a327-e81681b201e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:10.928957 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9971d03-464b-4c9b-a327-e81681b201e9 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:10.955770 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f2178-416b-48fd-abd9-3b98774304de service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:10.963811 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a326f35-2f3f-4681-b25b-4aaec1478b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:10.964491 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a326f35-2f3f-4681-b25b-4aaec1478b7d admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:10.964807 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a326f35-2f3f-4681-b25b-4aaec1478b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:10.965108 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a326f35-2f3f-4681-b25b-4aaec1478b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:10.965834 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 873/1756] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:10.965966 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a326f35-2f3f-4681-b25b-4aaec1478b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:10.967433 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d961f-b8fc-469b-847f-5105c183e7ca None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:10.967599 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d961f-b8fc-469b-847f-5105c183e7ca None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:10.967851 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d961f-b8fc-469b-847f-5105c183e7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:10.967956 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a326f35-2f3f-4681-b25b-4aaec1478b7d admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:11.019525 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-453d961f-b8fc-469b-847f-5105c183e7ca None None] MFA Rules not processed for user `72d4ac44d04943a5b24c7a1d6a31b7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:11.021273 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-453d961f-b8fc-469b-847f-5105c183e7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:11.119746 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 874/1757] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 13:19:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:11.120638 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d961f-b8fc-469b-847f-5105c183e7ca None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:11.122068 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-453d961f-b8fc-469b-847f-5105c183e7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:11.139852 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d961f-b8fc-469b-847f-5105c183e7ca None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:11.146206 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d959a-1631-42e4-b2e2-e2a7d5e06a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:11.147090 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d959a-1631-42e4-b2e2-e2a7d5e06a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:11.154152 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d959a-1631-42e4-b2e2-e2a7d5e06a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:11.154152 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d959a-1631-42e4-b2e2-e2a7d5e06a6d admin admin] PATH_INFO: `/v3/projects/b1ba32b69cba4ba49a77d7b135efd0d1` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:11.154152 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d959a-1631-42e4-b2e2-e2a7d5e06a6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ba32b69cba4ba49a77d7b135efd0d1)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:11.159963 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d959a-1631-42e4-b2e2-e2a7d5e06a6d admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:11.241670 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 884/1758] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:10 2022] POST /identity/v3/projects => generated 375 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:11.244186 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a326f35-2f3f-4681-b25b-4aaec1478b7d admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:11.304439 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-de5d959a-1631-42e4-b2e2-e2a7d5e06a6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ba32b69cba4ba49a77d7b135efd0d1', 'request_id': 'req-de5d959a-1631-42e4-b2e2-e2a7d5e06a6d'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:11.403580 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-de5d959a-1631-42e4-b2e2-e2a7d5e06a6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ba32b69cba4ba49a77d7b135efd0d1', 'request_id': 'req-de5d959a-1631-42e4-b2e2-e2a7d5e06a6d'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:11.410462 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-de5d959a-1631-42e4-b2e2-e2a7d5e06a6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ba32b69cba4ba49a77d7b135efd0d1', 'request_id': 'req-de5d959a-1631-42e4-b2e2-e2a7d5e06a6d'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:11.417789 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a326f35-2f3f-4681-b25b-4aaec1478b7d admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:11.433563 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-de5d959a-1631-42e4-b2e2-e2a7d5e06a6d admin admin] The token cache is being invalidate because project b1ba32b69cba4ba49a77d7b135efd0d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:19:11.433849 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-de5d959a-1631-42e4-b2e2-e2a7d5e06a6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:11.435885 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-de5d959a-1631-42e4-b2e2-e2a7d5e06a6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:11.443118 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 875/1759] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:19:11 2022] DELETE /identity/v3/projects/b1ba32b69cba4ba49a77d7b135efd0d1 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:11.444053 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d959a-1631-42e4-b2e2-e2a7d5e06a6d admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:11.449215 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-de5d959a-1631-42e4-b2e2-e2a7d5e06a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:11.543897 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1efaa-372a-4016-ad05-c2e185770444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:11.545783 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1efaa-372a-4016-ad05-c2e185770444 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:11.546670 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1efaa-372a-4016-ad05-c2e185770444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:11.547755 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1efaa-372a-4016-ad05-c2e185770444 admin admin] PATH_INFO: `/v3/projects/e64eb06f9c8740af98fd528c17fc0c4d/users/872366361cdf4fa3af34d23506c38a0f/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:11.579798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1efaa-372a-4016-ad05-c2e185770444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e64eb06f9c8740af98fd528c17fc0c4d, user_id=872366361cdf4fa3af34d23506c38a0f, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:11.583552 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1efaa-372a-4016-ad05-c2e185770444 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:11.671049 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d959a-1631-42e4-b2e2-e2a7d5e06a6d admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:11.687294 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62dabc0-f5f1-4c04-a946-e5c7c8c007e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:11.688132 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62dabc0-f5f1-4c04-a946-e5c7c8c007e5 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:11.688509 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62dabc0-f5f1-4c04-a946-e5c7c8c007e5 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:11.690260 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62dabc0-f5f1-4c04-a946-e5c7c8c007e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:11.694258 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-e62dabc0-f5f1-4c04-a946-e5c7c8c007e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:11.711315 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62dabc0-f5f1-4c04-a946-e5c7c8c007e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:11.714018 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62dabc0-f5f1-4c04-a946-e5c7c8c007e5 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:11.737301 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 885/1760] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:11 2022] PUT /identity/v3/projects/e64eb06f9c8740af98fd528c17fc0c4d/users/872366361cdf4fa3af34d23506c38a0f/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:11.739415 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1efaa-372a-4016-ad05-c2e185770444 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:11.746014 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-19d1efaa-372a-4016-ad05-c2e185770444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:11.791561 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 876/1761] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:11.800843 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62dabc0-f5f1-4c04-a946-e5c7c8c007e5 service nova] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:11.813400 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-e62dabc0-f5f1-4c04-a946-e5c7c8c007e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:11.859648 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62dabc0-f5f1-4c04-a946-e5c7c8c007e5 service nova] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:12.026110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1efaa-372a-4016-ad05-c2e185770444 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:12.046583 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da974a-6b28-4bd5-98a5-439485636b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:12.047666 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da974a-6b28-4bd5-98a5-439485636b86 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:12.048341 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da974a-6b28-4bd5-98a5-439485636b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:12.048636 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da974a-6b28-4bd5-98a5-439485636b86 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:12.050362 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da974a-6b28-4bd5-98a5-439485636b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:12.058156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da974a-6b28-4bd5-98a5-439485636b86 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:12.128697 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80beb4-e7be-4f7b-9fc3-93f7d63fdf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:12.129653 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80beb4-e7be-4f7b-9fc3-93f7d63fdf37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:12.129934 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80beb4-e7be-4f7b-9fc3-93f7d63fdf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:12.130429 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80beb4-e7be-4f7b-9fc3-93f7d63fdf37 admin admin] PATH_INFO: `/v3/users/4409781b00104156bc43e14cca414277` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:12.134198 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80beb4-e7be-4f7b-9fc3-93f7d63fdf37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4409781b00104156bc43e14cca414277)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:12.145864 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80beb4-e7be-4f7b-9fc3-93f7d63fdf37 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:12.186249 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 886/1762] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:11 2022] POST /identity/v3/users => generated 288 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:12.187299 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da974a-6b28-4bd5-98a5-439485636b86 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:12.190466 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b7da974a-6b28-4bd5-98a5-439485636b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:12.237780 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da974a-6b28-4bd5-98a5-439485636b86 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:12.249310 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfb8c3-9f05-453a-950d-5e2544af23a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:12.250199 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfb8c3-9f05-453a-950d-5e2544af23a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:12.256381 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfb8c3-9f05-453a-950d-5e2544af23a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:12.256381 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfb8c3-9f05-453a-950d-5e2544af23a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:12.256381 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfb8c3-9f05-453a-950d-5e2544af23a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:12.276762 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfb8c3-9f05-453a-950d-5e2544af23a2 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:12.336576 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 887/1763] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:12.337241 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfb8c3-9f05-453a-950d-5e2544af23a2 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:12.357268 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfb8c3-9f05-453a-950d-5e2544af23a2 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:12.373416 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048096e2-e9b3-41f9-83e0-aec1bc4e3aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:12.374042 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048096e2-e9b3-41f9-83e0-aec1bc4e3aab admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:12.374332 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048096e2-e9b3-41f9-83e0-aec1bc4e3aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:12.374604 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048096e2-e9b3-41f9-83e0-aec1bc4e3aab admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:12.375419 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048096e2-e9b3-41f9-83e0-aec1bc4e3aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:12.377204 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048096e2-e9b3-41f9-83e0-aec1bc4e3aab admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:12.411036 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 888/1764] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:12.417619 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048096e2-e9b3-41f9-83e0-aec1bc4e3aab admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:12.444087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048096e2-e9b3-41f9-83e0-aec1bc4e3aab admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:12.460628 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb9d9f-437f-4e32-afc8-0946a3858742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:12.462508 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb9d9f-437f-4e32-afc8-0946a3858742 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:12.466254 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb9d9f-437f-4e32-afc8-0946a3858742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:12.466751 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb9d9f-437f-4e32-afc8-0946a3858742 admin admin] PATH_INFO: `/v3/projects/e64eb06f9c8740af98fd528c17fc0c4d/users/872366361cdf4fa3af34d23506c38a0f/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:12.469373 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb9d9f-437f-4e32-afc8-0946a3858742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e64eb06f9c8740af98fd528c17fc0c4d, user_id=872366361cdf4fa3af34d23506c38a0f, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:12.472706 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb9d9f-437f-4e32-afc8-0946a3858742 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:12.488951 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 889/1765] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:12 2022] PUT /identity/v3/projects/e64eb06f9c8740af98fd528c17fc0c4d/users/872366361cdf4fa3af34d23506c38a0f/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:12.490219 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb9d9f-437f-4e32-afc8-0946a3858742 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:12.546997 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-0b80beb4-e7be-4f7b-9fc3-93f7d63fdf37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4409781b00104156bc43e14cca414277'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:12.614354 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-0b80beb4-e7be-4f7b-9fc3-93f7d63fdf37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4409781b00104156bc43e14cca414277'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:12.615645 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-0b80beb4-e7be-4f7b-9fc3-93f7d63fdf37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4409781b00104156bc43e14cca414277'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:12.662494 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb9d9f-437f-4e32-afc8-0946a3858742 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:12.685383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6dcaa5-7144-4ec8-9269-8689d0570799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:12.686106 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dcaa5-7144-4ec8-9269-8689d0570799 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:12.686388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dcaa5-7144-4ec8-9269-8689d0570799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:12.686665 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dcaa5-7144-4ec8-9269-8689d0570799 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:12.690527 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dcaa5-7144-4ec8-9269-8689d0570799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:12.699797 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-0b80beb4-e7be-4f7b-9fc3-93f7d63fdf37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4409781b00104156bc43e14cca414277'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:12.700723 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-0b80beb4-e7be-4f7b-9fc3-93f7d63fdf37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4409781b00104156bc43e14cca414277'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:12.741634 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dcaa5-7144-4ec8-9269-8689d0570799 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:12.768225 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 877/1766] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:19:11 2022] DELETE /identity/v3/users/4409781b00104156bc43e14cca414277 => generated 0 bytes in 973 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:12.771088 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 890/1767] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:12.772060 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6dcaa5-7144-4ec8-9269-8689d0570799 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:12.775277 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0e6dcaa5-7144-4ec8-9269-8689d0570799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:12.778845 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8d785-36a4-4909-9852-6ff6775ea2af None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:12.779138 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8d785-36a4-4909-9852-6ff6775ea2af None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:12.779415 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8d785-36a4-4909-9852-6ff6775ea2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:12.798694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6dcaa5-7144-4ec8-9269-8689d0570799 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:12.833388 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-2cf8d785-36a4-4909-9852-6ff6775ea2af None None] MFA Rules not processed for user `872366361cdf4fa3af34d23506c38a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:12.837761 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-2cf8d785-36a4-4909-9852-6ff6775ea2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:12.895286 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b60eb-0f2e-461e-bf88-42754880dc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:12.896159 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b60eb-0f2e-461e-bf88-42754880dc85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:12.896512 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b60eb-0f2e-461e-bf88-42754880dc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:12.896891 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b60eb-0f2e-461e-bf88-42754880dc85 admin admin] PATH_INFO: `/v3/projects/ac1b06c7b48f47cb8e19bb961c7a1d20/users/d0b150d6d1f94ebea172e4567fe276ca/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:12.922746 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b60eb-0f2e-461e-bf88-42754880dc85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1b06c7b48f47cb8e19bb961c7a1d20, user_id=d0b150d6d1f94ebea172e4567fe276ca, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:12.925659 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b60eb-0f2e-461e-bf88-42754880dc85 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:13.065291 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 891/1768] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:12 2022] PUT /identity/v3/projects/ac1b06c7b48f47cb8e19bb961c7a1d20/users/d0b150d6d1f94ebea172e4567fe276ca/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:13.065934 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 878/1769] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:13.077523 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7692b-3e52-4814-a2a9-017f7a0be23f None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:13.077523 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7692b-3e52-4814-a2a9-017f7a0be23f None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:13.077523 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7692b-3e52-4814-a2a9-017f7a0be23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:13.078344 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8d785-36a4-4909-9852-6ff6775ea2af None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:13.079787 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-2cf8d785-36a4-4909-9852-6ff6775ea2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:13.140712 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-54d7692b-3e52-4814-a2a9-017f7a0be23f None None] MFA Rules not processed for user `d0b150d6d1f94ebea172e4567fe276ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:13.141888 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-54d7692b-3e52-4814-a2a9-017f7a0be23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:13.193097 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8d785-36a4-4909-9852-6ff6775ea2af None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:13.287071 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697b8ba-4f4d-466a-93e3-d0dced26d66d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:13.287915 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697b8ba-4f4d-466a-93e3-d0dced26d66d service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:13.288329 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697b8ba-4f4d-466a-93e3-d0dced26d66d service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:13.288742 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697b8ba-4f4d-466a-93e3-d0dced26d66d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:13.335848 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 892/1770] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:13.341742 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7692b-3e52-4814-a2a9-017f7a0be23f None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:13.466937 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697b8ba-4f4d-466a-93e3-d0dced26d66d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:13.468884 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697b8ba-4f4d-466a-93e3-d0dced26d66d service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:13.487710 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7692b-3e52-4814-a2a9-017f7a0be23f None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:13.502461 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62128b29-1c4c-44ef-8257-bedd0b48b8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:13.503463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62128b29-1c4c-44ef-8257-bedd0b48b8ef admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:13.503894 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62128b29-1c4c-44ef-8257-bedd0b48b8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:13.504604 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62128b29-1c4c-44ef-8257-bedd0b48b8ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:13.505802 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62128b29-1c4c-44ef-8257-bedd0b48b8ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:13.509739 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62128b29-1c4c-44ef-8257-bedd0b48b8ef admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:13.514459 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 879/1771] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:13 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:19:13.634509 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 893/1772] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:13 2022] POST /identity/v3/projects => generated 375 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:13.635587 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697b8ba-4f4d-466a-93e3-d0dced26d66d service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:13.682777 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697b8ba-4f4d-466a-93e3-d0dced26d66d service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:13.766087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62128b29-1c4c-44ef-8257-bedd0b48b8ef admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:13.766087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-62128b29-1c4c-44ef-8257-bedd0b48b8ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:13.877491 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d91c6-1f91-425c-a3ee-60d1e46a6d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:13.880417 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d91c6-1f91-425c-a3ee-60d1e46a6d7c admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:13.881859 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d91c6-1f91-425c-a3ee-60d1e46a6d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:13.882159 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d91c6-1f91-425c-a3ee-60d1e46a6d7c admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:13.883812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d91c6-1f91-425c-a3ee-60d1e46a6d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:13.887297 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d91c6-1f91-425c-a3ee-60d1e46a6d7c admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:13.969861 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62128b29-1c4c-44ef-8257-bedd0b48b8ef admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:14.000139 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 880/1773] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:13 2022] POST /identity/v3/users => generated 294 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:19:14.000139 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d91c6-1f91-425c-a3ee-60d1e46a6d7c admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:14.002147 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8baac5-da83-4328-889e-ea991ee7b67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:14.002147 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8baac5-da83-4328-889e-ea991ee7b67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:14.002147 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8baac5-da83-4328-889e-ea991ee7b67a admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:14.002984 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8baac5-da83-4328-889e-ea991ee7b67a admin admin] PATH_INFO: `/v3/projects/4b7081174074414d937202d39ab81689` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:14.009627 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8baac5-da83-4328-889e-ea991ee7b67a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b7081174074414d937202d39ab81689)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:14.015642 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8baac5-da83-4328-889e-ea991ee7b67a admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:14.233945 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-cd8baac5-da83-4328-889e-ea991ee7b67a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b7081174074414d937202d39ab81689', 'request_id': 'req-cd8baac5-da83-4328-889e-ea991ee7b67a'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:14.234696 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d91c6-1f91-425c-a3ee-60d1e46a6d7c admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:14.260422 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-cd8baac5-da83-4328-889e-ea991ee7b67a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b7081174074414d937202d39ab81689', 'request_id': 'req-cd8baac5-da83-4328-889e-ea991ee7b67a'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:14.266379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-cd8baac5-da83-4328-889e-ea991ee7b67a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b7081174074414d937202d39ab81689', 'request_id': 'req-cd8baac5-da83-4328-889e-ea991ee7b67a'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:14.379106 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-cd8baac5-da83-4328-889e-ea991ee7b67a admin admin] The token cache is being invalidate because project 4b7081174074414d937202d39ab81689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:19:14.379426 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-cd8baac5-da83-4328-889e-ea991ee7b67a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:14.382927 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-cd8baac5-da83-4328-889e-ea991ee7b67a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:14.386047 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 894/1774] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:19:13 2022] DELETE /identity/v3/projects/4b7081174074414d937202d39ab81689 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:14.389001 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8baac5-da83-4328-889e-ea991ee7b67a admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:14.391746 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-cd8baac5-da83-4328-889e-ea991ee7b67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:14.411556 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdb96b-d9e0-4dee-a3a9-c922ac4852a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:14.412467 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdb96b-d9e0-4dee-a3a9-c922ac4852a5 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:14.412872 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdb96b-d9e0-4dee-a3a9-c922ac4852a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:14.413160 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdb96b-d9e0-4dee-a3a9-c922ac4852a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:14.422174 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-0ffdb96b-d9e0-4dee-a3a9-c922ac4852a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:14.515288 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8baac5-da83-4328-889e-ea991ee7b67a admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:14.524016 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e3807-6151-4a04-9854-998366d730b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:14.525420 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e3807-6151-4a04-9854-998366d730b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:14.525945 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e3807-6151-4a04-9854-998366d730b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:14.526263 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e3807-6151-4a04-9854-998366d730b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:14.527576 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e3807-6151-4a04-9854-998366d730b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:14.531674 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e3807-6151-4a04-9854-998366d730b8 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:14.562848 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 895/1775] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:14.566340 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e3807-6151-4a04-9854-998366d730b8 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:14.572577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-3b1e3807-6151-4a04-9854-998366d730b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:14.615621 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e3807-6151-4a04-9854-998366d730b8 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:14.628094 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbceec91-f78b-4cc0-aee9-f029ec7aedad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:14.629415 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceec91-f78b-4cc0-aee9-f029ec7aedad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:14.629680 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceec91-f78b-4cc0-aee9-f029ec7aedad admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:14.629960 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceec91-f78b-4cc0-aee9-f029ec7aedad admin admin] PATH_INFO: `/v3/users/a6977611c4f74c6fad2eba744c5cbc37` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:14.635263 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbceec91-f78b-4cc0-aee9-f029ec7aedad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6977611c4f74c6fad2eba744c5cbc37)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:14.649111 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdb96b-d9e0-4dee-a3a9-c922ac4852a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:14.649578 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbceec91-f78b-4cc0-aee9-f029ec7aedad admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:14.652410 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdb96b-d9e0-4dee-a3a9-c922ac4852a5 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:14.676983 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 881/1776] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:13 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:14.677851 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdb96b-d9e0-4dee-a3a9-c922ac4852a5 service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:14.710617 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdb96b-d9e0-4dee-a3a9-c922ac4852a5 service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:14.718595 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e11be9-2cf6-40bc-a831-0f8d7fe95cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:14.719520 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e11be9-2cf6-40bc-a831-0f8d7fe95cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:14.719804 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e11be9-2cf6-40bc-a831-0f8d7fe95cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:14.720084 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e11be9-2cf6-40bc-a831-0f8d7fe95cc9 admin admin] PATH_INFO: `/v3/projects/faf14713d98f4ef6823603c94e468a0c/users/55cb9c3187e048c99c99e82fbed33311/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:14.740210 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e11be9-2cf6-40bc-a831-0f8d7fe95cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf14713d98f4ef6823603c94e468a0c, user_id=55cb9c3187e048c99c99e82fbed33311, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:14.742353 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e11be9-2cf6-40bc-a831-0f8d7fe95cc9 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:14.896222 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 882/1777] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:14 2022] PUT /identity/v3/projects/faf14713d98f4ef6823603c94e468a0c/users/55cb9c3187e048c99c99e82fbed33311/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:14.900874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e11be9-2cf6-40bc-a831-0f8d7fe95cc9 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:15.030155 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e11be9-2cf6-40bc-a831-0f8d7fe95cc9 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:15.035999 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9818a-4da8-456d-9b33-c96a1189d56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:15.036870 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9818a-4da8-456d-9b33-c96a1189d56f admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:15.037172 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9818a-4da8-456d-9b33-c96a1189d56f admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:15.037502 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9818a-4da8-456d-9b33-c96a1189d56f admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:15.038299 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9818a-4da8-456d-9b33-c96a1189d56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:15.040064 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9818a-4da8-456d-9b33-c96a1189d56f admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:15.077223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 883/1778] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:15.077223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9818a-4da8-456d-9b33-c96a1189d56f admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:15.078566 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dbceec91-f78b-4cc0-aee9-f029ec7aedad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6977611c4f74c6fad2eba744c5cbc37'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:15.096633 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9818a-4da8-456d-9b33-c96a1189d56f admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:15.110130 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baffae8-d116-4d35-a37c-4a06dca2d23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:15.110999 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dbceec91-f78b-4cc0-aee9-f029ec7aedad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6977611c4f74c6fad2eba744c5cbc37'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:15.112254 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dbceec91-f78b-4cc0-aee9-f029ec7aedad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6977611c4f74c6fad2eba744c5cbc37'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:15.113273 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dbceec91-f78b-4cc0-aee9-f029ec7aedad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6977611c4f74c6fad2eba744c5cbc37'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:15.115329 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baffae8-d116-4d35-a37c-4a06dca2d23a admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:15.115743 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baffae8-d116-4d35-a37c-4a06dca2d23a admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:15.116056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baffae8-d116-4d35-a37c-4a06dca2d23a admin admin] PATH_INFO: `/v3/projects/faf14713d98f4ef6823603c94e468a0c/users/55cb9c3187e048c99c99e82fbed33311/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:15.121521 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baffae8-d116-4d35-a37c-4a06dca2d23a admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf14713d98f4ef6823603c94e468a0c, user_id=55cb9c3187e048c99c99e82fbed33311, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:15.124560 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baffae8-d116-4d35-a37c-4a06dca2d23a admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:15.137688 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dbceec91-f78b-4cc0-aee9-f029ec7aedad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6977611c4f74c6fad2eba744c5cbc37'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:15.150509 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 884/1779] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:15 2022] PUT /identity/v3/projects/faf14713d98f4ef6823603c94e468a0c/users/55cb9c3187e048c99c99e82fbed33311/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:15.151550 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baffae8-d116-4d35-a37c-4a06dca2d23a admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:15.153458 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1baffae8-d116-4d35-a37c-4a06dca2d23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:15.264351 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 896/1780] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:19:14 2022] DELETE /identity/v3/users/a6977611c4f74c6fad2eba744c5cbc37 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:15.264351 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85a51e-cbce-4671-8948-ddc3225b1756 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:15.264351 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85a51e-cbce-4671-8948-ddc3225b1756 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:15.264351 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85a51e-cbce-4671-8948-ddc3225b1756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:15.378984 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-2e85a51e-cbce-4671-8948-ddc3225b1756 None None] MFA Rules not processed for user `55cb9c3187e048c99c99e82fbed33311`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:15.382722 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-2e85a51e-cbce-4671-8948-ddc3225b1756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:15.394128 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baffae8-d116-4d35-a37c-4a06dca2d23a admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:15.497237 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156a45e-6edd-44a2-b9f5-eb99308c841c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:15.498213 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156a45e-6edd-44a2-b9f5-eb99308c841c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:15.498505 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156a45e-6edd-44a2-b9f5-eb99308c841c admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:15.498930 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156a45e-6edd-44a2-b9f5-eb99308c841c admin admin] PATH_INFO: `/v3/projects/dad479aec9dc46ffab9fcd852eaa941c` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:15.500238 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156a45e-6edd-44a2-b9f5-eb99308c841c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad479aec9dc46ffab9fcd852eaa941c)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:15.502345 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156a45e-6edd-44a2-b9f5-eb99308c841c admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:15.531572 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 897/1781] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:15.550380 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85a51e-cbce-4671-8948-ddc3225b1756 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:15.559968 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-2e85a51e-cbce-4671-8948-ddc3225b1756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:15.636521 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4156a45e-6edd-44a2-b9f5-eb99308c841c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad479aec9dc46ffab9fcd852eaa941c', 'request_id': 'req-4156a45e-6edd-44a2-b9f5-eb99308c841c'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:15.735695 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4156a45e-6edd-44a2-b9f5-eb99308c841c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad479aec9dc46ffab9fcd852eaa941c', 'request_id': 'req-4156a45e-6edd-44a2-b9f5-eb99308c841c'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:15.757083 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85a51e-cbce-4671-8948-ddc3225b1756 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:15.758238 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4156a45e-6edd-44a2-b9f5-eb99308c841c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad479aec9dc46ffab9fcd852eaa941c', 'request_id': 'req-4156a45e-6edd-44a2-b9f5-eb99308c841c'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:15.788355 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4156a45e-6edd-44a2-b9f5-eb99308c841c admin admin] The token cache is being invalidate because project dad479aec9dc46ffab9fcd852eaa941c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:19:15.788756 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4156a45e-6edd-44a2-b9f5-eb99308c841c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:15.793814 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4156a45e-6edd-44a2-b9f5-eb99308c841c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:15.796480 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 885/1782] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:19:15 2022] DELETE /identity/v3/projects/dad479aec9dc46ffab9fcd852eaa941c => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:15.801059 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bfd16-8fb1-4b40-81ef-c8fdbaa46f80 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:15.801388 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bfd16-8fb1-4b40-81ef-c8fdbaa46f80 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:15.801678 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bfd16-8fb1-4b40-81ef-c8fdbaa46f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:15.842651 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-d18bfd16-8fb1-4b40-81ef-c8fdbaa46f80 None None] MFA Rules not processed for user `728607c7138540d69532b0b806b9ccaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:15.843926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-d18bfd16-8fb1-4b40-81ef-c8fdbaa46f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:15.894436 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d238d8-482d-4fca-87e3-435a3c37e250 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:15.894813 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d238d8-482d-4fca-87e3-435a3c37e250 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:15.895356 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d238d8-482d-4fca-87e3-435a3c37e250 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:15.895465 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d238d8-482d-4fca-87e3-435a3c37e250 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:15.897418 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-45d238d8-482d-4fca-87e3-435a3c37e250 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:15.981037 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 886/1783] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:15.982929 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195782d5-fbf3-42c7-ad6f-e2eccc9bad75 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:15.983221 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195782d5-fbf3-42c7-ad6f-e2eccc9bad75 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:15.984244 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195782d5-fbf3-42c7-ad6f-e2eccc9bad75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:15.987754 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d238d8-482d-4fca-87e3-435a3c37e250 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:15.989265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d238d8-482d-4fca-87e3-435a3c37e250 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:16.000935 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 898/1784] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:16.020881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-195782d5-fbf3-42c7-ad6f-e2eccc9bad75 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:16.022974 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-195782d5-fbf3-42c7-ad6f-e2eccc9bad75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:16.142475 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 887/1785] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:16.152395 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdc092-8a81-4091-9cf2-f27d7716c5af None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:16.152693 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdc092-8a81-4091-9cf2-f27d7716c5af None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:16.152977 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdc092-8a81-4091-9cf2-f27d7716c5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:16.200604 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-eacdc092-8a81-4091-9cf2-f27d7716c5af None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:16.206226 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-eacdc092-8a81-4091-9cf2-f27d7716c5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:16.228979 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 899/1786] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:16.234249 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195782d5-fbf3-42c7-ad6f-e2eccc9bad75 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:16.250241 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195782d5-fbf3-42c7-ad6f-e2eccc9bad75 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:16.267739 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a7c85-a3bd-4cd8-abdf-0170bf4589d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:16.272398 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a7c85-a3bd-4cd8-abdf-0170bf4589d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:16.272911 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a7c85-a3bd-4cd8-abdf-0170bf4589d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:16.273287 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a7c85-a3bd-4cd8-abdf-0170bf4589d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:16.275353 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a7c85-a3bd-4cd8-abdf-0170bf4589d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:19:16.275959 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a7c85-a3bd-4cd8-abdf-0170bf4589d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:16.281058 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a7c85-a3bd-4cd8-abdf-0170bf4589d0 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:16.359116 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 888/1787] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:19:16.360366 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdc092-8a81-4091-9cf2-f27d7716c5af None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:16.374318 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdc092-8a81-4091-9cf2-f27d7716c5af None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:16.381085 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a4ccf-f41d-4e9f-bb36-f72c1c1c3e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:16.382198 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a4ccf-f41d-4e9f-bb36-f72c1c1c3e01 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:16.383649 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a4ccf-f41d-4e9f-bb36-f72c1c1c3e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:16.384519 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a4ccf-f41d-4e9f-bb36-f72c1c1c3e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:16.385477 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a4ccf-f41d-4e9f-bb36-f72c1c1c3e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:16.388142 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a4ccf-f41d-4e9f-bb36-f72c1c1c3e01 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:16.594458 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 900/1788] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:16 2022] POST /identity/v3/projects => generated 355 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:16.599194 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a7c85-a3bd-4cd8-abdf-0170bf4589d0 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:16.621136 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a7c85-a3bd-4cd8-abdf-0170bf4589d0 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:16.766990 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33d6a0-88c3-4fef-8656-53b3a681cfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:16.769036 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33d6a0-88c3-4fef-8656-53b3a681cfdf admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:16.769398 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33d6a0-88c3-4fef-8656-53b3a681cfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:16.770371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33d6a0-88c3-4fef-8656-53b3a681cfdf admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:16.772121 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33d6a0-88c3-4fef-8656-53b3a681cfdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:16.774455 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33d6a0-88c3-4fef-8656-53b3a681cfdf admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:16.927838 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 889/1789] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:16 2022] POST /identity/v3/users => generated 278 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:16.929161 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a4ccf-f41d-4e9f-bb36-f72c1c1c3e01 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:16.940501 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a4ccf-f41d-4e9f-bb36-f72c1c1c3e01 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:16.945532 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e94e0-a6a8-48a8-9b63-06fd8e4cd05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:16.946384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e94e0-a6a8-48a8-9b63-06fd8e4cd05c admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:16.946672 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e94e0-a6a8-48a8-9b63-06fd8e4cd05c admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:16.946950 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e94e0-a6a8-48a8-9b63-06fd8e4cd05c admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:16.947712 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e94e0-a6a8-48a8-9b63-06fd8e4cd05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:16.949416 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e94e0-a6a8-48a8-9b63-06fd8e4cd05c admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:16.975686 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 901/1790] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:16.982187 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33d6a0-88c3-4fef-8656-53b3a681cfdf admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:16.997435 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33d6a0-88c3-4fef-8656-53b3a681cfdf admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:17.020920 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febb2ad-0c81-4684-b913-1e19f362e723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:17.022018 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febb2ad-0c81-4684-b913-1e19f362e723 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:17.022336 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febb2ad-0c81-4684-b913-1e19f362e723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:17.022629 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febb2ad-0c81-4684-b913-1e19f362e723 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:17.024023 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febb2ad-0c81-4684-b913-1e19f362e723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:17.026437 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febb2ad-0c81-4684-b913-1e19f362e723 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:17.063164 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 890/1791] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:17.068549 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e94e0-a6a8-48a8-9b63-06fd8e4cd05c admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:17.095372 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e94e0-a6a8-48a8-9b63-06fd8e4cd05c admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:17.106701 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199f294-912a-401e-bf6d-545a0f1b9877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:17.109245 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199f294-912a-401e-bf6d-545a0f1b9877 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:17.110057 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199f294-912a-401e-bf6d-545a0f1b9877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:17.110678 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199f294-912a-401e-bf6d-545a0f1b9877 admin admin] PATH_INFO: `/v3/projects/f4cf8ff336b94998b2a2cff8031fa54b/users/4901aabf611b49d39f9f703aec10a6c6/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:17.159493 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199f294-912a-401e-bf6d-545a0f1b9877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4cf8ff336b94998b2a2cff8031fa54b, user_id=4901aabf611b49d39f9f703aec10a6c6, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:17.165786 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199f294-912a-401e-bf6d-545a0f1b9877 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:17.330219 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 902/1792] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:17 2022] PUT /identity/v3/projects/f4cf8ff336b94998b2a2cff8031fa54b/users/4901aabf611b49d39f9f703aec10a6c6/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:17.332169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218132f-acad-4988-885f-5c2871a4d785 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:17.332597 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218132f-acad-4988-885f-5c2871a4d785 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:17.333292 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218132f-acad-4988-885f-5c2871a4d785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:17.418837 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-b218132f-acad-4988-885f-5c2871a4d785 None None] MFA Rules not processed for user `4901aabf611b49d39f9f703aec10a6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:17.420160 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b218132f-acad-4988-885f-5c2871a4d785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:17.563296 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 891/1793] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:17 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:17.564375 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199f294-912a-401e-bf6d-545a0f1b9877 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:17.706798 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218132f-acad-4988-885f-5c2871a4d785 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:17.712002 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b218132f-acad-4988-885f-5c2871a4d785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:17.831551 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199f294-912a-401e-bf6d-545a0f1b9877 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:17.850497 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd9698-9ffd-4356-8227-f763d1f8c40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:17.851275 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd9698-9ffd-4356-8227-f763d1f8c40a admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:17.854361 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd9698-9ffd-4356-8227-f763d1f8c40a admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:17.854680 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd9698-9ffd-4356-8227-f763d1f8c40a admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:17.858128 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd9698-9ffd-4356-8227-f763d1f8c40a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:17.863655 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd9698-9ffd-4356-8227-f763d1f8c40a admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:17.973624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218132f-acad-4988-885f-5c2871a4d785 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:17.973624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab037be-5a36-494e-a201-90e67f98327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:17.973624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab037be-5a36-494e-a201-90e67f98327b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:17.973624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab037be-5a36-494e-a201-90e67f98327b admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:17.974920 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab037be-5a36-494e-a201-90e67f98327b admin admin] PATH_INFO: `/v3/projects/604164d22cd940f7bd51232035ff19be` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:17.974920 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab037be-5a36-494e-a201-90e67f98327b admin admin] RBAC: Authorizing `identity:delete_project(project_id=604164d22cd940f7bd51232035ff19be)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:17.974920 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab037be-5a36-494e-a201-90e67f98327b admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:18.464534 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 903/1794] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:17 2022] POST /identity/v3/projects => generated 355 bytes in 901 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:18.469081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f90178-924e-4054-86d8-0296d6d673fc None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:18.469377 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f90178-924e-4054-86d8-0296d6d673fc None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:18.469691 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f90178-924e-4054-86d8-0296d6d673fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:18.500898 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-04f90178-924e-4054-86d8-0296d6d673fc None None] MFA Rules not processed for user `ced48ea897124de6b874e797b6d74f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:18.561209 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-04f90178-924e-4054-86d8-0296d6d673fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:18.609095 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 904/1795] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:18.610236 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f90178-924e-4054-86d8-0296d6d673fc None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:18.728867 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f90178-924e-4054-86d8-0296d6d673fc None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:18.735699 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140485b-7a11-4ff8-92de-d95dfe12d09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:18.741640 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140485b-7a11-4ff8-92de-d95dfe12d09c admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:18.742725 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140485b-7a11-4ff8-92de-d95dfe12d09c admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:18.743187 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140485b-7a11-4ff8-92de-d95dfe12d09c admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:18.744344 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140485b-7a11-4ff8-92de-d95dfe12d09c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:18.754293 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140485b-7a11-4ff8-92de-d95dfe12d09c admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:19.114060 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 905/1796] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:18 2022] POST /identity/v3/users => generated 284 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:19.119278 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140485b-7a11-4ff8-92de-d95dfe12d09c admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:19.131716 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140485b-7a11-4ff8-92de-d95dfe12d09c admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:19.136788 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-5ab037be-5a36-494e-a201-90e67f98327b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '604164d22cd940f7bd51232035ff19be', 'request_id': 'req-5ab037be-5a36-494e-a201-90e67f98327b'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:19.204096 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dc286-61dc-4991-a218-036b9d1eb021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:19.205426 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dc286-61dc-4991-a218-036b9d1eb021 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:19.205913 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dc286-61dc-4991-a218-036b9d1eb021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:19.206493 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dc286-61dc-4991-a218-036b9d1eb021 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:19.207950 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dc286-61dc-4991-a218-036b9d1eb021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:19.210062 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dc286-61dc-4991-a218-036b9d1eb021 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:19.232040 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 906/1797] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:19.232040 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d2a3c-bef9-41b4-82e6-04e6dcb8d7d8 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:19.232040 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d2a3c-bef9-41b4-82e6-04e6dcb8d7d8 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:19.232379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d2a3c-bef9-41b4-82e6-04e6dcb8d7d8 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:19.244058 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 907/1798] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 13:19:19 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:19:19.245797 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d2a3c-bef9-41b4-82e6-04e6dcb8d7d8 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:19.272392 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d2a3c-bef9-41b4-82e6-04e6dcb8d7d8 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:19.278729 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eee23a-769e-4a3a-a968-88c5c3b5b9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:19.279967 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eee23a-769e-4a3a-a968-88c5c3b5b9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:19.280350 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eee23a-769e-4a3a-a968-88c5c3b5b9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:19.280761 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eee23a-769e-4a3a-a968-88c5c3b5b9e8 admin admin] PATH_INFO: `/v3/projects/879eba7f97c443d8a69ebe8f4b96d6e5/users/0522ed7e46f44923a47f5e0e6cd8a03d/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:19.299770 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eee23a-769e-4a3a-a968-88c5c3b5b9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879eba7f97c443d8a69ebe8f4b96d6e5, user_id=0522ed7e46f44923a47f5e0e6cd8a03d, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:19.303437 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eee23a-769e-4a3a-a968-88c5c3b5b9e8 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:19.308009 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-5ab037be-5a36-494e-a201-90e67f98327b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '604164d22cd940f7bd51232035ff19be', 'request_id': 'req-5ab037be-5a36-494e-a201-90e67f98327b'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:19.314240 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-5ab037be-5a36-494e-a201-90e67f98327b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '604164d22cd940f7bd51232035ff19be', 'request_id': 'req-5ab037be-5a36-494e-a201-90e67f98327b'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:19.328048 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-5ab037be-5a36-494e-a201-90e67f98327b admin admin] The token cache is being invalidate because project 604164d22cd940f7bd51232035ff19be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:19:19.328450 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-5ab037be-5a36-494e-a201-90e67f98327b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:19.329159 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-5ab037be-5a36-494e-a201-90e67f98327b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:19.330988 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 892/1799] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:19:17 2022] DELETE /identity/v3/projects/604164d22cd940f7bd51232035ff19be => generated 0 bytes in 1625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:19.332081 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ccde5-540e-49e5-9ef5-625c5792028a None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:19.332370 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ccde5-540e-49e5-9ef5-625c5792028a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:19.332651 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ccde5-540e-49e5-9ef5-625c5792028a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:19.358949 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-779ccde5-540e-49e5-9ef5-625c5792028a None None] MFA Rules not processed for user `72d4ac44d04943a5b24c7a1d6a31b7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:19.360405 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-779ccde5-540e-49e5-9ef5-625c5792028a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:19.452782 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 893/1800] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 13:19:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:19.462823 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e81fe0-60ae-4565-b0fb-56842f012944 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:19.463135 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e81fe0-60ae-4565-b0fb-56842f012944 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:19.463391 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e81fe0-60ae-4565-b0fb-56842f012944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:19.472579 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 908/1801] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:19 2022] PUT /identity/v3/projects/879eba7f97c443d8a69ebe8f4b96d6e5/users/0522ed7e46f44923a47f5e0e6cd8a03d/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:19.474048 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eee23a-769e-4a3a-a968-88c5c3b5b9e8 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:19.478384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-96eee23a-769e-4a3a-a968-88c5c3b5b9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:19.497511 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-88e81fe0-60ae-4565-b0fb-56842f012944 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:19.499568 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-88e81fe0-60ae-4565-b0fb-56842f012944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:19.600790 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 894/1802] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:19.600790 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e81fe0-60ae-4565-b0fb-56842f012944 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:19.606117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-88e81fe0-60ae-4565-b0fb-56842f012944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:19.607918 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eee23a-769e-4a3a-a968-88c5c3b5b9e8 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:19.614118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a080e0e-4e03-4c5d-baba-4f4c9fea9cac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:19.615041 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a080e0e-4e03-4c5d-baba-4f4c9fea9cac service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:19.615537 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a080e0e-4e03-4c5d-baba-4f4c9fea9cac service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:19.617627 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a080e0e-4e03-4c5d-baba-4f4c9fea9cac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:19.621278 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e81fe0-60ae-4565-b0fb-56842f012944 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:19.627181 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e8763-200b-44b2-bde6-3db8b10bd507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:19.627975 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e8763-200b-44b2-bde6-3db8b10bd507 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:19.628451 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e8763-200b-44b2-bde6-3db8b10bd507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:19.628867 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e8763-200b-44b2-bde6-3db8b10bd507 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:19.628990 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a080e0e-4e03-4c5d-baba-4f4c9fea9cac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:19.629925 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e8763-200b-44b2-bde6-3db8b10bd507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:19.630681 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a080e0e-4e03-4c5d-baba-4f4c9fea9cac service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:19.631763 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e8763-200b-44b2-bde6-3db8b10bd507 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:19.647436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 895/1803] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:19.647436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126d5a2-98f1-4b5f-92e6-83ff26fe49ba None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:19.647436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126d5a2-98f1-4b5f-92e6-83ff26fe49ba None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:19.647436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126d5a2-98f1-4b5f-92e6-83ff26fe49ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:19.647861 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 909/1804] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:19:19.649391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a080e0e-4e03-4c5d-baba-4f4c9fea9cac service nova] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:19.667379 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-f126d5a2-98f1-4b5f-92e6-83ff26fe49ba None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:19.668297 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a080e0e-4e03-4c5d-baba-4f4c9fea9cac service nova] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:19.669040 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f126d5a2-98f1-4b5f-92e6-83ff26fe49ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:19.676049 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34b0c9-11fd-4a56-92f3-9c364ee71a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:19.677409 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34b0c9-11fd-4a56-92f3-9c364ee71a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:19.678019 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34b0c9-11fd-4a56-92f3-9c364ee71a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:19.678441 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34b0c9-11fd-4a56-92f3-9c364ee71a00 admin admin] PATH_INFO: `/v3/projects/879eba7f97c443d8a69ebe8f4b96d6e5/users/0522ed7e46f44923a47f5e0e6cd8a03d/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:19.683518 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 896/1805] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:19.684529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126d5a2-98f1-4b5f-92e6-83ff26fe49ba None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:19.685378 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34b0c9-11fd-4a56-92f3-9c364ee71a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879eba7f97c443d8a69ebe8f4b96d6e5, user_id=0522ed7e46f44923a47f5e0e6cd8a03d, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:19.688843 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34b0c9-11fd-4a56-92f3-9c364ee71a00 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:19.698175 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126d5a2-98f1-4b5f-92e6-83ff26fe49ba None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:19.703769 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 910/1806] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:19 2022] PUT /identity/v3/projects/879eba7f97c443d8a69ebe8f4b96d6e5/users/0522ed7e46f44923a47f5e0e6cd8a03d/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:19.716563 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a37846-3d5b-4459-a2c6-7ce4f5638b73 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:19.717075 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a37846-3d5b-4459-a2c6-7ce4f5638b73 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:19.717528 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a37846-3d5b-4459-a2c6-7ce4f5638b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:19.764482 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-e0a37846-3d5b-4459-a2c6-7ce4f5638b73 None None] MFA Rules not processed for user `0522ed7e46f44923a47f5e0e6cd8a03d`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:19.766670 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e0a37846-3d5b-4459-a2c6-7ce4f5638b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:19.828741 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb4c93-a8f6-47e2-8da4-dffd7f3ed805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:19.831269 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb4c93-a8f6-47e2-8da4-dffd7f3ed805 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:19.831575 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb4c93-a8f6-47e2-8da4-dffd7f3ed805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:19.831869 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb4c93-a8f6-47e2-8da4-dffd7f3ed805 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:19.832599 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb4c93-a8f6-47e2-8da4-dffd7f3ed805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:19:19.833030 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb4c93-a8f6-47e2-8da4-dffd7f3ed805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:19.834584 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb4c93-a8f6-47e2-8da4-dffd7f3ed805 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:19.861342 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 897/1807] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:19:19.863320 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb4c93-a8f6-47e2-8da4-dffd7f3ed805 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:19.881153 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb4c93-a8f6-47e2-8da4-dffd7f3ed805 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:19.887052 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2700de-3008-4a2b-87bf-b669f3ba561a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:19.887703 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2700de-3008-4a2b-87bf-b669f3ba561a admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:19.887989 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2700de-3008-4a2b-87bf-b669f3ba561a admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:19.888266 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2700de-3008-4a2b-87bf-b669f3ba561a admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:19.889158 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2700de-3008-4a2b-87bf-b669f3ba561a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:19.891271 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2700de-3008-4a2b-87bf-b669f3ba561a admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:19.906275 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 911/1808] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:19 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:19:19.914784 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a37846-3d5b-4459-a2c6-7ce4f5638b73 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:19.919333 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e0a37846-3d5b-4459-a2c6-7ce4f5638b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:19.977192 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a37846-3d5b-4459-a2c6-7ce4f5638b73 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:19.981198 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc463d-688e-42fb-9fba-809f3a6d2e9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:19.981843 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc463d-688e-42fb-9fba-809f3a6d2e9f service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:19.982130 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc463d-688e-42fb-9fba-809f3a6d2e9f service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:19.982437 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc463d-688e-42fb-9fba-809f3a6d2e9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:19.993622 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc463d-688e-42fb-9fba-809f3a6d2e9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:19.995141 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc463d-688e-42fb-9fba-809f3a6d2e9f service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:20.006856 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 912/1809] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:19 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:19:20.036405 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 898/1810] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:19 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:20.041489 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc463d-688e-42fb-9fba-809f3a6d2e9f service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:20.056056 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc463d-688e-42fb-9fba-809f3a6d2e9f service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:20.163571 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d46a90-150f-456f-bf66-0e812fedbcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:20.165568 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d46a90-150f-456f-bf66-0e812fedbcb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:20.166013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d46a90-150f-456f-bf66-0e812fedbcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:20.169257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d46a90-150f-456f-bf66-0e812fedbcb7 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:20.169257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d46a90-150f-456f-bf66-0e812fedbcb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:20.171266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d46a90-150f-456f-bf66-0e812fedbcb7 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:20.285797 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 913/1811] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:20 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:19:20.290220 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2700de-3008-4a2b-87bf-b669f3ba561a admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:20.308581 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2700de-3008-4a2b-87bf-b669f3ba561a admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:20.314563 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38148f-7094-46d3-ad3f-a4a3b2cf2a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:20.316853 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38148f-7094-46d3-ad3f-a4a3b2cf2a7b admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:20.316853 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38148f-7094-46d3-ad3f-a4a3b2cf2a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:20.316853 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38148f-7094-46d3-ad3f-a4a3b2cf2a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:20.316853 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38148f-7094-46d3-ad3f-a4a3b2cf2a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:20.324408 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38148f-7094-46d3-ad3f-a4a3b2cf2a7b admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:20.342019 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d46a90-150f-456f-bf66-0e812fedbcb7 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:20.343024 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 899/1812] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:20.363355 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d46a90-150f-456f-bf66-0e812fedbcb7 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:20.378515 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d54083-abe2-4b61-a12c-9f7617b3e378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:20.381247 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d54083-abe2-4b61-a12c-9f7617b3e378 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:20.381697 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d54083-abe2-4b61-a12c-9f7617b3e378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:20.382112 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d54083-abe2-4b61-a12c-9f7617b3e378 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:20.386213 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d54083-abe2-4b61-a12c-9f7617b3e378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:20.386213 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d54083-abe2-4b61-a12c-9f7617b3e378 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:20.417883 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 914/1813] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:20.420329 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38148f-7094-46d3-ad3f-a4a3b2cf2a7b admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:20.430577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d54083-abe2-4b61-a12c-9f7617b3e378 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:20.435125 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38148f-7094-46d3-ad3f-a4a3b2cf2a7b admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:20.436056 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-79d54083-abe2-4b61-a12c-9f7617b3e378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:20.470991 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703719ba-f6a6-4b86-b61e-7590d1aad73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:20.474124 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703719ba-f6a6-4b86-b61e-7590d1aad73e admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:20.474425 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703719ba-f6a6-4b86-b61e-7590d1aad73e admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:20.475833 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703719ba-f6a6-4b86-b61e-7590d1aad73e admin admin] PATH_INFO: `/v3/projects/43adb7932c31430982833e991f02d516/users/e9d8a94d2f05467f9d88d3e6edb9ae48/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:20.499391 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703719ba-f6a6-4b86-b61e-7590d1aad73e admin admin] RBAC: Authorizing `identity:create_grant(project_id=43adb7932c31430982833e991f02d516, user_id=e9d8a94d2f05467f9d88d3e6edb9ae48, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:20.510890 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703719ba-f6a6-4b86-b61e-7590d1aad73e admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:20.543857 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d54083-abe2-4b61-a12c-9f7617b3e378 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:20.548022 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4611d-d6f8-4c9d-8e12-995ca4d8918a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:20.548768 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4611d-d6f8-4c9d-8e12-995ca4d8918a service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:20.548979 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4611d-d6f8-4c9d-8e12-995ca4d8918a service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:20.549248 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4611d-d6f8-4c9d-8e12-995ca4d8918a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:20.551057 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-76f4611d-d6f8-4c9d-8e12-995ca4d8918a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:20.629181 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4611d-d6f8-4c9d-8e12-995ca4d8918a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:20.630775 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4611d-d6f8-4c9d-8e12-995ca4d8918a service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:20.641529 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 915/1814] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:20 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:20.647217 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 900/1815] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:20 2022] PUT /identity/v3/projects/43adb7932c31430982833e991f02d516/users/e9d8a94d2f05467f9d88d3e6edb9ae48/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:20.657547 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cccb67-47c6-48f1-862d-5990feff46fd None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:20.658276 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cccb67-47c6-48f1-862d-5990feff46fd None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:20.658914 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cccb67-47c6-48f1-862d-5990feff46fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:20.705057 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-20cccb67-47c6-48f1-862d-5990feff46fd None None] MFA Rules not processed for user `e9d8a94d2f05467f9d88d3e6edb9ae48`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:20.708161 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-20cccb67-47c6-48f1-862d-5990feff46fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:20.787554 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 916/1816] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:19:20.792919 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703719ba-f6a6-4b86-b61e-7590d1aad73e admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:20.853139 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703719ba-f6a6-4b86-b61e-7590d1aad73e admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:20.858147 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e866972-3755-48f6-b1b5-6cd7e7e6fa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:20.858866 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e866972-3755-48f6-b1b5-6cd7e7e6fa4e admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:20.859152 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e866972-3755-48f6-b1b5-6cd7e7e6fa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:20.859431 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e866972-3755-48f6-b1b5-6cd7e7e6fa4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:20.860126 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e866972-3755-48f6-b1b5-6cd7e7e6fa4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:20.862100 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e866972-3755-48f6-b1b5-6cd7e7e6fa4e admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:21.047616 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 901/1817] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:20 2022] POST /identity/v3/projects => generated 387 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:19:21.051857 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cccb67-47c6-48f1-862d-5990feff46fd None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:21.062593 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cccb67-47c6-48f1-862d-5990feff46fd None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:21.123514 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ef49f-baf7-429e-8f09-ee0aaca8f982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:21.124186 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ef49f-baf7-429e-8f09-ee0aaca8f982 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:21.124471 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ef49f-baf7-429e-8f09-ee0aaca8f982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:21.124788 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ef49f-baf7-429e-8f09-ee0aaca8f982 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:21.125492 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ef49f-baf7-429e-8f09-ee0aaca8f982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:21.127509 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ef49f-baf7-429e-8f09-ee0aaca8f982 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:21.215285 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 917/1818] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:21 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:21.219249 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e866972-3755-48f6-b1b5-6cd7e7e6fa4e admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:21.229289 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e866972-3755-48f6-b1b5-6cd7e7e6fa4e admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:21.235669 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9544ae-1ef0-4f50-8c0e-1f6f58f67776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:21.236357 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9544ae-1ef0-4f50-8c0e-1f6f58f67776 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:21.236606 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9544ae-1ef0-4f50-8c0e-1f6f58f67776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:21.236952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9544ae-1ef0-4f50-8c0e-1f6f58f67776 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:21.237746 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9544ae-1ef0-4f50-8c0e-1f6f58f67776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:21.239351 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9544ae-1ef0-4f50-8c0e-1f6f58f67776 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:21.254005 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 902/1819] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:21.254824 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ef49f-baf7-429e-8f09-ee0aaca8f982 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:21.272167 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ef49f-baf7-429e-8f09-ee0aaca8f982 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:21.282578 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a7691-cdba-4a20-8a52-8df6fe644c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:21.284303 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a7691-cdba-4a20-8a52-8df6fe644c5e admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:21.285960 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a7691-cdba-4a20-8a52-8df6fe644c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:21.286899 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a7691-cdba-4a20-8a52-8df6fe644c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:21.288429 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a7691-cdba-4a20-8a52-8df6fe644c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:21.293982 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a7691-cdba-4a20-8a52-8df6fe644c5e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:21.312314 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 918/1820] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:21.314321 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9544ae-1ef0-4f50-8c0e-1f6f58f67776 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:21.332036 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9544ae-1ef0-4f50-8c0e-1f6f58f67776 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:21.337818 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd3756-f192-4fe3-86b0-f1e836ae644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:21.338707 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd3756-f192-4fe3-86b0-f1e836ae644c admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:21.339001 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd3756-f192-4fe3-86b0-f1e836ae644c admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:21.339266 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd3756-f192-4fe3-86b0-f1e836ae644c admin admin] PATH_INFO: `/v3/projects/a938ded42cd0407dbdbad77f1b296ece/users/d64a11e7030a450fa5b34b321bb40155/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:21.359371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd3756-f192-4fe3-86b0-f1e836ae644c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a938ded42cd0407dbdbad77f1b296ece, user_id=d64a11e7030a450fa5b34b321bb40155, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:21.363371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd3756-f192-4fe3-86b0-f1e836ae644c admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:21.483504 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 903/1821] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:21 2022] PUT /identity/v3/projects/a938ded42cd0407dbdbad77f1b296ece/users/d64a11e7030a450fa5b34b321bb40155/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:21.495433 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb95812-404e-4967-b94b-99cdcd3157e6 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:21.495671 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb95812-404e-4967-b94b-99cdcd3157e6 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:21.495950 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb95812-404e-4967-b94b-99cdcd3157e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:21.525351 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-5eb95812-404e-4967-b94b-99cdcd3157e6 None None] MFA Rules not processed for user `d64a11e7030a450fa5b34b321bb40155`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:21.527808 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-5eb95812-404e-4967-b94b-99cdcd3157e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:21.604181 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 919/1822] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:21.608847 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd3756-f192-4fe3-86b0-f1e836ae644c admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:21.678572 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd3756-f192-4fe3-86b0-f1e836ae644c admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:21.683647 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed66e96-cecd-44bd-9f42-e0bdae163b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:21.684370 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed66e96-cecd-44bd-9f42-e0bdae163b56 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:21.684648 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed66e96-cecd-44bd-9f42-e0bdae163b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:21.684951 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed66e96-cecd-44bd-9f42-e0bdae163b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:21.685661 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed66e96-cecd-44bd-9f42-e0bdae163b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:21.695147 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed66e96-cecd-44bd-9f42-e0bdae163b56 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:21.808795 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 904/1823] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:21 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:21.819063 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb95812-404e-4967-b94b-99cdcd3157e6 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:21.831345 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb95812-404e-4967-b94b-99cdcd3157e6 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:21.895200 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41981a0-662a-4f69-9ab5-a5d662b34a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:21.895910 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41981a0-662a-4f69-9ab5-a5d662b34a34 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:21.896409 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41981a0-662a-4f69-9ab5-a5d662b34a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:21.896518 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41981a0-662a-4f69-9ab5-a5d662b34a34 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:21.897223 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41981a0-662a-4f69-9ab5-a5d662b34a34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:21.899855 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41981a0-662a-4f69-9ab5-a5d662b34a34 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:22.056690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 920/1824] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:21 2022] POST /identity/v3/users => generated 300 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:22.060496 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed66e96-cecd-44bd-9f42-e0bdae163b56 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:22.071100 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed66e96-cecd-44bd-9f42-e0bdae163b56 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:22.075591 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca24a43-0f39-4689-a352-dce16e9de121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:22.078008 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca24a43-0f39-4689-a352-dce16e9de121 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:22.078008 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca24a43-0f39-4689-a352-dce16e9de121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:22.078008 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca24a43-0f39-4689-a352-dce16e9de121 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:22.078008 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca24a43-0f39-4689-a352-dce16e9de121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:22.079116 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca24a43-0f39-4689-a352-dce16e9de121 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:22.089931 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 905/1825] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:22.094048 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41981a0-662a-4f69-9ab5-a5d662b34a34 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:22.104036 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41981a0-662a-4f69-9ab5-a5d662b34a34 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:22.108987 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00beabfb-4471-4d09-8f77-bb62a49b85d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:22.109924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beabfb-4471-4d09-8f77-bb62a49b85d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:22.110175 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beabfb-4471-4d09-8f77-bb62a49b85d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:22.110445 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beabfb-4471-4d09-8f77-bb62a49b85d7 admin admin] PATH_INFO: `/v3/projects/d04ed3d28f1e4ed99b770c34e82f5165/users/b60cf206cb2a40619bb4a4bfe11c177b/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:22.125511 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00beabfb-4471-4d09-8f77-bb62a49b85d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04ed3d28f1e4ed99b770c34e82f5165, user_id=b60cf206cb2a40619bb4a4bfe11c177b, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:22.128206 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00beabfb-4471-4d09-8f77-bb62a49b85d7 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:22.222483 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 921/1826] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:22 2022] PUT /identity/v3/projects/d04ed3d28f1e4ed99b770c34e82f5165/users/b60cf206cb2a40619bb4a4bfe11c177b/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:22.227309 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca24a43-0f39-4689-a352-dce16e9de121 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:22.238106 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca24a43-0f39-4689-a352-dce16e9de121 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:22.291700 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f247fe-f0a1-4de1-8c39-aa5cc7a652bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:22.292359 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f247fe-f0a1-4de1-8c39-aa5cc7a652bf admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:22.292638 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f247fe-f0a1-4de1-8c39-aa5cc7a652bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:22.292950 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f247fe-f0a1-4de1-8c39-aa5cc7a652bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:22.293663 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f247fe-f0a1-4de1-8c39-aa5cc7a652bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:22.295254 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f247fe-f0a1-4de1-8c39-aa5cc7a652bf admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:22.305112 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 906/1827] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:22.309568 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00beabfb-4471-4d09-8f77-bb62a49b85d7 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:22.319634 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00beabfb-4471-4d09-8f77-bb62a49b85d7 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:22.325120 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045029ab-4c57-415f-8f80-fc79c547ac07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:22.326005 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045029ab-4c57-415f-8f80-fc79c547ac07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:22.326285 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045029ab-4c57-415f-8f80-fc79c547ac07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:22.326557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045029ab-4c57-415f-8f80-fc79c547ac07 admin admin] PATH_INFO: `/v3/projects/d04ed3d28f1e4ed99b770c34e82f5165/users/b60cf206cb2a40619bb4a4bfe11c177b/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:22.328877 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045029ab-4c57-415f-8f80-fc79c547ac07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04ed3d28f1e4ed99b770c34e82f5165, user_id=b60cf206cb2a40619bb4a4bfe11c177b, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:22.331764 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045029ab-4c57-415f-8f80-fc79c547ac07 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:22.342563 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 922/1828] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:22 2022] PUT /identity/v3/projects/d04ed3d28f1e4ed99b770c34e82f5165/users/b60cf206cb2a40619bb4a4bfe11c177b/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:22.353927 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d10b4b-9cfe-4b7a-90a6-2b0df87b3ba2 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:22.354364 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d10b4b-9cfe-4b7a-90a6-2b0df87b3ba2 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:22.354490 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d10b4b-9cfe-4b7a-90a6-2b0df87b3ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:22.389005 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-d4d10b4b-9cfe-4b7a-90a6-2b0df87b3ba2 None None] MFA Rules not processed for user `b60cf206cb2a40619bb4a4bfe11c177b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:22.390409 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-d4d10b4b-9cfe-4b7a-90a6-2b0df87b3ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:22.473624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 907/1829] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:19:22.487338 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045029ab-4c57-415f-8f80-fc79c547ac07 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:22.547988 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045029ab-4c57-415f-8f80-fc79c547ac07 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:22.551770 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6578c99-51f4-45c5-a98b-f2845aeffab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:22.552413 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6578c99-51f4-45c5-a98b-f2845aeffab5 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:22.552721 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6578c99-51f4-45c5-a98b-f2845aeffab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:22.553003 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6578c99-51f4-45c5-a98b-f2845aeffab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:22.565175 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6578c99-51f4-45c5-a98b-f2845aeffab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:22.565175 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6578c99-51f4-45c5-a98b-f2845aeffab5 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:22.574684 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 923/1830] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:23.483428 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d10b4b-9cfe-4b7a-90a6-2b0df87b3ba2 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:23.493431 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d10b4b-9cfe-4b7a-90a6-2b0df87b3ba2 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:23.497584 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39951344-473e-48a3-a49e-c9c96d912fe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:23.500164 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39951344-473e-48a3-a49e-c9c96d912fe7 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:23.500164 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39951344-473e-48a3-a49e-c9c96d912fe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:23.500164 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39951344-473e-48a3-a49e-c9c96d912fe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:23.500490 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-39951344-473e-48a3-a49e-c9c96d912fe7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:23.568878 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39951344-473e-48a3-a49e-c9c96d912fe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:23.571046 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39951344-473e-48a3-a49e-c9c96d912fe7 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:23.582155 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 908/1831] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:23 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:23.815419 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6578c99-51f4-45c5-a98b-f2845aeffab5 service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:23.824725 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6578c99-51f4-45c5-a98b-f2845aeffab5 service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:23.828312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365352ee-7c19-49cc-b995-cff64ce85fcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:23.828983 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365352ee-7c19-49cc-b995-cff64ce85fcc service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:23.829335 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365352ee-7c19-49cc-b995-cff64ce85fcc service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:23.829595 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365352ee-7c19-49cc-b995-cff64ce85fcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:23.901568 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365352ee-7c19-49cc-b995-cff64ce85fcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:23.903422 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365352ee-7c19-49cc-b995-cff64ce85fcc service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:23.914872 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 924/1832] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:32.067568 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359c78c-a896-416f-8d52-1f6c762e0459 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:32.068150 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359c78c-a896-416f-8d52-1f6c762e0459 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:32.068150 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359c78c-a896-416f-8d52-1f6c762e0459 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:32.069914 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 909/1833] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 13:19:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:19:32.093236 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411cf9c-3432-4490-885c-3a88ae3e97c9 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:32.094218 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411cf9c-3432-4490-885c-3a88ae3e97c9 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:32.095056 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411cf9c-3432-4490-885c-3a88ae3e97c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:32.123039 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-5411cf9c-3432-4490-885c-3a88ae3e97c9 None None] MFA Rules not processed for user `72d4ac44d04943a5b24c7a1d6a31b7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:32.123641 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-5411cf9c-3432-4490-885c-3a88ae3e97c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:32.316339 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 925/1834] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 13:19:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:32.378153 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359c78c-a896-416f-8d52-1f6c762e0459 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:32.419904 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359c78c-a896-416f-8d52-1f6c762e0459 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:32.442658 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bfe09-d034-40ff-98ee-22d5ea8edbce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:32.443564 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bfe09-d034-40ff-98ee-22d5ea8edbce service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:32.443672 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bfe09-d034-40ff-98ee-22d5ea8edbce service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:32.443881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bfe09-d034-40ff-98ee-22d5ea8edbce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:32.468580 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bfe09-d034-40ff-98ee-22d5ea8edbce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:32.470162 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bfe09-d034-40ff-98ee-22d5ea8edbce service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:32.497105 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 910/1835] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:19:36.306232 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411cf9c-3432-4490-885c-3a88ae3e97c9 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:36.317627 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411cf9c-3432-4490-885c-3a88ae3e97c9 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:36.322305 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6e98e-cbfd-4396-b8d3-5fa391962128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:36.322957 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6e98e-cbfd-4396-b8d3-5fa391962128 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:36.323436 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6e98e-cbfd-4396-b8d3-5fa391962128 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:36.323921 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6e98e-cbfd-4396-b8d3-5fa391962128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:36.389703 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6e98e-cbfd-4396-b8d3-5fa391962128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:36.391414 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6e98e-cbfd-4396-b8d3-5fa391962128 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:36.402569 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 926/1836] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:37.693458 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bfe09-d034-40ff-98ee-22d5ea8edbce service nova] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:37.694982 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-115bfe09-d034-40ff-98ee-22d5ea8edbce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:37.763751 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bfe09-d034-40ff-98ee-22d5ea8edbce service nova] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:37.768299 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cee020-aa30-46cd-b991-3979d1056201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:37.769134 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cee020-aa30-46cd-b991-3979d1056201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:37.769471 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cee020-aa30-46cd-b991-3979d1056201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:37.769751 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cee020-aa30-46cd-b991-3979d1056201 admin admin] PATH_INFO: `/v3/users/4ac0d033f80147fab976673ba0633958` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:37.771076 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cee020-aa30-46cd-b991-3979d1056201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac0d033f80147fab976673ba0633958)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:37.773343 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cee020-aa30-46cd-b991-3979d1056201 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:38.226987 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-89cee020-aa30-46cd-b991-3979d1056201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac0d033f80147fab976673ba0633958'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:38.243689 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-89cee020-aa30-46cd-b991-3979d1056201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac0d033f80147fab976673ba0633958'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:38.244423 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-89cee020-aa30-46cd-b991-3979d1056201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac0d033f80147fab976673ba0633958'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:38.387213 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-89cee020-aa30-46cd-b991-3979d1056201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac0d033f80147fab976673ba0633958'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:38.387843 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-89cee020-aa30-46cd-b991-3979d1056201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac0d033f80147fab976673ba0633958'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:38.403729 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 911/1837] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:19:37 2022] DELETE /identity/v3/users/4ac0d033f80147fab976673ba0633958 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:38.408295 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c257772-6989-47a5-b74d-a8683c08b953 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:38.408794 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c257772-6989-47a5-b74d-a8683c08b953 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:38.408935 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c257772-6989-47a5-b74d-a8683c08b953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:38.447409 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-0c257772-6989-47a5-b74d-a8683c08b953 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:38.448628 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0c257772-6989-47a5-b74d-a8683c08b953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:38.535208 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 927/1838] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:38.542361 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cee020-aa30-46cd-b991-3979d1056201 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:38.543839 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-89cee020-aa30-46cd-b991-3979d1056201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:38.603311 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cee020-aa30-46cd-b991-3979d1056201 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:38.607225 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909314b7-6664-4484-8db1-eb4bfbdb4040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:38.607908 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909314b7-6664-4484-8db1-eb4bfbdb4040 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:38.608193 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909314b7-6664-4484-8db1-eb4bfbdb4040 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:38.608491 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909314b7-6664-4484-8db1-eb4bfbdb4040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:38.618446 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909314b7-6664-4484-8db1-eb4bfbdb4040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:38.619886 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909314b7-6664-4484-8db1-eb4bfbdb4040 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:38.629637 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 912/1839] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:39.102471 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c257772-6989-47a5-b74d-a8683c08b953 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:39.107436 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0c257772-6989-47a5-b74d-a8683c08b953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:39.123460 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c257772-6989-47a5-b74d-a8683c08b953 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:39.134279 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71965d38-5e94-4cbd-ac69-65256e1f63b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:39.134279 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71965d38-5e94-4cbd-ac69-65256e1f63b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:39.134279 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71965d38-5e94-4cbd-ac69-65256e1f63b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:39.134279 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71965d38-5e94-4cbd-ac69-65256e1f63b8 admin admin] PATH_INFO: `/v3/projects/3ca0447aef3648b582fcbdfbc07ec994` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:39.134692 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71965d38-5e94-4cbd-ac69-65256e1f63b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ca0447aef3648b582fcbdfbc07ec994)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:39.135426 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71965d38-5e94-4cbd-ac69-65256e1f63b8 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:39.313933 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-71965d38-5e94-4cbd-ac69-65256e1f63b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ca0447aef3648b582fcbdfbc07ec994', 'request_id': 'req-71965d38-5e94-4cbd-ac69-65256e1f63b8'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:39.328195 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-71965d38-5e94-4cbd-ac69-65256e1f63b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ca0447aef3648b582fcbdfbc07ec994', 'request_id': 'req-71965d38-5e94-4cbd-ac69-65256e1f63b8'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:39.337398 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-71965d38-5e94-4cbd-ac69-65256e1f63b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ca0447aef3648b582fcbdfbc07ec994', 'request_id': 'req-71965d38-5e94-4cbd-ac69-65256e1f63b8'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:39.431806 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-71965d38-5e94-4cbd-ac69-65256e1f63b8 admin admin] The token cache is being invalidate because project 3ca0447aef3648b582fcbdfbc07ec994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:19:39.432436 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-71965d38-5e94-4cbd-ac69-65256e1f63b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:39.433830 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-71965d38-5e94-4cbd-ac69-65256e1f63b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:39.434608 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 928/1840] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:19:39 2022] DELETE /identity/v3/projects/3ca0447aef3648b582fcbdfbc07ec994 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:39.438501 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909314b7-6664-4484-8db1-eb4bfbdb4040 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:39.448783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909314b7-6664-4484-8db1-eb4bfbdb4040 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:39.505289 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74223b-9da5-4bc3-aef3-d86523952ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:39.506155 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74223b-9da5-4bc3-aef3-d86523952ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:39.506464 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74223b-9da5-4bc3-aef3-d86523952ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:39.506730 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74223b-9da5-4bc3-aef3-d86523952ca7 admin admin] PATH_INFO: `/v3/users/872366361cdf4fa3af34d23506c38a0f` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:39.507910 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74223b-9da5-4bc3-aef3-d86523952ca7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=872366361cdf4fa3af34d23506c38a0f)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:39.510167 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74223b-9da5-4bc3-aef3-d86523952ca7 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:39.685823 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4f74223b-9da5-4bc3-aef3-d86523952ca7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872366361cdf4fa3af34d23506c38a0f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:39.697463 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4f74223b-9da5-4bc3-aef3-d86523952ca7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872366361cdf4fa3af34d23506c38a0f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:39.698160 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4f74223b-9da5-4bc3-aef3-d86523952ca7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872366361cdf4fa3af34d23506c38a0f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:39.750141 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4f74223b-9da5-4bc3-aef3-d86523952ca7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872366361cdf4fa3af34d23506c38a0f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:39.750786 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4f74223b-9da5-4bc3-aef3-d86523952ca7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872366361cdf4fa3af34d23506c38a0f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:39.763046 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 913/1841] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:19:39 2022] DELETE /identity/v3/users/872366361cdf4fa3af34d23506c38a0f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:40.171361 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71965d38-5e94-4cbd-ac69-65256e1f63b8 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:40.172797 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-71965d38-5e94-4cbd-ac69-65256e1f63b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:40.192090 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71965d38-5e94-4cbd-ac69-65256e1f63b8 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:40.248992 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63e843-5c60-4b0b-80c1-80146edad639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:40.249858 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63e843-5c60-4b0b-80c1-80146edad639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:40.250143 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63e843-5c60-4b0b-80c1-80146edad639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:40.250431 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63e843-5c60-4b0b-80c1-80146edad639 admin admin] PATH_INFO: `/v3/projects/e64eb06f9c8740af98fd528c17fc0c4d` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:40.251639 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63e843-5c60-4b0b-80c1-80146edad639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e64eb06f9c8740af98fd528c17fc0c4d)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:40.253612 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63e843-5c60-4b0b-80c1-80146edad639 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:40.365165 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-6b63e843-5c60-4b0b-80c1-80146edad639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e64eb06f9c8740af98fd528c17fc0c4d', 'request_id': 'req-6b63e843-5c60-4b0b-80c1-80146edad639'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:40.370974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-6b63e843-5c60-4b0b-80c1-80146edad639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e64eb06f9c8740af98fd528c17fc0c4d', 'request_id': 'req-6b63e843-5c60-4b0b-80c1-80146edad639'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:40.377200 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-6b63e843-5c60-4b0b-80c1-80146edad639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e64eb06f9c8740af98fd528c17fc0c4d', 'request_id': 'req-6b63e843-5c60-4b0b-80c1-80146edad639'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:40.488560 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-6b63e843-5c60-4b0b-80c1-80146edad639 admin admin] The token cache is being invalidate because project e64eb06f9c8740af98fd528c17fc0c4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:19:40.489225 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-6b63e843-5c60-4b0b-80c1-80146edad639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:40.491773 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-6b63e843-5c60-4b0b-80c1-80146edad639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:40.493663 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 929/1842] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:19:40 2022] DELETE /identity/v3/projects/e64eb06f9c8740af98fd528c17fc0c4d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:40.498502 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f34cf-f262-44fe-bd09-4c705161f375 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:40.499303 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f34cf-f262-44fe-bd09-4c705161f375 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:40.499718 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f34cf-f262-44fe-bd09-4c705161f375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:40.523455 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-1d2f34cf-f262-44fe-bd09-4c705161f375 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:40.529121 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1d2f34cf-f262-44fe-bd09-4c705161f375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:40.600238 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 914/1843] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:40.602240 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4306cc-1d24-45ed-a0b3-52782f2d2873 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:40.602696 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4306cc-1d24-45ed-a0b3-52782f2d2873 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:40.603544 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4306cc-1d24-45ed-a0b3-52782f2d2873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:40.623779 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-9b4306cc-1d24-45ed-a0b3-52782f2d2873 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:40.625082 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9b4306cc-1d24-45ed-a0b3-52782f2d2873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:40.633692 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 930/1844] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:40.637959 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f34cf-f262-44fe-bd09-4c705161f375 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:40.651164 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f34cf-f262-44fe-bd09-4c705161f375 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:40.656114 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff9a2d-14e0-42ca-8fd2-2e7189b9bd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:40.657394 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff9a2d-14e0-42ca-8fd2-2e7189b9bd23 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:40.657394 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff9a2d-14e0-42ca-8fd2-2e7189b9bd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:40.657581 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff9a2d-14e0-42ca-8fd2-2e7189b9bd23 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:40.658196 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff9a2d-14e0-42ca-8fd2-2e7189b9bd23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:19:40.658499 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff9a2d-14e0-42ca-8fd2-2e7189b9bd23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:40.660178 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff9a2d-14e0-42ca-8fd2-2e7189b9bd23 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:40.679503 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4306cc-1d24-45ed-a0b3-52782f2d2873 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:40.687039 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 915/1845] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:19:40.689263 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4306cc-1d24-45ed-a0b3-52782f2d2873 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:40.694662 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2724aba-0c4a-4cee-a0ba-5491d91f702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:40.695386 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2724aba-0c4a-4cee-a0ba-5491d91f702e admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:40.695671 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2724aba-0c4a-4cee-a0ba-5491d91f702e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:40.695945 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2724aba-0c4a-4cee-a0ba-5491d91f702e admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:40.696638 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2724aba-0c4a-4cee-a0ba-5491d91f702e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:40.698599 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2724aba-0c4a-4cee-a0ba-5491d91f702e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:40.777767 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 931/1846] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:40 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:40.782000 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff9a2d-14e0-42ca-8fd2-2e7189b9bd23 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:40.791759 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff9a2d-14e0-42ca-8fd2-2e7189b9bd23 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:40.848387 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d40313-5ca2-4cbe-9fa9-4f8d895a3b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:40.849067 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d40313-5ca2-4cbe-9fa9-4f8d895a3b1f admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:40.849348 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d40313-5ca2-4cbe-9fa9-4f8d895a3b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:40.849621 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d40313-5ca2-4cbe-9fa9-4f8d895a3b1f admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:40.850334 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d40313-5ca2-4cbe-9fa9-4f8d895a3b1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:40.852292 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d40313-5ca2-4cbe-9fa9-4f8d895a3b1f admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:40.952950 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 916/1847] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:40 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:40.957198 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2724aba-0c4a-4cee-a0ba-5491d91f702e admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:40.968333 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2724aba-0c4a-4cee-a0ba-5491d91f702e admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:40.973131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a54036-f5d7-4bb6-a73b-30f550279354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:40.973793 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a54036-f5d7-4bb6-a73b-30f550279354 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:40.974282 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a54036-f5d7-4bb6-a73b-30f550279354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:40.974617 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a54036-f5d7-4bb6-a73b-30f550279354 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:40.975960 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a54036-f5d7-4bb6-a73b-30f550279354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:40.977772 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a54036-f5d7-4bb6-a73b-30f550279354 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:40.988848 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 932/1848] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:40.993373 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d40313-5ca2-4cbe-9fa9-4f8d895a3b1f admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:41.003375 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d40313-5ca2-4cbe-9fa9-4f8d895a3b1f admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:41.008123 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7e103-d085-44b1-aa3a-4a09f0609600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:41.008875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7e103-d085-44b1-aa3a-4a09f0609600 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:41.009162 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7e103-d085-44b1-aa3a-4a09f0609600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:41.009441 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7e103-d085-44b1-aa3a-4a09f0609600 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:41.010173 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7e103-d085-44b1-aa3a-4a09f0609600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:41.011783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7e103-d085-44b1-aa3a-4a09f0609600 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:41.022362 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 917/1849] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:41.026589 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a54036-f5d7-4bb6-a73b-30f550279354 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:41.036398 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a54036-f5d7-4bb6-a73b-30f550279354 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:41.041591 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411688b-25fa-487f-a360-f02327940e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:41.042486 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411688b-25fa-487f-a360-f02327940e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:41.042765 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411688b-25fa-487f-a360-f02327940e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:41.043032 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411688b-25fa-487f-a360-f02327940e1c admin admin] PATH_INFO: `/v3/projects/bd56fea948b14eb89fd9e8b359528d35/users/ec1bcd3cba614b3b857ecaecafe507ff/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:41.057233 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3411688b-25fa-487f-a360-f02327940e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd56fea948b14eb89fd9e8b359528d35, user_id=ec1bcd3cba614b3b857ecaecafe507ff, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:41.059894 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3411688b-25fa-487f-a360-f02327940e1c admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:41.204157 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 933/1850] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:41 2022] PUT /identity/v3/projects/bd56fea948b14eb89fd9e8b359528d35/users/ec1bcd3cba614b3b857ecaecafe507ff/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:41.215959 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc28fb-550e-4f99-a8f3-51d555531282 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:41.216344 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc28fb-550e-4f99-a8f3-51d555531282 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:41.216746 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc28fb-550e-4f99-a8f3-51d555531282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:41.244078 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-c1cc28fb-550e-4f99-a8f3-51d555531282 None None] MFA Rules not processed for user `ec1bcd3cba614b3b857ecaecafe507ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:41.245464 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c1cc28fb-550e-4f99-a8f3-51d555531282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:41.306621 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 918/1851] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:41.311199 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411688b-25fa-487f-a360-f02327940e1c admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:41.371183 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411688b-25fa-487f-a360-f02327940e1c admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:41.375817 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb16b2-63db-45cc-b6f3-9fd7856d673b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:41.376505 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb16b2-63db-45cc-b6f3-9fd7856d673b admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:41.376766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb16b2-63db-45cc-b6f3-9fd7856d673b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:41.377043 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb16b2-63db-45cc-b6f3-9fd7856d673b admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:41.377736 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb16b2-63db-45cc-b6f3-9fd7856d673b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:41.379624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb16b2-63db-45cc-b6f3-9fd7856d673b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:41.474297 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 934/1852] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:41 2022] POST /identity/v3/projects => generated 369 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:19:41.479674 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc28fb-550e-4f99-a8f3-51d555531282 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:41.491501 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc28fb-550e-4f99-a8f3-51d555531282 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:41.572892 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4e082-82f1-47cf-8106-af5149baf725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:41.573739 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4e082-82f1-47cf-8106-af5149baf725 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:41.574127 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4e082-82f1-47cf-8106-af5149baf725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:41.574502 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4e082-82f1-47cf-8106-af5149baf725 admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:41.575308 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4e082-82f1-47cf-8106-af5149baf725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:41.577366 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4e082-82f1-47cf-8106-af5149baf725 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:41.718414 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 919/1853] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:41 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:41.722332 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb16b2-63db-45cc-b6f3-9fd7856d673b admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:41.734158 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb16b2-63db-45cc-b6f3-9fd7856d673b admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:41.740370 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4e7b0-57b6-44c9-b752-9304e798ef1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:41.741313 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4e7b0-57b6-44c9-b752-9304e798ef1b admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:41.741698 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4e7b0-57b6-44c9-b752-9304e798ef1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:41.742110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4e7b0-57b6-44c9-b752-9304e798ef1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:41.742976 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4e7b0-57b6-44c9-b752-9304e798ef1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:41.744736 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4e7b0-57b6-44c9-b752-9304e798ef1b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:41.765571 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 935/1854] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:19:41.769728 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4e082-82f1-47cf-8106-af5149baf725 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:41.780348 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4e082-82f1-47cf-8106-af5149baf725 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:41.784933 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684dd8a-8532-48b0-8b4b-caadd8bb0dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:41.785810 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684dd8a-8532-48b0-8b4b-caadd8bb0dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:41.786085 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684dd8a-8532-48b0-8b4b-caadd8bb0dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:41.786356 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684dd8a-8532-48b0-8b4b-caadd8bb0dd3 admin admin] PATH_INFO: `/v3/projects/8faea864633d40b580b987c697f54f85/users/9240b73cb7ed439cbc61ae9b9f84c9cf/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:41.801241 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684dd8a-8532-48b0-8b4b-caadd8bb0dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8faea864633d40b580b987c697f54f85, user_id=9240b73cb7ed439cbc61ae9b9f84c9cf, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:41.803905 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684dd8a-8532-48b0-8b4b-caadd8bb0dd3 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:41.889794 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 920/1855] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:41 2022] PUT /identity/v3/projects/8faea864633d40b580b987c697f54f85/users/9240b73cb7ed439cbc61ae9b9f84c9cf/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:41.895935 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4e7b0-57b6-44c9-b752-9304e798ef1b admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:41.907535 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4e7b0-57b6-44c9-b752-9304e798ef1b admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:41.965483 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba938bed-0667-4e80-8606-1ba25b370787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:41.966097 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba938bed-0667-4e80-8606-1ba25b370787 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:41.966382 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba938bed-0667-4e80-8606-1ba25b370787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:41.966661 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba938bed-0667-4e80-8606-1ba25b370787 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:41.967391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba938bed-0667-4e80-8606-1ba25b370787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:41.969111 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba938bed-0667-4e80-8606-1ba25b370787 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:41.980937 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 936/1856] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:41.985101 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684dd8a-8532-48b0-8b4b-caadd8bb0dd3 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:41.996010 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684dd8a-8532-48b0-8b4b-caadd8bb0dd3 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:42.000745 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6aef32-2703-4bde-869b-c121721dd238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:42.001627 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6aef32-2703-4bde-869b-c121721dd238 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:42.001908 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6aef32-2703-4bde-869b-c121721dd238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:42.002180 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6aef32-2703-4bde-869b-c121721dd238 admin admin] PATH_INFO: `/v3/projects/8faea864633d40b580b987c697f54f85/users/9240b73cb7ed439cbc61ae9b9f84c9cf/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:42.004144 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6aef32-2703-4bde-869b-c121721dd238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8faea864633d40b580b987c697f54f85, user_id=9240b73cb7ed439cbc61ae9b9f84c9cf, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:42.006935 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6aef32-2703-4bde-869b-c121721dd238 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:42.017914 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 921/1857] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:41 2022] PUT /identity/v3/projects/8faea864633d40b580b987c697f54f85/users/9240b73cb7ed439cbc61ae9b9f84c9cf/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:42.028401 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95583008-6402-45d4-ad10-9d0f5b6484a1 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:42.028716 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95583008-6402-45d4-ad10-9d0f5b6484a1 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:42.029020 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95583008-6402-45d4-ad10-9d0f5b6484a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:42.056689 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-95583008-6402-45d4-ad10-9d0f5b6484a1 None None] MFA Rules not processed for user `9240b73cb7ed439cbc61ae9b9f84c9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:42.057932 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-95583008-6402-45d4-ad10-9d0f5b6484a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:42.123134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 937/1858] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:42 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:42.134868 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6aef32-2703-4bde-869b-c121721dd238 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:42.136575 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7a6aef32-2703-4bde-869b-c121721dd238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:42.191098 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6aef32-2703-4bde-869b-c121721dd238 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:42.195547 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae8783-bb0d-4a40-9020-72398523b5f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:42.196187 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae8783-bb0d-4a40-9020-72398523b5f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:42.196473 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae8783-bb0d-4a40-9020-72398523b5f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:42.196786 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae8783-bb0d-4a40-9020-72398523b5f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:42.207098 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae8783-bb0d-4a40-9020-72398523b5f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:42.208540 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae8783-bb0d-4a40-9020-72398523b5f8 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:42.218542 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 922/1859] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:42 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:42.340985 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95583008-6402-45d4-ad10-9d0f5b6484a1 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:42.353688 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95583008-6402-45d4-ad10-9d0f5b6484a1 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:42.357500 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a641b9-8ca8-4b8b-989e-a8fc9c04a133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:42.358168 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a641b9-8ca8-4b8b-989e-a8fc9c04a133 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:42.358446 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a641b9-8ca8-4b8b-989e-a8fc9c04a133 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:42.358837 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a641b9-8ca8-4b8b-989e-a8fc9c04a133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:42.415166 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a641b9-8ca8-4b8b-989e-a8fc9c04a133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:42.416748 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a641b9-8ca8-4b8b-989e-a8fc9c04a133 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:42.428605 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 938/1860] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:46.043991 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae8783-bb0d-4a40-9020-72398523b5f8 service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:46.045476 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-daae8783-bb0d-4a40-9020-72398523b5f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:46.127170 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae8783-bb0d-4a40-9020-72398523b5f8 service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:46.134476 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0429c5-0803-4c13-94e4-80c5ab2e4146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:46.135511 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0429c5-0803-4c13-94e4-80c5ab2e4146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:46.136020 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0429c5-0803-4c13-94e4-80c5ab2e4146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:46.136517 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0429c5-0803-4c13-94e4-80c5ab2e4146 admin admin] PATH_INFO: `/v3/users/e9d8a94d2f05467f9d88d3e6edb9ae48` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:46.137972 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0429c5-0803-4c13-94e4-80c5ab2e4146 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9d8a94d2f05467f9d88d3e6edb9ae48)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:46.141227 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0429c5-0803-4c13-94e4-80c5ab2e4146 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:46.394109 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ec0429c5-0803-4c13-94e4-80c5ab2e4146 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9d8a94d2f05467f9d88d3e6edb9ae48'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:46.407886 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ec0429c5-0803-4c13-94e4-80c5ab2e4146 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9d8a94d2f05467f9d88d3e6edb9ae48'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:46.408746 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ec0429c5-0803-4c13-94e4-80c5ab2e4146 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9d8a94d2f05467f9d88d3e6edb9ae48'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:46.502707 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ec0429c5-0803-4c13-94e4-80c5ab2e4146 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9d8a94d2f05467f9d88d3e6edb9ae48'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:46.512501 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ec0429c5-0803-4c13-94e4-80c5ab2e4146 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9d8a94d2f05467f9d88d3e6edb9ae48'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:46.538480 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 923/1861] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:19:46 2022] DELETE /identity/v3/users/e9d8a94d2f05467f9d88d3e6edb9ae48 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:46.543030 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d78a0-ade5-4230-992d-fc63195f26f8 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:46.543563 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d78a0-ade5-4230-992d-fc63195f26f8 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:46.543563 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d78a0-ade5-4230-992d-fc63195f26f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:46.561846 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-f95d78a0-ade5-4230-992d-fc63195f26f8 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:46.563126 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f95d78a0-ade5-4230-992d-fc63195f26f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:46.641861 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 939/1862] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:46.652290 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0429c5-0803-4c13-94e4-80c5ab2e4146 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:46.653807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-ec0429c5-0803-4c13-94e4-80c5ab2e4146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:46.715497 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0429c5-0803-4c13-94e4-80c5ab2e4146 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:46.719233 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa712ca-9a82-41b1-a99e-f4ee48bcb2a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:46.719876 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa712ca-9a82-41b1-a99e-f4ee48bcb2a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:46.720160 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa712ca-9a82-41b1-a99e-f4ee48bcb2a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:46.720442 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa712ca-9a82-41b1-a99e-f4ee48bcb2a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:46.731252 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa712ca-9a82-41b1-a99e-f4ee48bcb2a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:46.733158 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa712ca-9a82-41b1-a99e-f4ee48bcb2a4 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:46.744394 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 924/1863] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:47.497600 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d78a0-ade5-4230-992d-fc63195f26f8 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:47.499411 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f95d78a0-ade5-4230-992d-fc63195f26f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:47.511558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d78a0-ade5-4230-992d-fc63195f26f8 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:47.523237 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd550b-bcbc-422e-b733-02a240e33b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:47.524118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd550b-bcbc-422e-b733-02a240e33b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:47.524403 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd550b-bcbc-422e-b733-02a240e33b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:47.524706 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd550b-bcbc-422e-b733-02a240e33b3b admin admin] PATH_INFO: `/v3/projects/43adb7932c31430982833e991f02d516` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:47.525922 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd550b-bcbc-422e-b733-02a240e33b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=43adb7932c31430982833e991f02d516)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:47.527885 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd550b-bcbc-422e-b733-02a240e33b3b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:47.652463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ecdd550b-bcbc-422e-b733-02a240e33b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43adb7932c31430982833e991f02d516', 'request_id': 'req-ecdd550b-bcbc-422e-b733-02a240e33b3b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:47.652463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ecdd550b-bcbc-422e-b733-02a240e33b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43adb7932c31430982833e991f02d516', 'request_id': 'req-ecdd550b-bcbc-422e-b733-02a240e33b3b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:47.659027 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ecdd550b-bcbc-422e-b733-02a240e33b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43adb7932c31430982833e991f02d516', 'request_id': 'req-ecdd550b-bcbc-422e-b733-02a240e33b3b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:47.752775 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ecdd550b-bcbc-422e-b733-02a240e33b3b admin admin] The token cache is being invalidate because project 43adb7932c31430982833e991f02d516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:19:47.753071 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ecdd550b-bcbc-422e-b733-02a240e33b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:47.756426 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ecdd550b-bcbc-422e-b733-02a240e33b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:47.756426 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 940/1864] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:19:47 2022] DELETE /identity/v3/projects/43adb7932c31430982833e991f02d516 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:47.759694 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa712ca-9a82-41b1-a99e-f4ee48bcb2a4 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:47.770029 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa712ca-9a82-41b1-a99e-f4ee48bcb2a4 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:47.841381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74bd9e7-ac2f-432f-86c9-3db9d8045781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:47.842423 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bd9e7-ac2f-432f-86c9-3db9d8045781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:47.842722 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bd9e7-ac2f-432f-86c9-3db9d8045781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:47.843024 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bd9e7-ac2f-432f-86c9-3db9d8045781 admin admin] PATH_INFO: `/v3/users/d64a11e7030a450fa5b34b321bb40155` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:47.846175 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74bd9e7-ac2f-432f-86c9-3db9d8045781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d64a11e7030a450fa5b34b321bb40155)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:47.848214 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74bd9e7-ac2f-432f-86c9-3db9d8045781 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:48.090384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b74bd9e7-ac2f-432f-86c9-3db9d8045781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd64a11e7030a450fa5b34b321bb40155'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:48.104326 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b74bd9e7-ac2f-432f-86c9-3db9d8045781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd64a11e7030a450fa5b34b321bb40155'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:48.105033 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b74bd9e7-ac2f-432f-86c9-3db9d8045781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd64a11e7030a450fa5b34b321bb40155'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:48.202144 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b74bd9e7-ac2f-432f-86c9-3db9d8045781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd64a11e7030a450fa5b34b321bb40155'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:48.203239 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b74bd9e7-ac2f-432f-86c9-3db9d8045781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd64a11e7030a450fa5b34b321bb40155'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:48.221488 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 925/1865] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:19:47 2022] DELETE /identity/v3/users/d64a11e7030a450fa5b34b321bb40155 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:48.729891 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd550b-bcbc-422e-b733-02a240e33b3b admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:48.731684 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-ecdd550b-bcbc-422e-b733-02a240e33b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:48.752967 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd550b-bcbc-422e-b733-02a240e33b3b admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:48.821551 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b31e42-3271-44a1-985a-3e2aea8157b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:48.823121 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b31e42-3271-44a1-985a-3e2aea8157b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:48.823451 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b31e42-3271-44a1-985a-3e2aea8157b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:48.823989 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b31e42-3271-44a1-985a-3e2aea8157b1 admin admin] PATH_INFO: `/v3/projects/a938ded42cd0407dbdbad77f1b296ece` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:48.825519 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b31e42-3271-44a1-985a-3e2aea8157b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a938ded42cd0407dbdbad77f1b296ece)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:48.827766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b31e42-3271-44a1-985a-3e2aea8157b1 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:48.893933 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74bd9e7-ac2f-432f-86c9-3db9d8045781 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:48.896929 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b74bd9e7-ac2f-432f-86c9-3db9d8045781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:48.911024 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74bd9e7-ac2f-432f-86c9-3db9d8045781 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:48.924724 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a3770-0b08-4b2f-a8e6-7e1a0c0ca2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:48.925778 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a3770-0b08-4b2f-a8e6-7e1a0c0ca2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:48.926060 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a3770-0b08-4b2f-a8e6-7e1a0c0ca2db admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:48.926626 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a3770-0b08-4b2f-a8e6-7e1a0c0ca2db admin admin] PATH_INFO: `/v3/users/ec1bcd3cba614b3b857ecaecafe507ff` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:48.927887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a3770-0b08-4b2f-a8e6-7e1a0c0ca2db admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec1bcd3cba614b3b857ecaecafe507ff)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:48.929928 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a3770-0b08-4b2f-a8e6-7e1a0c0ca2db admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:49.002418 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f7b31e42-3271-44a1-985a-3e2aea8157b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a938ded42cd0407dbdbad77f1b296ece', 'request_id': 'req-f7b31e42-3271-44a1-985a-3e2aea8157b1'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:49.011120 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f7b31e42-3271-44a1-985a-3e2aea8157b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a938ded42cd0407dbdbad77f1b296ece', 'request_id': 'req-f7b31e42-3271-44a1-985a-3e2aea8157b1'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:49.014801 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f7b31e42-3271-44a1-985a-3e2aea8157b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a938ded42cd0407dbdbad77f1b296ece', 'request_id': 'req-f7b31e42-3271-44a1-985a-3e2aea8157b1'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:49.117017 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f7b31e42-3271-44a1-985a-3e2aea8157b1 admin admin] The token cache is being invalidate because project a938ded42cd0407dbdbad77f1b296ece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:19:49.117327 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f7b31e42-3271-44a1-985a-3e2aea8157b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:49.118030 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f7b31e42-3271-44a1-985a-3e2aea8157b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:49.119615 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 941/1866] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:19:48 2022] DELETE /identity/v3/projects/a938ded42cd0407dbdbad77f1b296ece => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:49.123377 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b31e42-3271-44a1-985a-3e2aea8157b1 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:49.124727 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f7b31e42-3271-44a1-985a-3e2aea8157b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:49.155114 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-bd6a3770-0b08-4b2f-a8e6-7e1a0c0ca2db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec1bcd3cba614b3b857ecaecafe507ff'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:49.167621 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-bd6a3770-0b08-4b2f-a8e6-7e1a0c0ca2db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec1bcd3cba614b3b857ecaecafe507ff'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:49.168511 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-bd6a3770-0b08-4b2f-a8e6-7e1a0c0ca2db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec1bcd3cba614b3b857ecaecafe507ff'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:49.190396 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b31e42-3271-44a1-985a-3e2aea8157b1 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:49.196362 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54cea4-cd2e-4e2d-97e1-2d1848832502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:49.197286 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54cea4-cd2e-4e2d-97e1-2d1848832502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:49.197568 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54cea4-cd2e-4e2d-97e1-2d1848832502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:49.197847 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54cea4-cd2e-4e2d-97e1-2d1848832502 admin admin] PATH_INFO: `/v3/users/b60cf206cb2a40619bb4a4bfe11c177b` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:49.199097 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54cea4-cd2e-4e2d-97e1-2d1848832502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b60cf206cb2a40619bb4a4bfe11c177b)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:49.201083 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54cea4-cd2e-4e2d-97e1-2d1848832502 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:49.275426 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-bd6a3770-0b08-4b2f-a8e6-7e1a0c0ca2db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec1bcd3cba614b3b857ecaecafe507ff'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:49.276000 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-bd6a3770-0b08-4b2f-a8e6-7e1a0c0ca2db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec1bcd3cba614b3b857ecaecafe507ff'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:49.290176 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 926/1867] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:19:48 2022] DELETE /identity/v3/users/ec1bcd3cba614b3b857ecaecafe507ff => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:49.294430 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b577a3-cc34-4d6e-9ce5-4e30cc09d4a3 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:49.294717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b577a3-cc34-4d6e-9ce5-4e30cc09d4a3 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:49.294992 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b577a3-cc34-4d6e-9ce5-4e30cc09d4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:49.312729 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-90b577a3-cc34-4d6e-9ce5-4e30cc09d4a3 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:49.313929 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-90b577a3-cc34-4d6e-9ce5-4e30cc09d4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:49.377292 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 927/1868] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:19:49.387315 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b577a3-cc34-4d6e-9ce5-4e30cc09d4a3 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:49.388712 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-90b577a3-cc34-4d6e-9ce5-4e30cc09d4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:49.401183 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-8b54cea4-cd2e-4e2d-97e1-2d1848832502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b60cf206cb2a40619bb4a4bfe11c177b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:49.420117 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-8b54cea4-cd2e-4e2d-97e1-2d1848832502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b60cf206cb2a40619bb4a4bfe11c177b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:49.421174 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-8b54cea4-cd2e-4e2d-97e1-2d1848832502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b60cf206cb2a40619bb4a4bfe11c177b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:49.422039 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-8b54cea4-cd2e-4e2d-97e1-2d1848832502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b60cf206cb2a40619bb4a4bfe11c177b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:49.432161 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-8b54cea4-cd2e-4e2d-97e1-2d1848832502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b60cf206cb2a40619bb4a4bfe11c177b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:49.447486 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b577a3-cc34-4d6e-9ce5-4e30cc09d4a3 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:49.451211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2372e-7cb3-4114-883e-7c8a60735826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:49.451869 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2372e-7cb3-4114-883e-7c8a60735826 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:49.452154 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2372e-7cb3-4114-883e-7c8a60735826 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:49.452462 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2372e-7cb3-4114-883e-7c8a60735826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:49.454424 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-36e2372e-7cb3-4114-883e-7c8a60735826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:49.467234 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2372e-7cb3-4114-883e-7c8a60735826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:49.468877 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2372e-7cb3-4114-883e-7c8a60735826 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:49.481222 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 928/1869] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:49.526724 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 942/1870] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:19:49 2022] DELETE /identity/v3/users/b60cf206cb2a40619bb4a4bfe11c177b => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:50.374569 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2372e-7cb3-4114-883e-7c8a60735826 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:50.376633 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-36e2372e-7cb3-4114-883e-7c8a60735826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:50.398855 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2372e-7cb3-4114-883e-7c8a60735826 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:50.562545 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1d2ad-a4d9-4c02-9ecc-ea9226204b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:50.565820 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1d2ad-a4d9-4c02-9ecc-ea9226204b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:50.565820 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1d2ad-a4d9-4c02-9ecc-ea9226204b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:50.565820 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1d2ad-a4d9-4c02-9ecc-ea9226204b1a admin admin] PATH_INFO: `/v3/projects/bd56fea948b14eb89fd9e8b359528d35` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:50.565820 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1d2ad-a4d9-4c02-9ecc-ea9226204b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd56fea948b14eb89fd9e8b359528d35)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:50.567197 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1d2ad-a4d9-4c02-9ecc-ea9226204b1a admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:50.628526 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54cea4-cd2e-4e2d-97e1-2d1848832502 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:50.631439 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-8b54cea4-cd2e-4e2d-97e1-2d1848832502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:50.655549 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54cea4-cd2e-4e2d-97e1-2d1848832502 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:50.671288 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eacfbd-f2bc-4fe0-9bf4-1e5ca98b7e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:50.672171 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eacfbd-f2bc-4fe0-9bf4-1e5ca98b7e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:50.672453 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eacfbd-f2bc-4fe0-9bf4-1e5ca98b7e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:50.672762 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eacfbd-f2bc-4fe0-9bf4-1e5ca98b7e8b admin admin] PATH_INFO: `/v3/projects/d04ed3d28f1e4ed99b770c34e82f5165` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:50.673956 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eacfbd-f2bc-4fe0-9bf4-1e5ca98b7e8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d04ed3d28f1e4ed99b770c34e82f5165)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:50.676459 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eacfbd-f2bc-4fe0-9bf4-1e5ca98b7e8b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:50.702034 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-27e1d2ad-a4d9-4c02-9ecc-ea9226204b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd56fea948b14eb89fd9e8b359528d35', 'request_id': 'req-27e1d2ad-a4d9-4c02-9ecc-ea9226204b1a'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:50.815130 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-27e1d2ad-a4d9-4c02-9ecc-ea9226204b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd56fea948b14eb89fd9e8b359528d35', 'request_id': 'req-27e1d2ad-a4d9-4c02-9ecc-ea9226204b1a'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:50.822733 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-27e1d2ad-a4d9-4c02-9ecc-ea9226204b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd56fea948b14eb89fd9e8b359528d35', 'request_id': 'req-27e1d2ad-a4d9-4c02-9ecc-ea9226204b1a'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:50.835479 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-27e1d2ad-a4d9-4c02-9ecc-ea9226204b1a admin admin] The token cache is being invalidate because project bd56fea948b14eb89fd9e8b359528d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:19:50.835771 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-27e1d2ad-a4d9-4c02-9ecc-ea9226204b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:50.836472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-27e1d2ad-a4d9-4c02-9ecc-ea9226204b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:50.838096 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 929/1871] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:19:50 2022] DELETE /identity/v3/projects/bd56fea948b14eb89fd9e8b359528d35 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:50.842392 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1d2ad-a4d9-4c02-9ecc-ea9226204b1a admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:50.843894 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-27e1d2ad-a4d9-4c02-9ecc-ea9226204b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:50.886738 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-84eacfbd-f2bc-4fe0-9bf4-1e5ca98b7e8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd04ed3d28f1e4ed99b770c34e82f5165', 'request_id': 'req-84eacfbd-f2bc-4fe0-9bf4-1e5ca98b7e8b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:50.906349 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-84eacfbd-f2bc-4fe0-9bf4-1e5ca98b7e8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd04ed3d28f1e4ed99b770c34e82f5165', 'request_id': 'req-84eacfbd-f2bc-4fe0-9bf4-1e5ca98b7e8b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:50.914744 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-84eacfbd-f2bc-4fe0-9bf4-1e5ca98b7e8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd04ed3d28f1e4ed99b770c34e82f5165', 'request_id': 'req-84eacfbd-f2bc-4fe0-9bf4-1e5ca98b7e8b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:50.925261 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1d2ad-a4d9-4c02-9ecc-ea9226204b1a admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:51.010319 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972cefd-85c1-4ed7-81da-696b71423752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:51.013763 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972cefd-85c1-4ed7-81da-696b71423752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:51.013763 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972cefd-85c1-4ed7-81da-696b71423752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:51.013763 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972cefd-85c1-4ed7-81da-696b71423752 admin admin] PATH_INFO: `/v3/users/9240b73cb7ed439cbc61ae9b9f84c9cf` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:51.013763 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972cefd-85c1-4ed7-81da-696b71423752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9240b73cb7ed439cbc61ae9b9f84c9cf)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:51.017379 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972cefd-85c1-4ed7-81da-696b71423752 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:51.045051 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-84eacfbd-f2bc-4fe0-9bf4-1e5ca98b7e8b admin admin] The token cache is being invalidate because project d04ed3d28f1e4ed99b770c34e82f5165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:19:51.045694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-84eacfbd-f2bc-4fe0-9bf4-1e5ca98b7e8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:51.046590 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-84eacfbd-f2bc-4fe0-9bf4-1e5ca98b7e8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:51.049614 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 943/1872] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:19:50 2022] DELETE /identity/v3/projects/d04ed3d28f1e4ed99b770c34e82f5165 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:51.056023 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f778d-eb74-490c-a16f-512b6004b797 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:51.058690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f778d-eb74-490c-a16f-512b6004b797 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:51.058690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f778d-eb74-490c-a16f-512b6004b797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:51.082873 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-ef3f778d-eb74-490c-a16f-512b6004b797 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:51.085792 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-ef3f778d-eb74-490c-a16f-512b6004b797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:51.097723 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 944/1873] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:19:51.107182 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff705f-6299-4829-aecc-f42963afc0a2 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:51.107536 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff705f-6299-4829-aecc-f42963afc0a2 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:51.108615 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff705f-6299-4829-aecc-f42963afc0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:51.160691 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-79ff705f-6299-4829-aecc-f42963afc0a2 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:51.166865 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-79ff705f-6299-4829-aecc-f42963afc0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:51.195354 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 945/1874] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:19:51.199658 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff705f-6299-4829-aecc-f42963afc0a2 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:51.218535 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff705f-6299-4829-aecc-f42963afc0a2 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:51.230361 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0665d-c193-4c80-9d7f-9941c86df788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:51.230361 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0665d-c193-4c80-9d7f-9941c86df788 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:51.230361 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0665d-c193-4c80-9d7f-9941c86df788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:51.230361 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0665d-c193-4c80-9d7f-9941c86df788 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:51.230731 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0665d-c193-4c80-9d7f-9941c86df788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:19:51.230731 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0665d-c193-4c80-9d7f-9941c86df788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:51.232298 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0665d-c193-4c80-9d7f-9941c86df788 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:51.257361 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 946/1875] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:19:51.260194 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0665d-c193-4c80-9d7f-9941c86df788 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:51.275796 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0665d-c193-4c80-9d7f-9941c86df788 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:51.281686 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6af133-951b-487e-a21e-40065482af55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:51.282396 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6af133-951b-487e-a21e-40065482af55 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:51.282802 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6af133-951b-487e-a21e-40065482af55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:51.283148 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6af133-951b-487e-a21e-40065482af55 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:51.284060 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6af133-951b-487e-a21e-40065482af55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:51.286804 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6af133-951b-487e-a21e-40065482af55 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:51.404215 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b972cefd-85c1-4ed7-81da-696b71423752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9240b73cb7ed439cbc61ae9b9f84c9cf'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:51.419566 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b972cefd-85c1-4ed7-81da-696b71423752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9240b73cb7ed439cbc61ae9b9f84c9cf'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:51.420283 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b972cefd-85c1-4ed7-81da-696b71423752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9240b73cb7ed439cbc61ae9b9f84c9cf'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:51.452082 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 947/1876] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:51 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:19:51.455436 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6af133-951b-487e-a21e-40065482af55 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:51.457037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-5e6af133-951b-487e-a21e-40065482af55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:51.521695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6af133-951b-487e-a21e-40065482af55 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:51.523341 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b972cefd-85c1-4ed7-81da-696b71423752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9240b73cb7ed439cbc61ae9b9f84c9cf'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:51.525384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b972cefd-85c1-4ed7-81da-696b71423752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9240b73cb7ed439cbc61ae9b9f84c9cf'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:51.528851 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e037a-a109-45b6-a754-f27b2f0a4011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:51.529840 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e037a-a109-45b6-a754-f27b2f0a4011 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:51.530131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e037a-a109-45b6-a754-f27b2f0a4011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:51.530413 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e037a-a109-45b6-a754-f27b2f0a4011 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:51.531297 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e037a-a109-45b6-a754-f27b2f0a4011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:51.534009 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e037a-a109-45b6-a754-f27b2f0a4011 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:51.542889 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 930/1877] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:19:50 2022] DELETE /identity/v3/users/9240b73cb7ed439cbc61ae9b9f84c9cf => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:51.639387 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 948/1878] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:51 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:19:51.640715 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972cefd-85c1-4ed7-81da-696b71423752 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:51.701231 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972cefd-85c1-4ed7-81da-696b71423752 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:51.705882 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde07f22-510b-4f35-929d-7c559efed9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:51.706549 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde07f22-510b-4f35-929d-7c559efed9ab admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:51.706834 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde07f22-510b-4f35-929d-7c559efed9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:51.707110 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde07f22-510b-4f35-929d-7c559efed9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:51.707867 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde07f22-510b-4f35-929d-7c559efed9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:51.715453 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde07f22-510b-4f35-929d-7c559efed9ab admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:51.722904 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 931/1879] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:51.724294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e037a-a109-45b6-a754-f27b2f0a4011 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:51.735165 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e037a-a109-45b6-a754-f27b2f0a4011 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:51.740860 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13871a36-65ae-4ea1-8917-51b94cf3c6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:51.741573 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13871a36-65ae-4ea1-8917-51b94cf3c6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:51.741878 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13871a36-65ae-4ea1-8917-51b94cf3c6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:51.742828 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13871a36-65ae-4ea1-8917-51b94cf3c6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:51.743634 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13871a36-65ae-4ea1-8917-51b94cf3c6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:51.745631 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13871a36-65ae-4ea1-8917-51b94cf3c6b3 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:51.773775 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 949/1880] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:51.775238 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde07f22-510b-4f35-929d-7c559efed9ab admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:51.785337 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde07f22-510b-4f35-929d-7c559efed9ab admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:51.790825 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba5a97-4fb1-4685-87f9-a4ef3ea0e17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:51.791704 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba5a97-4fb1-4685-87f9-a4ef3ea0e17b admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:51.791985 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba5a97-4fb1-4685-87f9-a4ef3ea0e17b admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:51.792257 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba5a97-4fb1-4685-87f9-a4ef3ea0e17b admin admin] PATH_INFO: `/v3/projects/952a960f427c447fbf0d53fa1f750874/users/388cebe0a4524c44b7eaa08b75986100/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:51.808189 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba5a97-4fb1-4685-87f9-a4ef3ea0e17b admin admin] RBAC: Authorizing `identity:create_grant(project_id=952a960f427c447fbf0d53fa1f750874, user_id=388cebe0a4524c44b7eaa08b75986100, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:51.810901 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba5a97-4fb1-4685-87f9-a4ef3ea0e17b admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:51.918192 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 932/1881] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:51 2022] PUT /identity/v3/projects/952a960f427c447fbf0d53fa1f750874/users/388cebe0a4524c44b7eaa08b75986100/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:51.931316 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacf31a-418d-48f5-a0dc-cd213a295ecf None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:51.931316 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacf31a-418d-48f5-a0dc-cd213a295ecf None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:51.931606 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacf31a-418d-48f5-a0dc-cd213a295ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:51.957919 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-2dacf31a-418d-48f5-a0dc-cd213a295ecf None None] MFA Rules not processed for user `388cebe0a4524c44b7eaa08b75986100`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:51.959758 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-2dacf31a-418d-48f5-a0dc-cd213a295ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:52.016153 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba5a97-4fb1-4685-87f9-a4ef3ea0e17b admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:52.018976 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-0bba5a97-4fb1-4685-87f9-a4ef3ea0e17b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:52.023912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 950/1882] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:52.035504 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacf31a-418d-48f5-a0dc-cd213a295ecf None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:52.036979 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-2dacf31a-418d-48f5-a0dc-cd213a295ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:52.094388 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba5a97-4fb1-4685-87f9-a4ef3ea0e17b admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:52.096270 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacf31a-418d-48f5-a0dc-cd213a295ecf None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:52.100177 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9e629-efe0-45c3-a628-e29a8cae572c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:52.100995 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658961a2-cfa8-484b-92fe-28aac603be96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:52.101859 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658961a2-cfa8-484b-92fe-28aac603be96 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:52.101993 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9e629-efe0-45c3-a628-e29a8cae572c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:52.102171 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9e629-efe0-45c3-a628-e29a8cae572c admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:52.102281 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658961a2-cfa8-484b-92fe-28aac603be96 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:52.102442 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658961a2-cfa8-484b-92fe-28aac603be96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:52.102548 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9e629-efe0-45c3-a628-e29a8cae572c admin admin] PATH_INFO: `/v3/projects/8faea864633d40b580b987c697f54f85` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:52.103965 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9e629-efe0-45c3-a628-e29a8cae572c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8faea864633d40b580b987c697f54f85)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:52.105963 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9e629-efe0-45c3-a628-e29a8cae572c admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:52.112615 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658961a2-cfa8-484b-92fe-28aac603be96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:52.117097 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658961a2-cfa8-484b-92fe-28aac603be96 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:52.125575 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 951/1883] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:52.145237 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658961a2-cfa8-484b-92fe-28aac603be96 service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:52.155886 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658961a2-cfa8-484b-92fe-28aac603be96 service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:52.160538 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cef71-ef28-4387-9c8b-add69b2b9029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:52.163059 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cef71-ef28-4387-9c8b-add69b2b9029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:52.163395 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cef71-ef28-4387-9c8b-add69b2b9029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:52.163674 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cef71-ef28-4387-9c8b-add69b2b9029 admin admin] PATH_INFO: `/v3/users/388cebe0a4524c44b7eaa08b75986100` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:52.164997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479cef71-ef28-4387-9c8b-add69b2b9029 admin admin] RBAC: Authorizing `identity:delete_user(user_id=388cebe0a4524c44b7eaa08b75986100)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:52.166962 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479cef71-ef28-4387-9c8b-add69b2b9029 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:52.252020 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7eb9e629-efe0-45c3-a628-e29a8cae572c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8faea864633d40b580b987c697f54f85', 'request_id': 'req-7eb9e629-efe0-45c3-a628-e29a8cae572c'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:52.385824 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7eb9e629-efe0-45c3-a628-e29a8cae572c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8faea864633d40b580b987c697f54f85', 'request_id': 'req-7eb9e629-efe0-45c3-a628-e29a8cae572c'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:52.392872 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7eb9e629-efe0-45c3-a628-e29a8cae572c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8faea864633d40b580b987c697f54f85', 'request_id': 'req-7eb9e629-efe0-45c3-a628-e29a8cae572c'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:52.405060 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7eb9e629-efe0-45c3-a628-e29a8cae572c admin admin] The token cache is being invalidate because project 8faea864633d40b580b987c697f54f85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:19:52.405706 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7eb9e629-efe0-45c3-a628-e29a8cae572c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:52.406117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7eb9e629-efe0-45c3-a628-e29a8cae572c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:52.407805 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 933/1884] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:19:52 2022] DELETE /identity/v3/projects/8faea864633d40b580b987c697f54f85 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:52.413880 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d6cd3-6c99-4889-b138-f4deb3f15cba None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:52.415179 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d6cd3-6c99-4889-b138-f4deb3f15cba None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:52.417022 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d6cd3-6c99-4889-b138-f4deb3f15cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:52.436385 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-479cef71-ef28-4387-9c8b-add69b2b9029 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '388cebe0a4524c44b7eaa08b75986100'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:52.468438 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-9d1d6cd3-6c99-4889-b138-f4deb3f15cba None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:52.468550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-479cef71-ef28-4387-9c8b-add69b2b9029 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '388cebe0a4524c44b7eaa08b75986100'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:52.468626 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-9d1d6cd3-6c99-4889-b138-f4deb3f15cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:52.468723 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-479cef71-ef28-4387-9c8b-add69b2b9029 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '388cebe0a4524c44b7eaa08b75986100'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:52.468723 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-479cef71-ef28-4387-9c8b-add69b2b9029 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '388cebe0a4524c44b7eaa08b75986100'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:52.472043 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-479cef71-ef28-4387-9c8b-add69b2b9029 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '388cebe0a4524c44b7eaa08b75986100'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:52.527564 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 934/1885] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:19:52.537389 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff073a33-7866-4e34-9976-a1a7c19fbcb7 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:52.537697 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff073a33-7866-4e34-9976-a1a7c19fbcb7 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:52.538018 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff073a33-7866-4e34-9976-a1a7c19fbcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:52.555964 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-ff073a33-7866-4e34-9976-a1a7c19fbcb7 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:52.557219 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-ff073a33-7866-4e34-9976-a1a7c19fbcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:52.565489 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 935/1886] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:19:52.569950 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff073a33-7866-4e34-9976-a1a7c19fbcb7 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:52.579228 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff073a33-7866-4e34-9976-a1a7c19fbcb7 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:52.584512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f8cc7-7e05-4343-917e-104ea049748e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:52.585205 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f8cc7-7e05-4343-917e-104ea049748e admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:52.585481 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f8cc7-7e05-4343-917e-104ea049748e admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:52.585751 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f8cc7-7e05-4343-917e-104ea049748e admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:52.586465 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f8cc7-7e05-4343-917e-104ea049748e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:19:52.586768 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f8cc7-7e05-4343-917e-104ea049748e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:52.588378 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f8cc7-7e05-4343-917e-104ea049748e admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:52.600399 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 936/1887] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:19:52.605031 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f8cc7-7e05-4343-917e-104ea049748e admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:52.613077 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 952/1888] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:19:52 2022] DELETE /identity/v3/users/388cebe0a4524c44b7eaa08b75986100 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:52.619008 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f8cc7-7e05-4343-917e-104ea049748e admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:52.622629 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ef76b-056e-49d3-b679-b7030aadcd69 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:52.623195 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ef76b-056e-49d3-b679-b7030aadcd69 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:52.623483 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ef76b-056e-49d3-b679-b7030aadcd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:52.676384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-726ef76b-056e-49d3-b679-b7030aadcd69 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:52.676384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-726ef76b-056e-49d3-b679-b7030aadcd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:52.728089 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed6c72-a41d-433d-b458-031c623ee6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:52.729052 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed6c72-a41d-433d-b458-031c623ee6bb admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:52.729341 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed6c72-a41d-433d-b458-031c623ee6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:52.729621 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed6c72-a41d-433d-b458-031c623ee6bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:52.730302 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed6c72-a41d-433d-b458-031c623ee6bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:52.732213 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed6c72-a41d-433d-b458-031c623ee6bb admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:52.754815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 953/1889] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:52.764944 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ef76b-056e-49d3-b679-b7030aadcd69 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:52.766361 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-726ef76b-056e-49d3-b679-b7030aadcd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:52.823952 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ef76b-056e-49d3-b679-b7030aadcd69 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:52.827605 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e9242-adfc-4991-8863-b822b79d458d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:52.828252 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e9242-adfc-4991-8863-b822b79d458d service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:52.828532 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e9242-adfc-4991-8863-b822b79d458d service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:52.828841 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e9242-adfc-4991-8863-b822b79d458d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:52.838688 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e9242-adfc-4991-8863-b822b79d458d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:52.840194 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e9242-adfc-4991-8863-b822b79d458d service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:52.850741 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 954/1890] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:19:52.873601 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 937/1891] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:52 2022] POST /identity/v3/projects => generated 391 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:19:52.874990 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e9242-adfc-4991-8863-b822b79d458d service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:52.900780 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e9242-adfc-4991-8863-b822b79d458d service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:53.008246 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c94bfb-abbf-4eda-a392-a5550749f3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:53.008974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c94bfb-abbf-4eda-a392-a5550749f3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:53.009257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c94bfb-abbf-4eda-a392-a5550749f3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:53.009530 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c94bfb-abbf-4eda-a392-a5550749f3b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:53.010217 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c94bfb-abbf-4eda-a392-a5550749f3b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:53.012186 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c94bfb-abbf-4eda-a392-a5550749f3b7 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:53.166357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 955/1892] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:52 2022] POST /identity/v3/users => generated 296 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:53.171953 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed6c72-a41d-433d-b458-031c623ee6bb admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:53.187274 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed6c72-a41d-433d-b458-031c623ee6bb admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:53.193780 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640f1e5-c849-4973-9996-5d4d23c6bfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:53.196327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640f1e5-c849-4973-9996-5d4d23c6bfb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:53.196327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640f1e5-c849-4973-9996-5d4d23c6bfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:53.196327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640f1e5-c849-4973-9996-5d4d23c6bfb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:53.196327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640f1e5-c849-4973-9996-5d4d23c6bfb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:53.200308 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640f1e5-c849-4973-9996-5d4d23c6bfb0 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:53.215219 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 938/1893] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:53.216376 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c94bfb-abbf-4eda-a392-a5550749f3b7 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:53.231044 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c94bfb-abbf-4eda-a392-a5550749f3b7 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:53.235948 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a207d40-6a96-4b4f-a3f0-b6aaef4c2a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:53.236756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207d40-6a96-4b4f-a3f0-b6aaef4c2a39 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:53.237045 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207d40-6a96-4b4f-a3f0-b6aaef4c2a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:53.237326 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207d40-6a96-4b4f-a3f0-b6aaef4c2a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:53.238113 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a207d40-6a96-4b4f-a3f0-b6aaef4c2a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:53.239994 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a207d40-6a96-4b4f-a3f0-b6aaef4c2a39 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:53.252177 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 956/1894] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:19:53.257146 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640f1e5-c849-4973-9996-5d4d23c6bfb0 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:53.269663 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640f1e5-c849-4973-9996-5d4d23c6bfb0 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:53.276329 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421100a-7046-415d-a1fb-83b299101d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:53.277361 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421100a-7046-415d-a1fb-83b299101d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:53.277589 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421100a-7046-415d-a1fb-83b299101d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:53.277895 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421100a-7046-415d-a1fb-83b299101d06 admin admin] PATH_INFO: `/v3/projects/80454f415e0f4c1b83fc17b59fc9ba0f/users/09105bf8f4a74cddb15ab83152f13885/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:53.308212 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421100a-7046-415d-a1fb-83b299101d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80454f415e0f4c1b83fc17b59fc9ba0f, user_id=09105bf8f4a74cddb15ab83152f13885, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:53.313968 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a207d40-6a96-4b4f-a3f0-b6aaef4c2a39 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:53.315574 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421100a-7046-415d-a1fb-83b299101d06 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:53.316775 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0a207d40-6a96-4b4f-a3f0-b6aaef4c2a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:53.340057 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a207d40-6a96-4b4f-a3f0-b6aaef4c2a39 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:53.347857 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a617fca-57f3-4018-a16b-a52f5604c3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:53.351548 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a617fca-57f3-4018-a16b-a52f5604c3df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:53.352881 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a617fca-57f3-4018-a16b-a52f5604c3df admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:53.353710 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a617fca-57f3-4018-a16b-a52f5604c3df admin admin] PATH_INFO: `/v3/users/4901aabf611b49d39f9f703aec10a6c6` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:53.361788 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a617fca-57f3-4018-a16b-a52f5604c3df admin admin] RBAC: Authorizing `identity:delete_user(user_id=4901aabf611b49d39f9f703aec10a6c6)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:53.367823 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a617fca-57f3-4018-a16b-a52f5604c3df admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:53.423177 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 939/1895] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:53 2022] PUT /identity/v3/projects/80454f415e0f4c1b83fc17b59fc9ba0f/users/09105bf8f4a74cddb15ab83152f13885/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:53.424886 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421100a-7046-415d-a1fb-83b299101d06 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:53.425938 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6421100a-7046-415d-a1fb-83b299101d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:53.512757 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421100a-7046-415d-a1fb-83b299101d06 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:53.523024 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac8e5d-7778-43f6-af78-512d2cd8be3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:53.523901 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac8e5d-7778-43f6-af78-512d2cd8be3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:53.524186 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac8e5d-7778-43f6-af78-512d2cd8be3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:53.524465 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac8e5d-7778-43f6-af78-512d2cd8be3a admin admin] PATH_INFO: `/v3/projects/952a960f427c447fbf0d53fa1f750874` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:53.526213 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac8e5d-7778-43f6-af78-512d2cd8be3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=952a960f427c447fbf0d53fa1f750874)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:53.528158 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac8e5d-7778-43f6-af78-512d2cd8be3a admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:53.683013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3a617fca-57f3-4018-a16b-a52f5604c3df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4901aabf611b49d39f9f703aec10a6c6'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:53.687683 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-33ac8e5d-7778-43f6-af78-512d2cd8be3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '952a960f427c447fbf0d53fa1f750874', 'request_id': 'req-33ac8e5d-7778-43f6-af78-512d2cd8be3a'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:53.696558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3a617fca-57f3-4018-a16b-a52f5604c3df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4901aabf611b49d39f9f703aec10a6c6'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:53.697422 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3a617fca-57f3-4018-a16b-a52f5604c3df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4901aabf611b49d39f9f703aec10a6c6'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:53.698024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3a617fca-57f3-4018-a16b-a52f5604c3df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4901aabf611b49d39f9f703aec10a6c6'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:53.705286 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3a617fca-57f3-4018-a16b-a52f5604c3df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4901aabf611b49d39f9f703aec10a6c6'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:53.791691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-33ac8e5d-7778-43f6-af78-512d2cd8be3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '952a960f427c447fbf0d53fa1f750874', 'request_id': 'req-33ac8e5d-7778-43f6-af78-512d2cd8be3a'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:53.798542 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-33ac8e5d-7778-43f6-af78-512d2cd8be3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '952a960f427c447fbf0d53fa1f750874', 'request_id': 'req-33ac8e5d-7778-43f6-af78-512d2cd8be3a'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:53.810533 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-33ac8e5d-7778-43f6-af78-512d2cd8be3a admin admin] The token cache is being invalidate because project 952a960f427c447fbf0d53fa1f750874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:19:53.810826 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-33ac8e5d-7778-43f6-af78-512d2cd8be3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:53.811493 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-33ac8e5d-7778-43f6-af78-512d2cd8be3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:53.813425 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 940/1896] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:19:53 2022] DELETE /identity/v3/projects/952a960f427c447fbf0d53fa1f750874 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:53.814505 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fece5-3528-4c60-ab0d-2239d0c19e28 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:53.814782 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fece5-3528-4c60-ab0d-2239d0c19e28 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:53.815072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fece5-3528-4c60-ab0d-2239d0c19e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:53.841531 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-c02fece5-3528-4c60-ab0d-2239d0c19e28 None None] MFA Rules not processed for user `09105bf8f4a74cddb15ab83152f13885`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:53.842753 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c02fece5-3528-4c60-ab0d-2239d0c19e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:53.906068 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 941/1897] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:53.907309 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15214b2d-08a0-4516-b2e7-46e124e989a5 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:53.907598 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15214b2d-08a0-4516-b2e7-46e124e989a5 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:53.907871 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15214b2d-08a0-4516-b2e7-46e124e989a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:53.927657 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-15214b2d-08a0-4516-b2e7-46e124e989a5 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:53.929129 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-15214b2d-08a0-4516-b2e7-46e124e989a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:53.938329 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 957/1898] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:19:53 2022] DELETE /identity/v3/users/4901aabf611b49d39f9f703aec10a6c6 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:53.939256 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a617fca-57f3-4018-a16b-a52f5604c3df admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:53.940845 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-3a617fca-57f3-4018-a16b-a52f5604c3df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:54.004175 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 942/1899] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:54.007365 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb350e-e99d-4940-b6f0-6ecdbf34c5fb None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:54.007661 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb350e-e99d-4940-b6f0-6ecdbf34c5fb None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:54.007942 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb350e-e99d-4940-b6f0-6ecdbf34c5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:54.016678 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a617fca-57f3-4018-a16b-a52f5604c3df admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:54.024107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e29b22-eb23-46ef-9fed-a8d76f600404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:54.024934 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e29b22-eb23-46ef-9fed-a8d76f600404 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:54.025284 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e29b22-eb23-46ef-9fed-a8d76f600404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:54.025679 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e29b22-eb23-46ef-9fed-a8d76f600404 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:54.026390 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e29b22-eb23-46ef-9fed-a8d76f600404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:54.028758 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e29b22-eb23-46ef-9fed-a8d76f600404 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:54.031507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-47fb350e-e99d-4940-b6f0-6ecdbf34c5fb None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:54.032814 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-47fb350e-e99d-4940-b6f0-6ecdbf34c5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:54.041735 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 943/1900] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:54.043020 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8b10e-1d0c-44b7-8537-210a490c0e12 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:54.043311 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8b10e-1d0c-44b7-8537-210a490c0e12 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:54.043624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8b10e-1d0c-44b7-8537-210a490c0e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:54.063928 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-b0d8b10e-1d0c-44b7-8537-210a490c0e12 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:54.065260 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b0d8b10e-1d0c-44b7-8537-210a490c0e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:54.074009 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 944/1901] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:54.075052 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8b10e-1d0c-44b7-8537-210a490c0e12 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:54.075911 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b0d8b10e-1d0c-44b7-8537-210a490c0e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:54.130069 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 958/1902] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:53 2022] POST /identity/v3/projects => generated 389 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:54.131347 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e29b22-eb23-46ef-9fed-a8d76f600404 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:54.132941 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8b10e-1d0c-44b7-8537-210a490c0e12 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:54.183172 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a7412-a06b-4017-b6e1-7fd5d886e7cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:54.183825 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a7412-a06b-4017-b6e1-7fd5d886e7cc service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:54.184117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a7412-a06b-4017-b6e1-7fd5d886e7cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:54.184400 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a7412-a06b-4017-b6e1-7fd5d886e7cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:54.204202 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e29b22-eb23-46ef-9fed-a8d76f600404 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:54.209988 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb26c0-0563-4746-97de-8b818d062ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:54.210653 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb26c0-0563-4746-97de-8b818d062ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:54.210940 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb26c0-0563-4746-97de-8b818d062ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:54.211219 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb26c0-0563-4746-97de-8b818d062ea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:54.211945 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb26c0-0563-4746-97de-8b818d062ea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:19:54.212254 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb26c0-0563-4746-97de-8b818d062ea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:54.213912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb26c0-0563-4746-97de-8b818d062ea1 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:54.229426 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 959/1903] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:19:54.229426 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb26c0-0563-4746-97de-8b818d062ea1 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:54.229426 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-11bb26c0-0563-4746-97de-8b818d062ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:54.241831 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb26c0-0563-4746-97de-8b818d062ea1 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:54.246625 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdf493-86eb-4efb-bed2-77c3b09fb862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:54.247343 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdf493-86eb-4efb-bed2-77c3b09fb862 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:54.247650 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdf493-86eb-4efb-bed2-77c3b09fb862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:54.247946 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdf493-86eb-4efb-bed2-77c3b09fb862 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:54.248637 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecdf493-86eb-4efb-bed2-77c3b09fb862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:54.250620 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecdf493-86eb-4efb-bed2-77c3b09fb862 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:54.254840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a7412-a06b-4017-b6e1-7fd5d886e7cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:54.257265 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a7412-a06b-4017-b6e1-7fd5d886e7cc service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:54.267201 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 945/1904] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:54.269837 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a7412-a06b-4017-b6e1-7fd5d886e7cc service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:54.278229 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a7412-a06b-4017-b6e1-7fd5d886e7cc service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:54.283122 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169f28e-38b1-40a3-9ec0-bdc602f86608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:54.283775 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169f28e-38b1-40a3-9ec0-bdc602f86608 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:54.284056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169f28e-38b1-40a3-9ec0-bdc602f86608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:54.284360 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169f28e-38b1-40a3-9ec0-bdc602f86608 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:54.285096 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169f28e-38b1-40a3-9ec0-bdc602f86608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:54.287129 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169f28e-38b1-40a3-9ec0-bdc602f86608 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:54.358087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 960/1905] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:54 2022] POST /identity/v3/users => generated 301 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:54.362041 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdf493-86eb-4efb-bed2-77c3b09fb862 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:54.371684 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdf493-86eb-4efb-bed2-77c3b09fb862 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:54.376318 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08b86a-76ff-4138-a6f7-1f080baac693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:54.376995 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b86a-76ff-4138-a6f7-1f080baac693 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:54.377270 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b86a-76ff-4138-a6f7-1f080baac693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:54.377539 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b86a-76ff-4138-a6f7-1f080baac693 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:54.378257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08b86a-76ff-4138-a6f7-1f080baac693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:54.379974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08b86a-76ff-4138-a6f7-1f080baac693 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:54.390205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 961/1906] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:19:54.394162 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08b86a-76ff-4138-a6f7-1f080baac693 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:54.405133 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08b86a-76ff-4138-a6f7-1f080baac693 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:54.405263 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 946/1907] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:54 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:54.409030 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169f28e-38b1-40a3-9ec0-bdc602f86608 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:54.524307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdced7aa-c9e1-4d79-9725-f14e75581ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:54.527844 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdced7aa-c9e1-4d79-9725-f14e75581ff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:54.527844 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdced7aa-c9e1-4d79-9725-f14e75581ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:54.527844 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdced7aa-c9e1-4d79-9725-f14e75581ff4 admin admin] PATH_INFO: `/v3/projects/ec551366a8f14b91925ff24c15c66ab0/users/af18695d03c7447aba2c0def016a2147/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:54.558638 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169f28e-38b1-40a3-9ec0-bdc602f86608 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:54.564240 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99550b-7e14-42b8-b4e6-dbc09f4baa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:54.564852 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99550b-7e14-42b8-b4e6-dbc09f4baa92 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:54.565170 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99550b-7e14-42b8-b4e6-dbc09f4baa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:54.565457 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99550b-7e14-42b8-b4e6-dbc09f4baa92 admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:54.566168 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99550b-7e14-42b8-b4e6-dbc09f4baa92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:54.568901 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99550b-7e14-42b8-b4e6-dbc09f4baa92 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:54.569475 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdced7aa-c9e1-4d79-9725-f14e75581ff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec551366a8f14b91925ff24c15c66ab0, user_id=af18695d03c7447aba2c0def016a2147, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:54.573892 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdced7aa-c9e1-4d79-9725-f14e75581ff4 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:54.716222 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 962/1908] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:54 2022] PUT /identity/v3/projects/ec551366a8f14b91925ff24c15c66ab0/users/af18695d03c7447aba2c0def016a2147/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:54.716222 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdced7aa-c9e1-4d79-9725-f14e75581ff4 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:54.751556 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 947/1909] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:54 2022] POST /identity/v3/users => generated 289 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:54.761058 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99550b-7e14-42b8-b4e6-dbc09f4baa92 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:54.778181 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99550b-7e14-42b8-b4e6-dbc09f4baa92 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:54.856474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdced7aa-c9e1-4d79-9725-f14e75581ff4 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:54.856474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fa674-d81d-4e72-bf12-f5e7f2ca2905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:54.856474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fa674-d81d-4e72-bf12-f5e7f2ca2905 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:54.856474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fa674-d81d-4e72-bf12-f5e7f2ca2905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:54.856938 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fa674-d81d-4e72-bf12-f5e7f2ca2905 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:54.856938 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fa674-d81d-4e72-bf12-f5e7f2ca2905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:54.856938 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fa674-d81d-4e72-bf12-f5e7f2ca2905 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:54.862190 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 963/1910] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:54.863287 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fa674-d81d-4e72-bf12-f5e7f2ca2905 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:54.863926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458eedc1-7b78-4100-ad84-2046dbd0d807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:54.866133 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eedc1-7b78-4100-ad84-2046dbd0d807 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:54.867879 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eedc1-7b78-4100-ad84-2046dbd0d807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:54.868096 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eedc1-7b78-4100-ad84-2046dbd0d807 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:54.868931 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458eedc1-7b78-4100-ad84-2046dbd0d807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:54.871362 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458eedc1-7b78-4100-ad84-2046dbd0d807 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:54.887204 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fa674-d81d-4e72-bf12-f5e7f2ca2905 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:54.894614 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 948/1911] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:54.899897 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458eedc1-7b78-4100-ad84-2046dbd0d807 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:54.903595 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebdb2f-b6ff-489d-963a-f4962e2c97d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:54.904601 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebdb2f-b6ff-489d-963a-f4962e2c97d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:54.905883 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebdb2f-b6ff-489d-963a-f4962e2c97d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:54.906173 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebdb2f-b6ff-489d-963a-f4962e2c97d9 admin admin] PATH_INFO: `/v3/projects/ec551366a8f14b91925ff24c15c66ab0/users/af18695d03c7447aba2c0def016a2147/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:54.910786 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebdb2f-b6ff-489d-963a-f4962e2c97d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec551366a8f14b91925ff24c15c66ab0, user_id=af18695d03c7447aba2c0def016a2147, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:54.918198 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebdb2f-b6ff-489d-963a-f4962e2c97d9 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:54.928381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458eedc1-7b78-4100-ad84-2046dbd0d807 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:54.943546 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 964/1912] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:54 2022] PUT /identity/v3/projects/ec551366a8f14b91925ff24c15c66ab0/users/af18695d03c7447aba2c0def016a2147/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:54.947355 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5ebf7-2c95-4a1b-bd15-24e63bc43e6b None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:54.951094 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5ebf7-2c95-4a1b-bd15-24e63bc43e6b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:54.952756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5ebf7-2c95-4a1b-bd15-24e63bc43e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:55.043996 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-bca5ebf7-2c95-4a1b-bd15-24e63bc43e6b None None] MFA Rules not processed for user `af18695d03c7447aba2c0def016a2147`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:55.045699 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-bca5ebf7-2c95-4a1b-bd15-24e63bc43e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:55.049983 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3711fb6-e0b9-4ead-b70f-fe73a6f6c3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:55.050927 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3711fb6-e0b9-4ead-b70f-fe73a6f6c3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:55.051400 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3711fb6-e0b9-4ead-b70f-fe73a6f6c3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:55.052037 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3711fb6-e0b9-4ead-b70f-fe73a6f6c3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:55.053633 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3711fb6-e0b9-4ead-b70f-fe73a6f6c3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:55.055347 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3711fb6-e0b9-4ead-b70f-fe73a6f6c3f8 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:55.088037 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 949/1913] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:55.093616 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3711fb6-e0b9-4ead-b70f-fe73a6f6c3f8 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:55.148690 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3711fb6-e0b9-4ead-b70f-fe73a6f6c3f8 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:55.163227 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a66544-847d-4fbd-9a2c-585c26d0bfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:55.164995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a66544-847d-4fbd-9a2c-585c26d0bfb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:55.165194 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a66544-847d-4fbd-9a2c-585c26d0bfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:55.165646 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a66544-847d-4fbd-9a2c-585c26d0bfb6 admin admin] PATH_INFO: `/v3/projects/8ea74095e4554caf8bacf9364f72eb90/users/d1bbab80576c4e12948e6ef7fb8327b8/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:55.199045 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a66544-847d-4fbd-9a2c-585c26d0bfb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea74095e4554caf8bacf9364f72eb90, user_id=d1bbab80576c4e12948e6ef7fb8327b8, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:55.201940 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a66544-847d-4fbd-9a2c-585c26d0bfb6 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:55.213477 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 965/1914] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:55.214745 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5ebf7-2c95-4a1b-bd15-24e63bc43e6b None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:55.218665 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-bca5ebf7-2c95-4a1b-bd15-24e63bc43e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:55.232386 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5ebf7-2c95-4a1b-bd15-24e63bc43e6b None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:55.239236 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ff476-86aa-4678-acd8-7591a5eed158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:55.240999 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ff476-86aa-4678-acd8-7591a5eed158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:55.241398 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ff476-86aa-4678-acd8-7591a5eed158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:55.241561 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ff476-86aa-4678-acd8-7591a5eed158 admin admin] PATH_INFO: `/v3/projects/f4cf8ff336b94998b2a2cff8031fa54b` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:55.242978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ff476-86aa-4678-acd8-7591a5eed158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4cf8ff336b94998b2a2cff8031fa54b)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:55.245220 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ff476-86aa-4678-acd8-7591a5eed158 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:55.303355 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 950/1915] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:55 2022] PUT /identity/v3/projects/8ea74095e4554caf8bacf9364f72eb90/users/d1bbab80576c4e12948e6ef7fb8327b8/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:55.309730 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a66544-847d-4fbd-9a2c-585c26d0bfb6 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:55.313922 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-81a66544-847d-4fbd-9a2c-585c26d0bfb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:55.385708 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a66544-847d-4fbd-9a2c-585c26d0bfb6 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:55.389415 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abed18-cfe1-4b8e-b226-b000ef66f5ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:55.390253 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abed18-cfe1-4b8e-b226-b000ef66f5ab service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:55.390546 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abed18-cfe1-4b8e-b226-b000ef66f5ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:55.390825 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abed18-cfe1-4b8e-b226-b000ef66f5ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:55.417933 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9b3ff476-86aa-4678-acd8-7591a5eed158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4cf8ff336b94998b2a2cff8031fa54b', 'request_id': 'req-9b3ff476-86aa-4678-acd8-7591a5eed158'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:55.425030 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9b3ff476-86aa-4678-acd8-7591a5eed158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4cf8ff336b94998b2a2cff8031fa54b', 'request_id': 'req-9b3ff476-86aa-4678-acd8-7591a5eed158'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:55.438129 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9b3ff476-86aa-4678-acd8-7591a5eed158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4cf8ff336b94998b2a2cff8031fa54b', 'request_id': 'req-9b3ff476-86aa-4678-acd8-7591a5eed158'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:55.476065 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abed18-cfe1-4b8e-b226-b000ef66f5ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:55.478433 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abed18-cfe1-4b8e-b226-b000ef66f5ab service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:55.488873 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 951/1916] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:55.490851 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875a391-e069-401c-a985-7570228aa78a None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:55.491152 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875a391-e069-401c-a985-7570228aa78a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:55.491619 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875a391-e069-401c-a985-7570228aa78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:55.522852 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-f875a391-e069-401c-a985-7570228aa78a None None] MFA Rules not processed for user `d1bbab80576c4e12948e6ef7fb8327b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:55.524135 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f875a391-e069-401c-a985-7570228aa78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:55.584337 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9b3ff476-86aa-4678-acd8-7591a5eed158 admin admin] The token cache is being invalidate because project f4cf8ff336b94998b2a2cff8031fa54b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:19:55.584853 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9b3ff476-86aa-4678-acd8-7591a5eed158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:55.585543 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9b3ff476-86aa-4678-acd8-7591a5eed158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:55.587160 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 966/1917] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:19:55 2022] DELETE /identity/v3/projects/f4cf8ff336b94998b2a2cff8031fa54b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:55.587962 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ff476-86aa-4678-acd8-7591a5eed158 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:55.589298 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9b3ff476-86aa-4678-acd8-7591a5eed158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:55.619076 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 952/1918] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:55.619076 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875a391-e069-401c-a985-7570228aa78a None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:55.619076 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f875a391-e069-401c-a985-7570228aa78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:55.656245 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ff476-86aa-4678-acd8-7591a5eed158 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:55.660393 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21edd48-3898-4261-b091-879a35e9ce32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:55.662127 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21edd48-3898-4261-b091-879a35e9ce32 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:55.662413 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21edd48-3898-4261-b091-879a35e9ce32 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:55.662815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21edd48-3898-4261-b091-879a35e9ce32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:55.665001 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-c21edd48-3898-4261-b091-879a35e9ce32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:55.707472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875a391-e069-401c-a985-7570228aa78a None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:55.712362 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9055604-8342-4194-a346-4b89769969fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:55.713430 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055604-8342-4194-a346-4b89769969fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:55.713728 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055604-8342-4194-a346-4b89769969fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:55.714002 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055604-8342-4194-a346-4b89769969fa admin admin] PATH_INFO: `/v3/users/0522ed7e46f44923a47f5e0e6cd8a03d` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:55.715249 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9055604-8342-4194-a346-4b89769969fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0522ed7e46f44923a47f5e0e6cd8a03d)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:55.717308 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9055604-8342-4194-a346-4b89769969fa admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:55.736485 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21edd48-3898-4261-b091-879a35e9ce32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:55.736485 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21edd48-3898-4261-b091-879a35e9ce32 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:55.740920 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 967/1919] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:55.742044 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21edd48-3898-4261-b091-879a35e9ce32 service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:55.743695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-c21edd48-3898-4261-b091-879a35e9ce32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:55.758228 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21edd48-3898-4261-b091-879a35e9ce32 service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:55.766199 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95992bdc-f0a0-4efc-8fd0-3308e977fe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:55.766870 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95992bdc-f0a0-4efc-8fd0-3308e977fe46 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:55.767155 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95992bdc-f0a0-4efc-8fd0-3308e977fe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:55.767431 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95992bdc-f0a0-4efc-8fd0-3308e977fe46 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:55.768131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95992bdc-f0a0-4efc-8fd0-3308e977fe46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:55.770307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95992bdc-f0a0-4efc-8fd0-3308e977fe46 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:55.982607 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 968/1920] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:55 2022] POST /identity/v3/projects => generated 375 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:55.986566 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95992bdc-f0a0-4efc-8fd0-3308e977fe46 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:56.055684 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e9055604-8342-4194-a346-4b89769969fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0522ed7e46f44923a47f5e0e6cd8a03d'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:56.064269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95992bdc-f0a0-4efc-8fd0-3308e977fe46 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:56.069589 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7776436-8b1b-4d4c-9951-6276e309ee1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:56.070265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7776436-8b1b-4d4c-9951-6276e309ee1a admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:56.070545 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7776436-8b1b-4d4c-9951-6276e309ee1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:56.070824 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7776436-8b1b-4d4c-9951-6276e309ee1a admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:56.071518 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7776436-8b1b-4d4c-9951-6276e309ee1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:56.073493 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7776436-8b1b-4d4c-9951-6276e309ee1a admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:56.074549 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e9055604-8342-4194-a346-4b89769969fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0522ed7e46f44923a47f5e0e6cd8a03d'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:56.075284 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e9055604-8342-4194-a346-4b89769969fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0522ed7e46f44923a47f5e0e6cd8a03d'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:56.214332 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e9055604-8342-4194-a346-4b89769969fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0522ed7e46f44923a47f5e0e6cd8a03d'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:56.216867 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e9055604-8342-4194-a346-4b89769969fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0522ed7e46f44923a47f5e0e6cd8a03d'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:56.221541 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 969/1921] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:55 2022] POST /identity/v3/users => generated 288 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:19:56.225997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7776436-8b1b-4d4c-9951-6276e309ee1a admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:56.228292 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e7776436-8b1b-4d4c-9951-6276e309ee1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:56.229669 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 953/1922] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:19:55 2022] DELETE /identity/v3/users/0522ed7e46f44923a47f5e0e6cd8a03d => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:56.243565 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7776436-8b1b-4d4c-9951-6276e309ee1a admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:56.245555 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9055604-8342-4194-a346-4b89769969fa admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:56.245800 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-e9055604-8342-4194-a346-4b89769969fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:56.308880 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9a015-3586-4c02-9b66-06e69d070870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:56.309870 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9a015-3586-4c02-9b66-06e69d070870 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:56.310227 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9a015-3586-4c02-9b66-06e69d070870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:56.310578 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9a015-3586-4c02-9b66-06e69d070870 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:56.311392 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9a015-3586-4c02-9b66-06e69d070870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:56.313298 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9a015-3586-4c02-9b66-06e69d070870 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:56.330877 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 970/1923] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:19:56.334847 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9055604-8342-4194-a346-4b89769969fa admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:56.337264 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9a015-3586-4c02-9b66-06e69d070870 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:56.340453 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e4019-cc04-4733-8f85-f9900d313239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:56.341389 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e4019-cc04-4733-8f85-f9900d313239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:56.341670 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e4019-cc04-4733-8f85-f9900d313239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:56.341942 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e4019-cc04-4733-8f85-f9900d313239 admin admin] PATH_INFO: `/v3/users/d0b150d6d1f94ebea172e4567fe276ca` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:56.343142 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e4019-cc04-4733-8f85-f9900d313239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0b150d6d1f94ebea172e4567fe276ca)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:56.345169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e4019-cc04-4733-8f85-f9900d313239 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:56.346331 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9a015-3586-4c02-9b66-06e69d070870 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:56.351703 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e9464-dc47-4101-8099-b01928331e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:56.352368 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e9464-dc47-4101-8099-b01928331e0b admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:56.352650 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e9464-dc47-4101-8099-b01928331e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:56.353219 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e9464-dc47-4101-8099-b01928331e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:56.353943 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e9464-dc47-4101-8099-b01928331e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:56.355536 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e9464-dc47-4101-8099-b01928331e0b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:56.365511 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 971/1924] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:19:56.369683 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e9464-dc47-4101-8099-b01928331e0b admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:56.379118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e9464-dc47-4101-8099-b01928331e0b admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:56.384562 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f7d6a-a172-4105-8675-f92b3e84a16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:56.385442 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f7d6a-a172-4105-8675-f92b3e84a16a admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:56.385727 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f7d6a-a172-4105-8675-f92b3e84a16a admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:56.385999 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f7d6a-a172-4105-8675-f92b3e84a16a admin admin] PATH_INFO: `/v3/projects/c4df1c324b7e47af824bc90522d07049/users/82f2e6b97d704bf994e37046e8e7e67a/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:56.400638 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f7d6a-a172-4105-8675-f92b3e84a16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4df1c324b7e47af824bc90522d07049, user_id=82f2e6b97d704bf994e37046e8e7e67a, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:56.403310 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f7d6a-a172-4105-8675-f92b3e84a16a admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:56.518053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 972/1925] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:56 2022] PUT /identity/v3/projects/c4df1c324b7e47af824bc90522d07049/users/82f2e6b97d704bf994e37046e8e7e67a/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:56.529616 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff8571-3735-4279-8251-481c6e425b85 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:56.529923 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff8571-3735-4279-8251-481c6e425b85 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:56.530173 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff8571-3735-4279-8251-481c6e425b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:56.564202 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-6f7e4019-cc04-4733-8f85-f9900d313239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0b150d6d1f94ebea172e4567fe276ca'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:56.582853 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-0dff8571-3735-4279-8251-481c6e425b85 None None] MFA Rules not processed for user `82f2e6b97d704bf994e37046e8e7e67a`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:56.585482 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0dff8571-3735-4279-8251-481c6e425b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:56.595047 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-6f7e4019-cc04-4733-8f85-f9900d313239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0b150d6d1f94ebea172e4567fe276ca'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:56.595835 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-6f7e4019-cc04-4733-8f85-f9900d313239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0b150d6d1f94ebea172e4567fe276ca'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:56.658218 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 973/1926] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:56.662672 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff8571-3735-4279-8251-481c6e425b85 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:56.663940 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0dff8571-3735-4279-8251-481c6e425b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:56.705819 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-6f7e4019-cc04-4733-8f85-f9900d313239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0b150d6d1f94ebea172e4567fe276ca'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:56.707140 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-6f7e4019-cc04-4733-8f85-f9900d313239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0b150d6d1f94ebea172e4567fe276ca'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:56.733488 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff8571-3735-4279-8251-481c6e425b85 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:56.736562 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 954/1927] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:19:56 2022] DELETE /identity/v3/users/d0b150d6d1f94ebea172e4567fe276ca => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:56.740777 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e4019-cc04-4733-8f85-f9900d313239 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:56.742157 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6f7e4019-cc04-4733-8f85-f9900d313239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:56.791083 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd6deb-e4c1-43a8-bb01-b00188aa33ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:56.791707 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd6deb-e4c1-43a8-bb01-b00188aa33ba admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:56.791944 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd6deb-e4c1-43a8-bb01-b00188aa33ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:56.792218 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd6deb-e4c1-43a8-bb01-b00188aa33ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:56.792977 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd6deb-e4c1-43a8-bb01-b00188aa33ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:56.795179 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd6deb-e4c1-43a8-bb01-b00188aa33ba admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:56.806235 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e4019-cc04-4733-8f85-f9900d313239 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:56.811340 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366c14a-9a34-4af2-976b-81263969087d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:56.812201 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366c14a-9a34-4af2-976b-81263969087d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:56.812485 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366c14a-9a34-4af2-976b-81263969087d admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:56.812795 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366c14a-9a34-4af2-976b-81263969087d admin admin] PATH_INFO: `/v3/projects/879eba7f97c443d8a69ebe8f4b96d6e5` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:56.814105 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366c14a-9a34-4af2-976b-81263969087d admin admin] RBAC: Authorizing `identity:delete_project(project_id=879eba7f97c443d8a69ebe8f4b96d6e5)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:56.815984 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366c14a-9a34-4af2-976b-81263969087d admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:56.917136 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 974/1928] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:56 2022] POST /identity/v3/projects => generated 377 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:19:56.918527 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795cb0-7d90-48fd-99d8-dab74554c3bf None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:56.918849 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795cb0-7d90-48fd-99d8-dab74554c3bf None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:56.919132 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795cb0-7d90-48fd-99d8-dab74554c3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:56.937526 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-89795cb0-7d90-48fd-99d8-dab74554c3bf None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:56.938718 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-89795cb0-7d90-48fd-99d8-dab74554c3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:56.962889 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7366c14a-9a34-4af2-976b-81263969087d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879eba7f97c443d8a69ebe8f4b96d6e5', 'request_id': 'req-7366c14a-9a34-4af2-976b-81263969087d'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:56.999597 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 975/1929] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:57.000413 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89795cb0-7d90-48fd-99d8-dab74554c3bf None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:57.009960 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89795cb0-7d90-48fd-99d8-dab74554c3bf None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:57.064607 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4bb19-3e8b-4b95-8dc2-a8ec03dcd6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:57.065232 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4bb19-3e8b-4b95-8dc2-a8ec03dcd6ed admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:57.065514 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4bb19-3e8b-4b95-8dc2-a8ec03dcd6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:57.065790 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4bb19-3e8b-4b95-8dc2-a8ec03dcd6ed admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:57.066475 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4bb19-3e8b-4b95-8dc2-a8ec03dcd6ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:57.069201 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4bb19-3e8b-4b95-8dc2-a8ec03dcd6ed admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:57.080686 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7366c14a-9a34-4af2-976b-81263969087d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879eba7f97c443d8a69ebe8f4b96d6e5', 'request_id': 'req-7366c14a-9a34-4af2-976b-81263969087d'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:57.087252 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7366c14a-9a34-4af2-976b-81263969087d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879eba7f97c443d8a69ebe8f4b96d6e5', 'request_id': 'req-7366c14a-9a34-4af2-976b-81263969087d'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:57.098206 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7366c14a-9a34-4af2-976b-81263969087d admin admin] The token cache is being invalidate because project 879eba7f97c443d8a69ebe8f4b96d6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:19:57.098489 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7366c14a-9a34-4af2-976b-81263969087d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:57.099324 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7366c14a-9a34-4af2-976b-81263969087d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:57.100986 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 955/1930] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:19:56 2022] DELETE /identity/v3/projects/879eba7f97c443d8a69ebe8f4b96d6e5 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:57.101749 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366c14a-9a34-4af2-976b-81263969087d admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:57.103857 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7366c14a-9a34-4af2-976b-81263969087d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:57.153063 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 976/1931] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:56 2022] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:57.153063 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a8fe3-1874-4ad0-97af-99d73a96050c None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:57.153063 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a8fe3-1874-4ad0-97af-99d73a96050c None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:57.153063 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a8fe3-1874-4ad0-97af-99d73a96050c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:57.157831 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366c14a-9a34-4af2-976b-81263969087d admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:57.161641 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9a414-8e4f-4ef3-9786-ed0acee24030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:57.162306 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9a414-8e4f-4ef3-9786-ed0acee24030 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:57.162584 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9a414-8e4f-4ef3-9786-ed0acee24030 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:57.162858 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9a414-8e4f-4ef3-9786-ed0acee24030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:57.164642 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-53b9a414-8e4f-4ef3-9786-ed0acee24030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:57.170120 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-0b3a8fe3-1874-4ad0-97af-99d73a96050c None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:57.171286 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0b3a8fe3-1874-4ad0-97af-99d73a96050c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:57.176902 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b9a414-8e4f-4ef3-9786-ed0acee24030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:57.178748 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b9a414-8e4f-4ef3-9786-ed0acee24030 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:57.179554 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 977/1932] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:57.180202 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a8fe3-1874-4ad0-97af-99d73a96050c None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:57.181431 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0b3a8fe3-1874-4ad0-97af-99d73a96050c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:57.193928 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 956/1933] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:57.194089 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a8fe3-1874-4ad0-97af-99d73a96050c None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:57.195208 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f50dd-6e7f-4576-a509-4a1eb94e4b57 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:57.195498 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f50dd-6e7f-4576-a509-4a1eb94e4b57 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:57.195884 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f50dd-6e7f-4576-a509-4a1eb94e4b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:57.198952 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f3b8c-a030-47bd-a120-aa38c1d765ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:57.199631 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f3b8c-a030-47bd-a120-aa38c1d765ba admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:57.199920 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f3b8c-a030-47bd-a120-aa38c1d765ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:57.200200 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f3b8c-a030-47bd-a120-aa38c1d765ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:57.201149 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f3b8c-a030-47bd-a120-aa38c1d765ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:57.204280 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f3b8c-a030-47bd-a120-aa38c1d765ba admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:57.222851 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 978/1934] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:57.223054 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-2f5f50dd-6e7f-4576-a509-4a1eb94e4b57 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:57.223054 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-2f5f50dd-6e7f-4576-a509-4a1eb94e4b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:57.223952 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f3b8c-a030-47bd-a120-aa38c1d765ba admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:57.232102 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 957/1935] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:57.236322 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f50dd-6e7f-4576-a509-4a1eb94e4b57 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:57.243416 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f3b8c-a030-47bd-a120-aa38c1d765ba admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:57.249237 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f50dd-6e7f-4576-a509-4a1eb94e4b57 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:57.251837 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f439908-9940-443a-b88b-6a10dc5fc0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:57.251837 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f439908-9940-443a-b88b-6a10dc5fc0e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:57.251837 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f439908-9940-443a-b88b-6a10dc5fc0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:57.251837 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f439908-9940-443a-b88b-6a10dc5fc0e2 admin admin] PATH_INFO: `/v3/projects/be906962b5ab45fa83825760ff47e76b/users/a3cb2b65417748bdb482492ae1bf4d34/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:57.254324 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f48ac-11a8-4fde-9adf-a6095557270e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:57.255558 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f48ac-11a8-4fde-9adf-a6095557270e admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:57.255850 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f48ac-11a8-4fde-9adf-a6095557270e admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:57.256109 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f48ac-11a8-4fde-9adf-a6095557270e admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:57.256866 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f48ac-11a8-4fde-9adf-a6095557270e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:19:57.257180 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f48ac-11a8-4fde-9adf-a6095557270e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:57.258801 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f48ac-11a8-4fde-9adf-a6095557270e admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:57.268687 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f439908-9940-443a-b88b-6a10dc5fc0e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be906962b5ab45fa83825760ff47e76b, user_id=a3cb2b65417748bdb482492ae1bf4d34, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:57.272399 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f439908-9940-443a-b88b-6a10dc5fc0e2 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:57.276713 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 958/1936] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:19:57.281161 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f48ac-11a8-4fde-9adf-a6095557270e admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:57.291056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f48ac-11a8-4fde-9adf-a6095557270e admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:57.295958 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c7e44-8533-4057-8b52-80d5ff3b6370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:57.297293 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c7e44-8533-4057-8b52-80d5ff3b6370 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:57.297580 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c7e44-8533-4057-8b52-80d5ff3b6370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:57.297850 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c7e44-8533-4057-8b52-80d5ff3b6370 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:57.298631 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c7e44-8533-4057-8b52-80d5ff3b6370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:57.300579 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c7e44-8533-4057-8b52-80d5ff3b6370 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:57.354691 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 979/1937] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:57 2022] PUT /identity/v3/projects/be906962b5ab45fa83825760ff47e76b/users/a3cb2b65417748bdb482492ae1bf4d34/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:57.355777 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f439908-9940-443a-b88b-6a10dc5fc0e2 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:57.412370 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 959/1938] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:57 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:19:57.414286 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c7e44-8533-4057-8b52-80d5ff3b6370 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:57.429256 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f439908-9940-443a-b88b-6a10dc5fc0e2 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:57.488703 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01b77e-b3c7-4a13-a0a4-41316a7226c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:57.489950 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01b77e-b3c7-4a13-a0a4-41316a7226c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:57.490234 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01b77e-b3c7-4a13-a0a4-41316a7226c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:57.490506 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01b77e-b3c7-4a13-a0a4-41316a7226c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:57.491642 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01b77e-b3c7-4a13-a0a4-41316a7226c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:57.493357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01b77e-b3c7-4a13-a0a4-41316a7226c4 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:57.499285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c7e44-8533-4057-8b52-80d5ff3b6370 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:57.504460 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e0cce-0c1a-47b3-a6f4-bee18a15cdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:57.505961 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e0cce-0c1a-47b3-a6f4-bee18a15cdcc admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:57.506273 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e0cce-0c1a-47b3-a6f4-bee18a15cdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:57.506569 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e0cce-0c1a-47b3-a6f4-bee18a15cdcc admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:57.507265 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e0cce-0c1a-47b3-a6f4-bee18a15cdcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:57.511734 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 980/1939] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:57.511870 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e0cce-0c1a-47b3-a6f4-bee18a15cdcc admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:57.512904 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01b77e-b3c7-4a13-a0a4-41316a7226c4 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:57.523579 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01b77e-b3c7-4a13-a0a4-41316a7226c4 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:57.528535 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dc436-0810-4fa5-a9dc-98bc2878e31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:57.529701 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dc436-0810-4fa5-a9dc-98bc2878e31f admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:57.530053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dc436-0810-4fa5-a9dc-98bc2878e31f admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:57.530403 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dc436-0810-4fa5-a9dc-98bc2878e31f admin admin] PATH_INFO: `/v3/projects/be906962b5ab45fa83825760ff47e76b/users/a3cb2b65417748bdb482492ae1bf4d34/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:57.532409 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25dc436-0810-4fa5-a9dc-98bc2878e31f admin admin] RBAC: Authorizing `identity:create_grant(project_id=be906962b5ab45fa83825760ff47e76b, user_id=a3cb2b65417748bdb482492ae1bf4d34, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:57.535279 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25dc436-0810-4fa5-a9dc-98bc2878e31f admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:57.546967 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 981/1940] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:57 2022] PUT /identity/v3/projects/be906962b5ab45fa83825760ff47e76b/users/a3cb2b65417748bdb482492ae1bf4d34/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:57.558194 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9009f-037e-46a3-9444-1c752b599728 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:57.558485 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9009f-037e-46a3-9444-1c752b599728 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:57.558766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9009f-037e-46a3-9444-1c752b599728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:57.586092 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-b6d9009f-037e-46a3-9444-1c752b599728 None None] MFA Rules not processed for user `a3cb2b65417748bdb482492ae1bf4d34`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:57.587224 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b6d9009f-037e-46a3-9444-1c752b599728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:57.631820 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 960/1941] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:57 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:57.635716 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e0cce-0c1a-47b3-a6f4-bee18a15cdcc admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:57.649478 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e0cce-0c1a-47b3-a6f4-bee18a15cdcc admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:57.659676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 982/1942] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:57.667507 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9009f-037e-46a3-9444-1c752b599728 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:57.670913 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b6d9009f-037e-46a3-9444-1c752b599728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:57.742589 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809990b7-c858-4dad-9ccb-2290b0e09749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:57.743125 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9009f-037e-46a3-9444-1c752b599728 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:57.743946 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809990b7-c858-4dad-9ccb-2290b0e09749 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:57.744428 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809990b7-c858-4dad-9ccb-2290b0e09749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:57.744736 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809990b7-c858-4dad-9ccb-2290b0e09749 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:57.745489 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809990b7-c858-4dad-9ccb-2290b0e09749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:57.747158 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809990b7-c858-4dad-9ccb-2290b0e09749 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:57.747913 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631b6d7-9cea-44cd-8103-3ffd96f73860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:57.748796 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631b6d7-9cea-44cd-8103-3ffd96f73860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:57.749341 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631b6d7-9cea-44cd-8103-3ffd96f73860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:57.749341 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631b6d7-9cea-44cd-8103-3ffd96f73860 admin admin] PATH_INFO: `/v3/projects/ac1b06c7b48f47cb8e19bb961c7a1d20` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:57.750560 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631b6d7-9cea-44cd-8103-3ffd96f73860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac1b06c7b48f47cb8e19bb961c7a1d20)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:57.752466 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631b6d7-9cea-44cd-8103-3ffd96f73860 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:57.760823 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 961/1943] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:19:57.760823 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809990b7-c858-4dad-9ccb-2290b0e09749 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:57.760823 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-809990b7-c858-4dad-9ccb-2290b0e09749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:57.816353 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809990b7-c858-4dad-9ccb-2290b0e09749 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:57.821042 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ea48d-d2f2-4d00-b720-4b9d5dfab8b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:57.821690 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ea48d-d2f2-4d00-b720-4b9d5dfab8b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:57.821974 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ea48d-d2f2-4d00-b720-4b9d5dfab8b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:57.822250 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ea48d-d2f2-4d00-b720-4b9d5dfab8b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:57.824081 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-d24ea48d-d2f2-4d00-b720-4b9d5dfab8b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:57.855155 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d631b6d7-9cea-44cd-8103-3ffd96f73860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac1b06c7b48f47cb8e19bb961c7a1d20', 'request_id': 'req-d631b6d7-9cea-44cd-8103-3ffd96f73860'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:57.860651 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d631b6d7-9cea-44cd-8103-3ffd96f73860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac1b06c7b48f47cb8e19bb961c7a1d20', 'request_id': 'req-d631b6d7-9cea-44cd-8103-3ffd96f73860'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:57.866761 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d631b6d7-9cea-44cd-8103-3ffd96f73860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac1b06c7b48f47cb8e19bb961c7a1d20', 'request_id': 'req-d631b6d7-9cea-44cd-8103-3ffd96f73860'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:57.884202 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ea48d-d2f2-4d00-b720-4b9d5dfab8b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:57.885789 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ea48d-d2f2-4d00-b720-4b9d5dfab8b2 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:57.894542 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 962/1944] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:57.898965 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ea48d-d2f2-4d00-b720-4b9d5dfab8b2 service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:57.908752 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ea48d-d2f2-4d00-b720-4b9d5dfab8b2 service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:57.956181 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d631b6d7-9cea-44cd-8103-3ffd96f73860 admin admin] The token cache is being invalidate because project ac1b06c7b48f47cb8e19bb961c7a1d20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:19:57.956775 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d631b6d7-9cea-44cd-8103-3ffd96f73860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:57.957611 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d631b6d7-9cea-44cd-8103-3ffd96f73860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:57.960074 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 983/1945] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:19:57 2022] DELETE /identity/v3/projects/ac1b06c7b48f47cb8e19bb961c7a1d20 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:57.964439 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631b6d7-9cea-44cd-8103-3ffd96f73860 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:57.966044 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-d631b6d7-9cea-44cd-8103-3ffd96f73860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:57.969436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907edf2-c2cc-4cfd-913e-738bbc14e139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:57.970111 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907edf2-c2cc-4cfd-913e-738bbc14e139 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:57.970395 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907edf2-c2cc-4cfd-913e-738bbc14e139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:57.970672 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907edf2-c2cc-4cfd-913e-738bbc14e139 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:57.971460 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907edf2-c2cc-4cfd-913e-738bbc14e139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:57.973763 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907edf2-c2cc-4cfd-913e-738bbc14e139 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:57.982240 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631b6d7-9cea-44cd-8103-3ffd96f73860 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:57.984431 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 963/1946] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:19:57.988046 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907edf2-c2cc-4cfd-913e-738bbc14e139 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:57.990095 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b907edf2-c2cc-4cfd-913e-738bbc14e139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:57.990529 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668c9ad-5b30-4abc-bbc8-6c8a32711915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:57.991676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668c9ad-5b30-4abc-bbc8-6c8a32711915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:57.992273 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668c9ad-5b30-4abc-bbc8-6c8a32711915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:57.992796 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668c9ad-5b30-4abc-bbc8-6c8a32711915 admin admin] PATH_INFO: `/v3/users/55cb9c3187e048c99c99e82fbed33311` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:57.994286 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668c9ad-5b30-4abc-bbc8-6c8a32711915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55cb9c3187e048c99c99e82fbed33311)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:57.996384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668c9ad-5b30-4abc-bbc8-6c8a32711915 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:58.004414 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907edf2-c2cc-4cfd-913e-738bbc14e139 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:58.014118 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b453d-d1ba-4314-af00-aa8fcff97302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:58.015208 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b453d-d1ba-4314-af00-aa8fcff97302 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:58.015502 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b453d-d1ba-4314-af00-aa8fcff97302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:58.015783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b453d-d1ba-4314-af00-aa8fcff97302 admin admin] PATH_INFO: `/v3/projects/220a310c83cc4db09b2f400416321f35/users/eb90048468b94c0492c607e926649696/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:58.037974 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b453d-d1ba-4314-af00-aa8fcff97302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=220a310c83cc4db09b2f400416321f35, user_id=eb90048468b94c0492c607e926649696, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:58.040846 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b453d-d1ba-4314-af00-aa8fcff97302 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:58.140310 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 964/1947] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:57 2022] PUT /identity/v3/projects/220a310c83cc4db09b2f400416321f35/users/eb90048468b94c0492c607e926649696/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:58.156023 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b8c02-33a4-4813-9e12-01947e28f8ff None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:58.156323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b8c02-33a4-4813-9e12-01947e28f8ff None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:58.156601 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b8c02-33a4-4813-9e12-01947e28f8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:58.183585 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-e56b8c02-33a4-4813-9e12-01947e28f8ff None None] MFA Rules not processed for user `eb90048468b94c0492c607e926649696`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:58.184837 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-e56b8c02-33a4-4813-9e12-01947e28f8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:58.204802 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d668c9ad-5b30-4abc-bbc8-6c8a32711915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55cb9c3187e048c99c99e82fbed33311'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:58.217711 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d668c9ad-5b30-4abc-bbc8-6c8a32711915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55cb9c3187e048c99c99e82fbed33311'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:58.217711 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d668c9ad-5b30-4abc-bbc8-6c8a32711915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55cb9c3187e048c99c99e82fbed33311'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:58.218281 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d668c9ad-5b30-4abc-bbc8-6c8a32711915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55cb9c3187e048c99c99e82fbed33311'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:58.226089 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d668c9ad-5b30-4abc-bbc8-6c8a32711915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55cb9c3187e048c99c99e82fbed33311'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:58.250372 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 965/1948] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:19:58.254747 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b8c02-33a4-4813-9e12-01947e28f8ff None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:58.256152 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-e56b8c02-33a4-4813-9e12-01947e28f8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:58.316342 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 984/1949] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:19:57 2022] DELETE /identity/v3/users/55cb9c3187e048c99c99e82fbed33311 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:19:58.323263 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b8c02-33a4-4813-9e12-01947e28f8ff None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:58.392555 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfc152-d04f-4141-8e62-3cd54aa18552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:58.393310 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfc152-d04f-4141-8e62-3cd54aa18552 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:58.393600 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfc152-d04f-4141-8e62-3cd54aa18552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:58.393879 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfc152-d04f-4141-8e62-3cd54aa18552 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:58.394629 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfc152-d04f-4141-8e62-3cd54aa18552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:58.397345 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfc152-d04f-4141-8e62-3cd54aa18552 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:58.558158 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 966/1950] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:58 2022] POST /identity/v3/projects => generated 387 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:19:58.561719 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668c9ad-5b30-4abc-bbc8-6c8a32711915 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:58.577306 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668c9ad-5b30-4abc-bbc8-6c8a32711915 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:58.647656 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f13a10-7364-4848-8818-cd5aaae1e626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:58.648342 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f13a10-7364-4848-8818-cd5aaae1e626 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:58.648629 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f13a10-7364-4848-8818-cd5aaae1e626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:58.649528 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f13a10-7364-4848-8818-cd5aaae1e626 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:58.649986 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f13a10-7364-4848-8818-cd5aaae1e626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:58.652066 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f13a10-7364-4848-8818-cd5aaae1e626 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:58.774134 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfc152-d04f-4141-8e62-3cd54aa18552 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:58.780837 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 985/1951] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:58 2022] POST /identity/v3/users => generated 300 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:19:58.789267 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfc152-d04f-4141-8e62-3cd54aa18552 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:58.794825 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3766c0-1f3f-449e-b83b-fbcb28d5e7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:58.796717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3766c0-1f3f-449e-b83b-fbcb28d5e7fd admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:58.796717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3766c0-1f3f-449e-b83b-fbcb28d5e7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:58.796717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3766c0-1f3f-449e-b83b-fbcb28d5e7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:58.797288 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3766c0-1f3f-449e-b83b-fbcb28d5e7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:58.799403 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3766c0-1f3f-449e-b83b-fbcb28d5e7fd admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:58.810781 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f13a10-7364-4848-8818-cd5aaae1e626 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:58.812228 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-29f13a10-7364-4848-8818-cd5aaae1e626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:58.812787 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 967/1952] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:19:58.816517 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3766c0-1f3f-449e-b83b-fbcb28d5e7fd admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:58.829421 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f13a10-7364-4848-8818-cd5aaae1e626 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:58.841745 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44b744-173a-418f-9356-eba0705130a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:58.842627 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44b744-173a-418f-9356-eba0705130a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:58.843107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44b744-173a-418f-9356-eba0705130a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:58.843858 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44b744-173a-418f-9356-eba0705130a9 admin admin] PATH_INFO: `/v3/projects/faf14713d98f4ef6823603c94e468a0c` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:58.845978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44b744-173a-418f-9356-eba0705130a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf14713d98f4ef6823603c94e468a0c)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:58.850067 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44b744-173a-418f-9356-eba0705130a9 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:58.850586 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3766c0-1f3f-449e-b83b-fbcb28d5e7fd admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:58.859029 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349ecdb-38d5-4227-826a-c36bcf64aabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:58.859930 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349ecdb-38d5-4227-826a-c36bcf64aabc admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:58.860213 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349ecdb-38d5-4227-826a-c36bcf64aabc admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:58.860488 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349ecdb-38d5-4227-826a-c36bcf64aabc admin admin] PATH_INFO: `/v3/projects/988f04d1055943369671c334f5199399/users/caac90eff096423ba364d9011133901c/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:58.882692 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349ecdb-38d5-4227-826a-c36bcf64aabc admin admin] RBAC: Authorizing `identity:create_grant(project_id=988f04d1055943369671c334f5199399, user_id=caac90eff096423ba364d9011133901c, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:58.885563 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349ecdb-38d5-4227-826a-c36bcf64aabc admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:58.963482 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 968/1953] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:58 2022] PUT /identity/v3/projects/988f04d1055943369671c334f5199399/users/caac90eff096423ba364d9011133901c/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:58.967342 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349ecdb-38d5-4227-826a-c36bcf64aabc admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:58.978842 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-bf44b744-173a-418f-9356-eba0705130a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf14713d98f4ef6823603c94e468a0c', 'request_id': 'req-bf44b744-173a-418f-9356-eba0705130a9'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:58.984574 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-bf44b744-173a-418f-9356-eba0705130a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf14713d98f4ef6823603c94e468a0c', 'request_id': 'req-bf44b744-173a-418f-9356-eba0705130a9'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:58.991386 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-bf44b744-173a-418f-9356-eba0705130a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf14713d98f4ef6823603c94e468a0c', 'request_id': 'req-bf44b744-173a-418f-9356-eba0705130a9'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:59.027180 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349ecdb-38d5-4227-826a-c36bcf64aabc admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:59.081452 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31005c2d-d37f-44ab-b3b2-b2ecffd584c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:59.082116 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31005c2d-d37f-44ab-b3b2-b2ecffd584c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:59.082397 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31005c2d-d37f-44ab-b3b2-b2ecffd584c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:59.082690 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31005c2d-d37f-44ab-b3b2-b2ecffd584c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:59.084000 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31005c2d-d37f-44ab-b3b2-b2ecffd584c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:59.085632 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31005c2d-d37f-44ab-b3b2-b2ecffd584c1 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:59.095106 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 969/1954] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:19:59.099888 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31005c2d-d37f-44ab-b3b2-b2ecffd584c1 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:59.109530 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31005c2d-d37f-44ab-b3b2-b2ecffd584c1 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:59.114586 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797367a-8dcf-4689-b876-17ee809dc27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:59.117393 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797367a-8dcf-4689-b876-17ee809dc27c admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:59.117393 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797367a-8dcf-4689-b876-17ee809dc27c admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:59.117393 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797367a-8dcf-4689-b876-17ee809dc27c admin admin] PATH_INFO: `/v3/projects/988f04d1055943369671c334f5199399/users/caac90eff096423ba364d9011133901c/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:59.118478 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797367a-8dcf-4689-b876-17ee809dc27c admin admin] RBAC: Authorizing `identity:create_grant(project_id=988f04d1055943369671c334f5199399, user_id=caac90eff096423ba364d9011133901c, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:59.121174 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797367a-8dcf-4689-b876-17ee809dc27c admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:59.132031 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 970/1955] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:59 2022] PUT /identity/v3/projects/988f04d1055943369671c334f5199399/users/caac90eff096423ba364d9011133901c/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:59.142690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-bf44b744-173a-418f-9356-eba0705130a9 admin admin] The token cache is being invalidate because project faf14713d98f4ef6823603c94e468a0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:19:59.142690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-bf44b744-173a-418f-9356-eba0705130a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:59.142690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-bf44b744-173a-418f-9356-eba0705130a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:59.142690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 986/1956] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:19:58 2022] DELETE /identity/v3/projects/faf14713d98f4ef6823603c94e468a0c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:59.143097 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d3dbb-5703-438a-aeae-ae4c6be959a8 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:59.143447 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d3dbb-5703-438a-aeae-ae4c6be959a8 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:59.143728 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d3dbb-5703-438a-aeae-ae4c6be959a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:59.146711 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860967c9-7089-4840-b2f6-af27c7eac06c None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:59.147163 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860967c9-7089-4840-b2f6-af27c7eac06c None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:59.147445 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860967c9-7089-4840-b2f6-af27c7eac06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:59.165122 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-860967c9-7089-4840-b2f6-af27c7eac06c None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:59.166360 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-860967c9-7089-4840-b2f6-af27c7eac06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:59.170977 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-d36d3dbb-5703-438a-aeae-ae4c6be959a8 None None] MFA Rules not processed for user `caac90eff096423ba364d9011133901c`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:59.172164 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-d36d3dbb-5703-438a-aeae-ae4c6be959a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:59.234053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 987/1957] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:19:59.235102 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70412e8a-38b4-426a-9376-fb1598f030ee None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:59.235403 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70412e8a-38b4-426a-9376-fb1598f030ee None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:59.235680 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70412e8a-38b4-426a-9376-fb1598f030ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:59.252819 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 971/1958] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:19:59.261516 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-70412e8a-38b4-426a-9376-fb1598f030ee None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:59.262798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-70412e8a-38b4-426a-9376-fb1598f030ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:59.267410 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d3dbb-5703-438a-aeae-ae4c6be959a8 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:59.269823 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-d36d3dbb-5703-438a-aeae-ae4c6be959a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:59.272164 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 988/1959] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:19:59.278748 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70412e8a-38b4-426a-9376-fb1598f030ee None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:59.288830 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70412e8a-38b4-426a-9376-fb1598f030ee None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:59.294182 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd4509-3cb9-490c-bab9-6552daa9fc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:59.294840 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd4509-3cb9-490c-bab9-6552daa9fc78 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:59.295118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd4509-3cb9-490c-bab9-6552daa9fc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:59.295389 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd4509-3cb9-490c-bab9-6552daa9fc78 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:59.296114 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd4509-3cb9-490c-bab9-6552daa9fc78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:19:59.296416 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd4509-3cb9-490c-bab9-6552daa9fc78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:59.298058 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd4509-3cb9-490c-bab9-6552daa9fc78 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:59.311107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 989/1960] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:19:59.321152 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd4509-3cb9-490c-bab9-6552daa9fc78 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:59.331159 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd4509-3cb9-490c-bab9-6552daa9fc78 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:59.336691 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd38e-b165-455f-bedf-2b44d3bdd434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:59.337215 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd38e-b165-455f-bedf-2b44d3bdd434 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:59.337503 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd38e-b165-455f-bedf-2b44d3bdd434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:59.349358 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd38e-b165-455f-bedf-2b44d3bdd434 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:59.349358 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cd38e-b165-455f-bedf-2b44d3bdd434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:59.349537 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d3dbb-5703-438a-aeae-ae4c6be959a8 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:59.349614 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cd38e-b165-455f-bedf-2b44d3bdd434 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:59.349691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c815e-20d4-488f-8a2a-d9c9d5697972 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:59.349691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c815e-20d4-488f-8a2a-d9c9d5697972 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:59.349691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c815e-20d4-488f-8a2a-d9c9d5697972 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:59.349691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c815e-20d4-488f-8a2a-d9c9d5697972 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:59.355391 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c815e-20d4-488f-8a2a-d9c9d5697972 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:59.356918 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c815e-20d4-488f-8a2a-d9c9d5697972 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:59.366948 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 972/1961] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:19:59.394639 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c815e-20d4-488f-8a2a-d9c9d5697972 service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:59.396576 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-898c815e-20d4-488f-8a2a-d9c9d5697972 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:59.410217 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c815e-20d4-488f-8a2a-d9c9d5697972 service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:59.415634 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03af46-514e-4535-aca4-9e0251472921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:59.426630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03af46-514e-4535-aca4-9e0251472921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:59.426630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03af46-514e-4535-aca4-9e0251472921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:59.426630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03af46-514e-4535-aca4-9e0251472921 admin admin] PATH_INFO: `/v3/users/eb90048468b94c0492c607e926649696` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:59.426630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03af46-514e-4535-aca4-9e0251472921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb90048468b94c0492c607e926649696)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:59.426630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03af46-514e-4535-aca4-9e0251472921 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:59.491867 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 990/1962] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:19:59 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:19:59.494777 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd38e-b165-455f-bedf-2b44d3bdd434 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:59.566803 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd38e-b165-455f-bedf-2b44d3bdd434 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:59.577052 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96953b-af6d-42a7-8257-e7a6dad28bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:59.577735 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96953b-af6d-42a7-8257-e7a6dad28bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:59.578081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96953b-af6d-42a7-8257-e7a6dad28bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:59.578358 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96953b-af6d-42a7-8257-e7a6dad28bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:59.579059 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96953b-af6d-42a7-8257-e7a6dad28bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:59.581023 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96953b-af6d-42a7-8257-e7a6dad28bd8 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:59.632275 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-fd03af46-514e-4535-aca4-9e0251472921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb90048468b94c0492c607e926649696'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:59.645044 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-fd03af46-514e-4535-aca4-9e0251472921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb90048468b94c0492c607e926649696'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:59.645790 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-fd03af46-514e-4535-aca4-9e0251472921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb90048468b94c0492c607e926649696'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:59.712581 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 991/1963] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:19:59 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:19:59.716684 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96953b-af6d-42a7-8257-e7a6dad28bd8 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:59.719072 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-1f96953b-af6d-42a7-8257-e7a6dad28bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:59.731964 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96953b-af6d-42a7-8257-e7a6dad28bd8 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:59.737928 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79284807-b2d5-435a-9a6b-e1acd2413b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:59.738596 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79284807-b2d5-435a-9a6b-e1acd2413b50 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:59.738872 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79284807-b2d5-435a-9a6b-e1acd2413b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:59.739143 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79284807-b2d5-435a-9a6b-e1acd2413b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:59.740684 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79284807-b2d5-435a-9a6b-e1acd2413b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:59.743168 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79284807-b2d5-435a-9a6b-e1acd2413b50 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:59.743920 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-fd03af46-514e-4535-aca4-9e0251472921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb90048468b94c0492c607e926649696'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:59.744812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-fd03af46-514e-4535-aca4-9e0251472921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb90048468b94c0492c607e926649696'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:19:59.763417 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 992/1964] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:19:59.763417 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79284807-b2d5-435a-9a6b-e1acd2413b50 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:59.764270 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 973/1965] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:19:59 2022] DELETE /identity/v3/users/eb90048468b94c0492c607e926649696 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:19:59.767394 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68109087-fad4-452c-af2f-471c5afddcfe None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:59.767793 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68109087-fad4-452c-af2f-471c5afddcfe None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:59.768147 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68109087-fad4-452c-af2f-471c5afddcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:59.775726 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79284807-b2d5-435a-9a6b-e1acd2413b50 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:59.809085 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-68109087-fad4-452c-af2f-471c5afddcfe None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:19:59.811606 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-68109087-fad4-452c-af2f-471c5afddcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:59.836171 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c3b1b-fa15-4869-b441-efa5449c496e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:59.836886 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c3b1b-fa15-4869-b441-efa5449c496e admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:59.837174 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c3b1b-fa15-4869-b441-efa5449c496e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:59.837472 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c3b1b-fa15-4869-b441-efa5449c496e admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:59.838258 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c3b1b-fa15-4869-b441-efa5449c496e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:59.839834 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c3b1b-fa15-4869-b441-efa5449c496e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:59.849670 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 993/1966] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:19:59.854437 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c3b1b-fa15-4869-b441-efa5449c496e admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:59.865178 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c3b1b-fa15-4869-b441-efa5449c496e admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:59.869189 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 974/1967] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:19:59.870050 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828428e-4da9-477b-99e4-6039a90e362e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:59.870856 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828428e-4da9-477b-99e4-6039a90e362e admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:59.871149 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828428e-4da9-477b-99e4-6039a90e362e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:59.871418 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828428e-4da9-477b-99e4-6039a90e362e admin admin] PATH_INFO: `/v3/projects/81767ab29cbc4a21a0844927f7cd9a2a/users/19b2bcc7dae3482593ec5a299646c9c9/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:59.882211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68109087-fad4-452c-af2f-471c5afddcfe None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:19:59.883788 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-68109087-fad4-452c-af2f-471c5afddcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:19:59.888506 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828428e-4da9-477b-99e4-6039a90e362e admin admin] RBAC: Authorizing `identity:create_grant(project_id=81767ab29cbc4a21a0844927f7cd9a2a, user_id=19b2bcc7dae3482593ec5a299646c9c9, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:59.891212 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828428e-4da9-477b-99e4-6039a90e362e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:59.939173 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68109087-fad4-452c-af2f-471c5afddcfe None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:19:59.942885 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de043722-e3bc-4e21-b401-0a9cf8d492b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:19:59.943522 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de043722-e3bc-4e21-b401-0a9cf8d492b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:19:59.943804 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de043722-e3bc-4e21-b401-0a9cf8d492b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:19:59.944135 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de043722-e3bc-4e21-b401-0a9cf8d492b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:19:59.953549 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de043722-e3bc-4e21-b401-0a9cf8d492b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:19:59.954990 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de043722-e3bc-4e21-b401-0a9cf8d492b7 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:19:59.966158 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 975/1968] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:19:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:19:59.999705 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 994/1969] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:19:59 2022] PUT /identity/v3/projects/81767ab29cbc4a21a0844927f7cd9a2a/users/19b2bcc7dae3482593ec5a299646c9c9/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:00.012796 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e273a2-47a7-4997-b2d4-464648768fa0 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:00.013117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e273a2-47a7-4997-b2d4-464648768fa0 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:00.013561 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e273a2-47a7-4997-b2d4-464648768fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:00.042074 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-82e273a2-47a7-4997-b2d4-464648768fa0 None None] MFA Rules not processed for user `19b2bcc7dae3482593ec5a299646c9c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:00.043289 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-82e273a2-47a7-4997-b2d4-464648768fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:00.086294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828428e-4da9-477b-99e4-6039a90e362e admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:00.088184 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-6828428e-4da9-477b-99e4-6039a90e362e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:00.114876 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 976/1970] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:00.119385 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e273a2-47a7-4997-b2d4-464648768fa0 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:00.151390 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828428e-4da9-477b-99e4-6039a90e362e admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:00.155993 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b63b31-12ef-4f03-ad6e-cd9e16817dd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:00.157410 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b63b31-12ef-4f03-ad6e-cd9e16817dd5 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:00.157694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b63b31-12ef-4f03-ad6e-cd9e16817dd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:00.157967 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b63b31-12ef-4f03-ad6e-cd9e16817dd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:00.159833 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-d9b63b31-12ef-4f03-ad6e-cd9e16817dd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:00.194944 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e273a2-47a7-4997-b2d4-464648768fa0 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:00.199772 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a0c22-73b1-406b-aa45-260e6f2dc6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:00.200413 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a0c22-73b1-406b-aa45-260e6f2dc6fb admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:00.200740 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a0c22-73b1-406b-aa45-260e6f2dc6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:00.201021 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a0c22-73b1-406b-aa45-260e6f2dc6fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:00.203141 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a0c22-73b1-406b-aa45-260e6f2dc6fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:00.203672 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a0c22-73b1-406b-aa45-260e6f2dc6fb admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:00.247558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b63b31-12ef-4f03-ad6e-cd9e16817dd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:00.249036 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b63b31-12ef-4f03-ad6e-cd9e16817dd5 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:00.258651 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 995/1971] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:20:00.304178 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 977/1972] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:00 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:00.308311 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b63b31-12ef-4f03-ad6e-cd9e16817dd5 service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:00.319753 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b63b31-12ef-4f03-ad6e-cd9e16817dd5 service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:00.382015 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0864763-8eff-43eb-b462-511979c3a2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:00.382683 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0864763-8eff-43eb-b462-511979c3a2cf admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:00.382965 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0864763-8eff-43eb-b462-511979c3a2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:00.383239 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0864763-8eff-43eb-b462-511979c3a2cf admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:00.383925 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0864763-8eff-43eb-b462-511979c3a2cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:00.385879 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0864763-8eff-43eb-b462-511979c3a2cf admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:00.404532 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a0c22-73b1-406b-aa45-260e6f2dc6fb admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:00.406294 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-dd4a0c22-73b1-406b-aa45-260e6f2dc6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:00.419004 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a0c22-73b1-406b-aa45-260e6f2dc6fb admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:00.423703 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd8453-6766-44f5-90bf-91c357f839f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:00.424588 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd8453-6766-44f5-90bf-91c357f839f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:00.424912 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd8453-6766-44f5-90bf-91c357f839f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:00.425184 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd8453-6766-44f5-90bf-91c357f839f2 admin admin] PATH_INFO: `/v3/projects/220a310c83cc4db09b2f400416321f35` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:00.427518 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd8453-6766-44f5-90bf-91c357f839f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=220a310c83cc4db09b2f400416321f35)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:00.429359 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd8453-6766-44f5-90bf-91c357f839f2 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:00.481022 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 996/1973] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:00 2022] POST /identity/v3/users => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:00.484753 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0864763-8eff-43eb-b462-511979c3a2cf admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:00.495042 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0864763-8eff-43eb-b462-511979c3a2cf admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:00.499640 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0b078-da2b-48e7-affe-513decfce21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:00.500272 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0b078-da2b-48e7-affe-513decfce21d admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:00.500552 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0b078-da2b-48e7-affe-513decfce21d admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:00.500856 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0b078-da2b-48e7-affe-513decfce21d admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:00.501567 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0b078-da2b-48e7-affe-513decfce21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:00.503142 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0b078-da2b-48e7-affe-513decfce21d admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:00.514144 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 997/1974] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:20:00.517929 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0b078-da2b-48e7-affe-513decfce21d admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:00.527371 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0b078-da2b-48e7-affe-513decfce21d admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:00.532000 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510ea2e-46f2-427d-a5fc-34ed2b9276dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:00.532889 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510ea2e-46f2-427d-a5fc-34ed2b9276dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:00.533177 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510ea2e-46f2-427d-a5fc-34ed2b9276dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:00.539148 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510ea2e-46f2-427d-a5fc-34ed2b9276dc admin admin] PATH_INFO: `/v3/projects/aa1d495214e34dbeac205f273ecbd929/users/b9a546069666456e92edbbe199d35865/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:00.548237 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510ea2e-46f2-427d-a5fc-34ed2b9276dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1d495214e34dbeac205f273ecbd929, user_id=b9a546069666456e92edbbe199d35865, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:00.550998 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510ea2e-46f2-427d-a5fc-34ed2b9276dc admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:00.722534 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 998/1975] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:00 2022] PUT /identity/v3/projects/aa1d495214e34dbeac205f273ecbd929/users/b9a546069666456e92edbbe199d35865/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:00.726620 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510ea2e-46f2-427d-a5fc-34ed2b9276dc admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:00.731606 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-cffd8453-6766-44f5-90bf-91c357f839f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '220a310c83cc4db09b2f400416321f35', 'request_id': 'req-cffd8453-6766-44f5-90bf-91c357f839f2'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:00.792056 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510ea2e-46f2-427d-a5fc-34ed2b9276dc admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:00.835279 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-cffd8453-6766-44f5-90bf-91c357f839f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '220a310c83cc4db09b2f400416321f35', 'request_id': 'req-cffd8453-6766-44f5-90bf-91c357f839f2'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:00.842179 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-cffd8453-6766-44f5-90bf-91c357f839f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '220a310c83cc4db09b2f400416321f35', 'request_id': 'req-cffd8453-6766-44f5-90bf-91c357f839f2'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:00.847157 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8e8d8-8ab5-49f4-907c-aee02fcab72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:00.847837 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8e8d8-8ab5-49f4-907c-aee02fcab72c admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:00.848118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8e8d8-8ab5-49f4-907c-aee02fcab72c admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:00.848932 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8e8d8-8ab5-49f4-907c-aee02fcab72c admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:00.849661 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8e8d8-8ab5-49f4-907c-aee02fcab72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:00.851308 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8e8d8-8ab5-49f4-907c-aee02fcab72c admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:00.855863 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-cffd8453-6766-44f5-90bf-91c357f839f2 admin admin] The token cache is being invalidate because project 220a310c83cc4db09b2f400416321f35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:00.856155 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-cffd8453-6766-44f5-90bf-91c357f839f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:00.856848 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-cffd8453-6766-44f5-90bf-91c357f839f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:00.858404 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 978/1976] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:00 2022] DELETE /identity/v3/projects/220a310c83cc4db09b2f400416321f35 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:00.862152 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 999/1977] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:20:00.862328 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd8453-6766-44f5-90bf-91c357f839f2 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:00.864604 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-cffd8453-6766-44f5-90bf-91c357f839f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:00.867280 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8e8d8-8ab5-49f4-907c-aee02fcab72c admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:00.870352 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-dec8e8d8-8ab5-49f4-907c-aee02fcab72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:00.883781 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8e8d8-8ab5-49f4-907c-aee02fcab72c admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:00.886984 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd8453-6766-44f5-90bf-91c357f839f2 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:00.888957 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca1891-1f7a-403c-b2b0-f6c15995ca3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:00.889853 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca1891-1f7a-403c-b2b0-f6c15995ca3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:00.890134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca1891-1f7a-403c-b2b0-f6c15995ca3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:00.890416 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca1891-1f7a-403c-b2b0-f6c15995ca3b admin admin] PATH_INFO: `/v3/projects/aa1d495214e34dbeac205f273ecbd929/users/b9a546069666456e92edbbe199d35865/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:00.892276 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb088b6-920b-4a9e-aafd-9e8383e73964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:00.892443 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca1891-1f7a-403c-b2b0-f6c15995ca3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1d495214e34dbeac205f273ecbd929, user_id=b9a546069666456e92edbbe199d35865, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:00.893185 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb088b6-920b-4a9e-aafd-9e8383e73964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:00.893471 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb088b6-920b-4a9e-aafd-9e8383e73964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:00.893748 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb088b6-920b-4a9e-aafd-9e8383e73964 admin admin] PATH_INFO: `/v3/users/caac90eff096423ba364d9011133901c` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:00.894967 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb088b6-920b-4a9e-aafd-9e8383e73964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caac90eff096423ba364d9011133901c)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:00.895184 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca1891-1f7a-403c-b2b0-f6c15995ca3b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:00.897109 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb088b6-920b-4a9e-aafd-9e8383e73964 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:00.909138 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1000/1978] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:00 2022] PUT /identity/v3/projects/aa1d495214e34dbeac205f273ecbd929/users/b9a546069666456e92edbbe199d35865/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:00.921146 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73580127-c9f7-4437-a838-549260de1922 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:00.921437 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73580127-c9f7-4437-a838-549260de1922 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:00.921711 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73580127-c9f7-4437-a838-549260de1922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:00.948893 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-73580127-c9f7-4437-a838-549260de1922 None None] MFA Rules not processed for user `b9a546069666456e92edbbe199d35865`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:00.950109 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-73580127-c9f7-4437-a838-549260de1922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:01.017517 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1001/1979] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:01.192621 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-bbb088b6-920b-4a9e-aafd-9e8383e73964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caac90eff096423ba364d9011133901c'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:01.204021 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-bbb088b6-920b-4a9e-aafd-9e8383e73964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caac90eff096423ba364d9011133901c'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:01.204761 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-bbb088b6-920b-4a9e-aafd-9e8383e73964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caac90eff096423ba364d9011133901c'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:01.293958 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-bbb088b6-920b-4a9e-aafd-9e8383e73964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caac90eff096423ba364d9011133901c'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:01.294583 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-bbb088b6-920b-4a9e-aafd-9e8383e73964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caac90eff096423ba364d9011133901c'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:01.307765 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 979/1980] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:00 2022] DELETE /identity/v3/users/caac90eff096423ba364d9011133901c => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:01.327940 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73580127-c9f7-4437-a838-549260de1922 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:01.330130 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-73580127-c9f7-4437-a838-549260de1922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:01.330960 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb088b6-920b-4a9e-aafd-9e8383e73964 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:01.333279 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-bbb088b6-920b-4a9e-aafd-9e8383e73964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:01.400388 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb088b6-920b-4a9e-aafd-9e8383e73964 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:01.404801 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7856c-43e6-44c3-9783-7844a8424f6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:01.405460 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7856c-43e6-44c3-9783-7844a8424f6c service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:01.405744 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7856c-43e6-44c3-9783-7844a8424f6c service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:01.406021 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7856c-43e6-44c3-9783-7844a8424f6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:01.407853 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-97d7856c-43e6-44c3-9783-7844a8424f6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:01.413427 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73580127-c9f7-4437-a838-549260de1922 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:01.472587 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f8df3-1ce3-415b-9a69-e92e7f12635b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:01.474391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f8df3-1ce3-415b-9a69-e92e7f12635b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:01.474846 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f8df3-1ce3-415b-9a69-e92e7f12635b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:01.475154 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f8df3-1ce3-415b-9a69-e92e7f12635b admin admin] PATH_INFO: `/v3/users/09105bf8f4a74cddb15ab83152f13885` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:01.475715 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7856c-43e6-44c3-9783-7844a8424f6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:01.476795 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f8df3-1ce3-415b-9a69-e92e7f12635b admin admin] RBAC: Authorizing `identity:delete_user(user_id=09105bf8f4a74cddb15ab83152f13885)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:01.477116 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7856c-43e6-44c3-9783-7844a8424f6c service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:01.479181 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f8df3-1ce3-415b-9a69-e92e7f12635b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:01.487687 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 980/1981] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:20:01.606382 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7856c-43e6-44c3-9783-7844a8424f6c service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:01.621963 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7856c-43e6-44c3-9783-7844a8424f6c service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:01.621963 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ba126-7586-4447-a671-b4085d8c6f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:01.621963 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ba126-7586-4447-a671-b4085d8c6f98 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:01.621963 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ba126-7586-4447-a671-b4085d8c6f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:01.622392 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ba126-7586-4447-a671-b4085d8c6f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:01.622566 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c03ba126-7586-4447-a671-b4085d8c6f98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:01.691651 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ba126-7586-4447-a671-b4085d8c6f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:01.693421 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ba126-7586-4447-a671-b4085d8c6f98 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:01.702330 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 981/1982] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:20:01.717766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-c46f8df3-1ce3-415b-9a69-e92e7f12635b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09105bf8f4a74cddb15ab83152f13885'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:01.730005 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-c46f8df3-1ce3-415b-9a69-e92e7f12635b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09105bf8f4a74cddb15ab83152f13885'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:01.730670 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-c46f8df3-1ce3-415b-9a69-e92e7f12635b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09105bf8f4a74cddb15ab83152f13885'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:01.731265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-c46f8df3-1ce3-415b-9a69-e92e7f12635b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09105bf8f4a74cddb15ab83152f13885'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:01.737802 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-c46f8df3-1ce3-415b-9a69-e92e7f12635b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09105bf8f4a74cddb15ab83152f13885'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:01.758717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ba126-7586-4447-a671-b4085d8c6f98 service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:01.760273 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c03ba126-7586-4447-a671-b4085d8c6f98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:01.787522 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ba126-7586-4447-a671-b4085d8c6f98 service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:01.794372 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f2715-01d4-4a8c-9d59-b8b8f1957de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:01.795229 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f2715-01d4-4a8c-9d59-b8b8f1957de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:01.795446 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f2715-01d4-4a8c-9d59-b8b8f1957de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:01.795909 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f2715-01d4-4a8c-9d59-b8b8f1957de5 admin admin] PATH_INFO: `/v3/projects/988f04d1055943369671c334f5199399` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:01.797168 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f2715-01d4-4a8c-9d59-b8b8f1957de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=988f04d1055943369671c334f5199399)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:01.799323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f2715-01d4-4a8c-9d59-b8b8f1957de5 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:01.848910 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1002/1983] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:01 2022] DELETE /identity/v3/users/09105bf8f4a74cddb15ab83152f13885 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:01.853685 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68618d65-51fe-45af-bc2a-b8a2c4eb1cc9 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:01.853978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68618d65-51fe-45af-bc2a-b8a2c4eb1cc9 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:01.854253 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68618d65-51fe-45af-bc2a-b8a2c4eb1cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:01.872743 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-68618d65-51fe-45af-bc2a-b8a2c4eb1cc9 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:01.873943 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-68618d65-51fe-45af-bc2a-b8a2c4eb1cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:01.925477 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-465f2715-01d4-4a8c-9d59-b8b8f1957de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '988f04d1055943369671c334f5199399', 'request_id': 'req-465f2715-01d4-4a8c-9d59-b8b8f1957de5'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:01.942893 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1003/1984] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:01.951961 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68618d65-51fe-45af-bc2a-b8a2c4eb1cc9 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:01.953472 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-68618d65-51fe-45af-bc2a-b8a2c4eb1cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:02.024977 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-465f2715-01d4-4a8c-9d59-b8b8f1957de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '988f04d1055943369671c334f5199399', 'request_id': 'req-465f2715-01d4-4a8c-9d59-b8b8f1957de5'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:02.029640 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68618d65-51fe-45af-bc2a-b8a2c4eb1cc9 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:02.035056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-465f2715-01d4-4a8c-9d59-b8b8f1957de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '988f04d1055943369671c334f5199399', 'request_id': 'req-465f2715-01d4-4a8c-9d59-b8b8f1957de5'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:02.055991 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-465f2715-01d4-4a8c-9d59-b8b8f1957de5 admin admin] The token cache is being invalidate because project 988f04d1055943369671c334f5199399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:02.056287 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-465f2715-01d4-4a8c-9d59-b8b8f1957de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:02.057003 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-465f2715-01d4-4a8c-9d59-b8b8f1957de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:02.063155 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 982/1985] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:01 2022] DELETE /identity/v3/projects/988f04d1055943369671c334f5199399 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:02.066628 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd23d9-b60d-4d51-be7f-ebe0b37eb7a3 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:02.067115 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd23d9-b60d-4d51-be7f-ebe0b37eb7a3 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:02.074389 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd23d9-b60d-4d51-be7f-ebe0b37eb7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:02.090726 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-71fd23d9-b60d-4d51-be7f-ebe0b37eb7a3 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:02.091975 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-71fd23d9-b60d-4d51-be7f-ebe0b37eb7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:02.130608 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb1c1f-4255-4b74-a167-2e06321722dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:02.131720 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb1c1f-4255-4b74-a167-2e06321722dd service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:02.131720 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb1c1f-4255-4b74-a167-2e06321722dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:02.132045 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb1c1f-4255-4b74-a167-2e06321722dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:02.135311 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-c8fb1c1f-4255-4b74-a167-2e06321722dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:02.161579 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 983/1986] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:02.166034 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd23d9-b60d-4d51-be7f-ebe0b37eb7a3 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:02.167644 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-71fd23d9-b60d-4d51-be7f-ebe0b37eb7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:02.225983 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb1c1f-4255-4b74-a167-2e06321722dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:02.228524 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb1c1f-4255-4b74-a167-2e06321722dd service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:02.239478 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1004/1987] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:20:02.240828 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f53ef2-e8cf-497c-8b21-fef7739b0406 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:02.241116 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f53ef2-e8cf-497c-8b21-fef7739b0406 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:02.241393 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f53ef2-e8cf-497c-8b21-fef7739b0406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:02.255673 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd23d9-b60d-4d51-be7f-ebe0b37eb7a3 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:02.259817 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2529a3-40eb-4ab7-9d14-6a666d0efdcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:02.260563 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2529a3-40eb-4ab7-9d14-6a666d0efdcb service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:02.261140 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2529a3-40eb-4ab7-9d14-6a666d0efdcb service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:02.261410 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2529a3-40eb-4ab7-9d14-6a666d0efdcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:02.263210 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-98f53ef2-e8cf-497c-8b21-fef7739b0406 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:02.263520 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-fc2529a3-40eb-4ab7-9d14-6a666d0efdcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:02.265141 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-98f53ef2-e8cf-497c-8b21-fef7739b0406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:02.288207 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1005/1988] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:02.293144 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f53ef2-e8cf-497c-8b21-fef7739b0406 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:02.305788 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f53ef2-e8cf-497c-8b21-fef7739b0406 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:02.312706 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c03d5-e031-4408-a444-8fb70d1d6cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:02.312706 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c03d5-e031-4408-a444-8fb70d1d6cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:02.312706 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c03d5-e031-4408-a444-8fb70d1d6cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:02.313015 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c03d5-e031-4408-a444-8fb70d1d6cc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:02.313843 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c03d5-e031-4408-a444-8fb70d1d6cc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:20:02.314235 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c03d5-e031-4408-a444-8fb70d1d6cc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:02.316375 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c03d5-e031-4408-a444-8fb70d1d6cc9 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:02.336361 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1006/1989] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:20:02.340723 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c03d5-e031-4408-a444-8fb70d1d6cc9 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:02.365382 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c03d5-e031-4408-a444-8fb70d1d6cc9 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:02.366431 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2529a3-40eb-4ab7-9d14-6a666d0efdcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:02.368142 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2529a3-40eb-4ab7-9d14-6a666d0efdcb service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:02.381317 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db53ac-74fe-4259-b5fc-34db44989d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:02.382027 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 984/1990] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:02.382525 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db53ac-74fe-4259-b5fc-34db44989d96 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:02.383145 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db53ac-74fe-4259-b5fc-34db44989d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:02.383812 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db53ac-74fe-4259-b5fc-34db44989d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:02.384838 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db53ac-74fe-4259-b5fc-34db44989d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:02.387380 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db53ac-74fe-4259-b5fc-34db44989d96 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:02.503197 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1007/1991] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:02 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:02.507910 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2529a3-40eb-4ab7-9d14-6a666d0efdcb service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:02.518456 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2529a3-40eb-4ab7-9d14-6a666d0efdcb service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:02.578246 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6531dfa-e00e-4ce6-9a6a-690ed4ecb663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:02.578995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6531dfa-e00e-4ce6-9a6a-690ed4ecb663 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:02.579280 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6531dfa-e00e-4ce6-9a6a-690ed4ecb663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:02.579610 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6531dfa-e00e-4ce6-9a6a-690ed4ecb663 admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:02.580322 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6531dfa-e00e-4ce6-9a6a-690ed4ecb663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:02.582401 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6531dfa-e00e-4ce6-9a6a-690ed4ecb663 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:02.733461 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 985/1992] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:02 2022] POST /identity/v3/users => generated 290 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:02.734978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db53ac-74fe-4259-b5fc-34db44989d96 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:02.746826 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db53ac-74fe-4259-b5fc-34db44989d96 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:02.751913 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549ac61-cd0d-4bae-96fd-3c9db079a5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:02.752600 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549ac61-cd0d-4bae-96fd-3c9db079a5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:02.752920 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549ac61-cd0d-4bae-96fd-3c9db079a5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:02.753326 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549ac61-cd0d-4bae-96fd-3c9db079a5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:02.754138 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549ac61-cd0d-4bae-96fd-3c9db079a5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:02.756422 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549ac61-cd0d-4bae-96fd-3c9db079a5f8 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:02.767398 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1008/1993] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:02.773172 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6531dfa-e00e-4ce6-9a6a-690ed4ecb663 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:02.784111 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6531dfa-e00e-4ce6-9a6a-690ed4ecb663 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:02.790403 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599851dc-7c18-4c46-a7ec-2d97d4919a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:02.791066 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599851dc-7c18-4c46-a7ec-2d97d4919a1f admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:02.791345 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599851dc-7c18-4c46-a7ec-2d97d4919a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:02.791722 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599851dc-7c18-4c46-a7ec-2d97d4919a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:02.792472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599851dc-7c18-4c46-a7ec-2d97d4919a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:02.794174 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599851dc-7c18-4c46-a7ec-2d97d4919a1f admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:02.809767 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 986/1994] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:02.811820 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549ac61-cd0d-4bae-96fd-3c9db079a5f8 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:02.823776 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549ac61-cd0d-4bae-96fd-3c9db079a5f8 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:02.830235 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac946b1a-5b2f-4254-b3f1-78ec5b37f232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:02.831135 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac946b1a-5b2f-4254-b3f1-78ec5b37f232 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:02.831417 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac946b1a-5b2f-4254-b3f1-78ec5b37f232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:02.831694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac946b1a-5b2f-4254-b3f1-78ec5b37f232 admin admin] PATH_INFO: `/v3/projects/40a8637d47d046a4bc80e4bfc3a6824b/users/ec303fded871454d863b88d5c169b045/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:02.847870 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599851dc-7c18-4c46-a7ec-2d97d4919a1f admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:02.851551 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac946b1a-5b2f-4254-b3f1-78ec5b37f232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a8637d47d046a4bc80e4bfc3a6824b, user_id=ec303fded871454d863b88d5c169b045, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:02.851685 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-599851dc-7c18-4c46-a7ec-2d97d4919a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:02.852287 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac946b1a-5b2f-4254-b3f1-78ec5b37f232 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:02.865559 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599851dc-7c18-4c46-a7ec-2d97d4919a1f admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:02.870615 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47cc37-6001-448d-b6b3-668f4c9b8045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:02.871491 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47cc37-6001-448d-b6b3-668f4c9b8045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:02.871774 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47cc37-6001-448d-b6b3-668f4c9b8045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:02.872046 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47cc37-6001-448d-b6b3-668f4c9b8045 admin admin] PATH_INFO: `/v3/projects/80454f415e0f4c1b83fc17b59fc9ba0f` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:02.873385 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd47cc37-6001-448d-b6b3-668f4c9b8045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80454f415e0f4c1b83fc17b59fc9ba0f)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:02.875477 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd47cc37-6001-448d-b6b3-668f4c9b8045 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:02.938589 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1009/1995] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:02 2022] PUT /identity/v3/projects/40a8637d47d046a4bc80e4bfc3a6824b/users/ec303fded871454d863b88d5c169b045/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:02.949930 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee1882-1495-4a97-856c-3b51391a29d2 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:02.950224 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee1882-1495-4a97-856c-3b51391a29d2 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:02.950512 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee1882-1495-4a97-856c-3b51391a29d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:02.980390 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-00ee1882-1495-4a97-856c-3b51391a29d2 None None] MFA Rules not processed for user `ec303fded871454d863b88d5c169b045`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:02.981665 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-00ee1882-1495-4a97-856c-3b51391a29d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:03.040220 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-fd47cc37-6001-448d-b6b3-668f4c9b8045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80454f415e0f4c1b83fc17b59fc9ba0f', 'request_id': 'req-fd47cc37-6001-448d-b6b3-668f4c9b8045'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:03.056568 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1010/1996] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:03.061687 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee1882-1495-4a97-856c-3b51391a29d2 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:03.127077 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee1882-1495-4a97-856c-3b51391a29d2 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:03.162640 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-fd47cc37-6001-448d-b6b3-668f4c9b8045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80454f415e0f4c1b83fc17b59fc9ba0f', 'request_id': 'req-fd47cc37-6001-448d-b6b3-668f4c9b8045'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:03.170644 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-fd47cc37-6001-448d-b6b3-668f4c9b8045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80454f415e0f4c1b83fc17b59fc9ba0f', 'request_id': 'req-fd47cc37-6001-448d-b6b3-668f4c9b8045'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:03.183123 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-fd47cc37-6001-448d-b6b3-668f4c9b8045 admin admin] The token cache is being invalidate because project 80454f415e0f4c1b83fc17b59fc9ba0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:03.183465 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-fd47cc37-6001-448d-b6b3-668f4c9b8045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:03.184086 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-fd47cc37-6001-448d-b6b3-668f4c9b8045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:03.185824 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 987/1997] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:02 2022] DELETE /identity/v3/projects/80454f415e0f4c1b83fc17b59fc9ba0f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:03.191100 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8387529-8fd3-455c-803f-eacb26312284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:03.191287 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47cc37-6001-448d-b6b3-668f4c9b8045 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:03.192391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8387529-8fd3-455c-803f-eacb26312284 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:03.192814 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8387529-8fd3-455c-803f-eacb26312284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:03.193385 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8387529-8fd3-455c-803f-eacb26312284 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:03.193552 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-fd47cc37-6001-448d-b6b3-668f4c9b8045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:03.194111 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8387529-8fd3-455c-803f-eacb26312284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:03.196522 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8387529-8fd3-455c-803f-eacb26312284 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:03.207558 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47cc37-6001-448d-b6b3-668f4c9b8045 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:03.213009 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03b086-ac90-4372-b201-f11738262d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:03.213881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03b086-ac90-4372-b201-f11738262d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:03.214161 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03b086-ac90-4372-b201-f11738262d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:03.214436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03b086-ac90-4372-b201-f11738262d58 admin admin] PATH_INFO: `/v3/users/af18695d03c7447aba2c0def016a2147` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:03.215648 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03b086-ac90-4372-b201-f11738262d58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af18695d03c7447aba2c0def016a2147)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:03.217616 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03b086-ac90-4372-b201-f11738262d58 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:03.318364 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1011/1998] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:03 2022] POST /identity/v3/projects => generated 377 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:03.319441 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8387529-8fd3-455c-803f-eacb26312284 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:03.323264 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a8387529-8fd3-455c-803f-eacb26312284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:03.421774 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8387529-8fd3-455c-803f-eacb26312284 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:03.432816 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-eb03b086-ac90-4372-b201-f11738262d58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af18695d03c7447aba2c0def016a2147'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:03.433851 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56025795-7e9d-4fee-893e-107e737da261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:03.436763 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56025795-7e9d-4fee-893e-107e737da261 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:03.437243 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56025795-7e9d-4fee-893e-107e737da261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:03.437756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56025795-7e9d-4fee-893e-107e737da261 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:03.439003 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56025795-7e9d-4fee-893e-107e737da261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:03.443083 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56025795-7e9d-4fee-893e-107e737da261 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:03.451340 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-eb03b086-ac90-4372-b201-f11738262d58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af18695d03c7447aba2c0def016a2147'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:03.453270 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-eb03b086-ac90-4372-b201-f11738262d58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af18695d03c7447aba2c0def016a2147'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:03.543345 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-eb03b086-ac90-4372-b201-f11738262d58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af18695d03c7447aba2c0def016a2147'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:03.544869 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-eb03b086-ac90-4372-b201-f11738262d58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af18695d03c7447aba2c0def016a2147'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:03.550695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1012/1999] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:03 2022] POST /identity/v3/users => generated 295 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:03.554815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56025795-7e9d-4fee-893e-107e737da261 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:03.556894 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-56025795-7e9d-4fee-893e-107e737da261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:03.560052 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 988/2000] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:03 2022] DELETE /identity/v3/users/af18695d03c7447aba2c0def016a2147 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:03.570029 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56025795-7e9d-4fee-893e-107e737da261 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:03.650693 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b64680-f8dc-4b46-9ddc-7174f6a229bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:03.651391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b64680-f8dc-4b46-9ddc-7174f6a229bd admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:03.651978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b64680-f8dc-4b46-9ddc-7174f6a229bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:03.652265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b64680-f8dc-4b46-9ddc-7174f6a229bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:03.653060 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b64680-f8dc-4b46-9ddc-7174f6a229bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:03.654680 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b64680-f8dc-4b46-9ddc-7174f6a229bd admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:03.666422 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1013/2001] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:20:03.670562 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03b086-ac90-4372-b201-f11738262d58 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:03.683281 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03b086-ac90-4372-b201-f11738262d58 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:03.691603 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad10ea-1c02-4efb-83f1-ee54cbec2b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:03.692468 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad10ea-1c02-4efb-83f1-ee54cbec2b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:03.692993 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad10ea-1c02-4efb-83f1-ee54cbec2b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:03.697119 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad10ea-1c02-4efb-83f1-ee54cbec2b2f admin admin] PATH_INFO: `/v3/projects/7acf5af55de648068dc7e0542ee35d7c/users/073a20adde9e41f299b19912ef83874e/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:03.716604 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad10ea-1c02-4efb-83f1-ee54cbec2b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7acf5af55de648068dc7e0542ee35d7c, user_id=073a20adde9e41f299b19912ef83874e, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:03.720934 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad10ea-1c02-4efb-83f1-ee54cbec2b2f admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:03.826162 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 989/2002] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:03 2022] PUT /identity/v3/projects/7acf5af55de648068dc7e0542ee35d7c/users/073a20adde9e41f299b19912ef83874e/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:03.830242 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b64680-f8dc-4b46-9ddc-7174f6a229bd admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:03.849288 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b64680-f8dc-4b46-9ddc-7174f6a229bd admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:03.934713 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f22d8c-8055-40fd-9734-cc8893fd7d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:03.936196 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f22d8c-8055-40fd-9734-cc8893fd7d1d admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:03.936488 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f22d8c-8055-40fd-9734-cc8893fd7d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:03.940416 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f22d8c-8055-40fd-9734-cc8893fd7d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:03.940416 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f22d8c-8055-40fd-9734-cc8893fd7d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:03.940416 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f22d8c-8055-40fd-9734-cc8893fd7d1d admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:03.950066 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1014/2003] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:03.954492 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad10ea-1c02-4efb-83f1-ee54cbec2b2f admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:03.965422 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad10ea-1c02-4efb-83f1-ee54cbec2b2f admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:03.970892 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809ab4c-afe8-4990-95fd-767881e7b8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:03.971868 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809ab4c-afe8-4990-95fd-767881e7b8f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:03.972611 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809ab4c-afe8-4990-95fd-767881e7b8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:03.973720 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809ab4c-afe8-4990-95fd-767881e7b8f4 admin admin] PATH_INFO: `/v3/projects/7acf5af55de648068dc7e0542ee35d7c/users/073a20adde9e41f299b19912ef83874e/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:03.976438 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809ab4c-afe8-4990-95fd-767881e7b8f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7acf5af55de648068dc7e0542ee35d7c, user_id=073a20adde9e41f299b19912ef83874e, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:03.979784 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809ab4c-afe8-4990-95fd-767881e7b8f4 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:03.991549 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 990/2004] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:03 2022] PUT /identity/v3/projects/7acf5af55de648068dc7e0542ee35d7c/users/073a20adde9e41f299b19912ef83874e/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:04.002677 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8288e-fb40-4ae5-a52f-eb6047f1a65c None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:04.002974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8288e-fb40-4ae5-a52f-eb6047f1a65c None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:04.003258 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8288e-fb40-4ae5-a52f-eb6047f1a65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:04.030011 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-6fe8288e-fb40-4ae5-a52f-eb6047f1a65c None None] MFA Rules not processed for user `073a20adde9e41f299b19912ef83874e`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:04.031246 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-6fe8288e-fb40-4ae5-a52f-eb6047f1a65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:04.095370 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809ab4c-afe8-4990-95fd-767881e7b8f4 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:04.097353 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c809ab4c-afe8-4990-95fd-767881e7b8f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:04.106987 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1015/2005] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:04.171816 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809ab4c-afe8-4990-95fd-767881e7b8f4 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:04.177105 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241c55b-f754-42d3-b9af-2fb1a93b3efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:04.178113 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241c55b-f754-42d3-b9af-2fb1a93b3efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:04.178386 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241c55b-f754-42d3-b9af-2fb1a93b3efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:04.178661 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241c55b-f754-42d3-b9af-2fb1a93b3efb admin admin] PATH_INFO: `/v3/projects/ec551366a8f14b91925ff24c15c66ab0` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:04.179862 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241c55b-f754-42d3-b9af-2fb1a93b3efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec551366a8f14b91925ff24c15c66ab0)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:04.181850 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241c55b-f754-42d3-b9af-2fb1a93b3efb admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:04.231175 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8288e-fb40-4ae5-a52f-eb6047f1a65c None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:04.232557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-6fe8288e-fb40-4ae5-a52f-eb6047f1a65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:04.290495 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8288e-fb40-4ae5-a52f-eb6047f1a65c None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:04.294203 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423f0dc-9979-4812-9d60-7d8a0130ce03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:04.294854 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423f0dc-9979-4812-9d60-7d8a0130ce03 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:04.295134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423f0dc-9979-4812-9d60-7d8a0130ce03 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:04.295409 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423f0dc-9979-4812-9d60-7d8a0130ce03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:04.305268 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423f0dc-9979-4812-9d60-7d8a0130ce03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:04.306755 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423f0dc-9979-4812-9d60-7d8a0130ce03 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:04.316870 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1016/2006] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:20:04.378488 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1241c55b-f754-42d3-b9af-2fb1a93b3efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec551366a8f14b91925ff24c15c66ab0', 'request_id': 'req-1241c55b-f754-42d3-b9af-2fb1a93b3efb'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:04.491846 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1241c55b-f754-42d3-b9af-2fb1a93b3efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec551366a8f14b91925ff24c15c66ab0', 'request_id': 'req-1241c55b-f754-42d3-b9af-2fb1a93b3efb'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:04.499366 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1241c55b-f754-42d3-b9af-2fb1a93b3efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec551366a8f14b91925ff24c15c66ab0', 'request_id': 'req-1241c55b-f754-42d3-b9af-2fb1a93b3efb'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:04.510401 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1241c55b-f754-42d3-b9af-2fb1a93b3efb admin admin] The token cache is being invalidate because project ec551366a8f14b91925ff24c15c66ab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:04.510689 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1241c55b-f754-42d3-b9af-2fb1a93b3efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:04.511353 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1241c55b-f754-42d3-b9af-2fb1a93b3efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:04.512926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 991/2007] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:04 2022] DELETE /identity/v3/projects/ec551366a8f14b91925ff24c15c66ab0 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:04.518277 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df49a89-2fea-4199-8b37-d8ba35b30340 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:04.518277 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df49a89-2fea-4199-8b37-d8ba35b30340 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:04.518552 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df49a89-2fea-4199-8b37-d8ba35b30340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:04.540897 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-9df49a89-2fea-4199-8b37-d8ba35b30340 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:04.546570 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9df49a89-2fea-4199-8b37-d8ba35b30340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:04.624224 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1017/2008] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:04.632515 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291422f4-e92e-42a6-a840-24c9b18b0879 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:04.632835 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291422f4-e92e-42a6-a840-24c9b18b0879 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:04.633312 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291422f4-e92e-42a6-a840-24c9b18b0879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:04.658441 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-291422f4-e92e-42a6-a840-24c9b18b0879 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:04.659513 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-291422f4-e92e-42a6-a840-24c9b18b0879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:04.667581 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 992/2009] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:04.671805 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df49a89-2fea-4199-8b37-d8ba35b30340 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:04.682786 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df49a89-2fea-4199-8b37-d8ba35b30340 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:04.689065 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2a991-59f1-4d12-83be-3cf98882541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:04.689569 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2a991-59f1-4d12-83be-3cf98882541a admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:04.689854 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2a991-59f1-4d12-83be-3cf98882541a admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:04.690134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2a991-59f1-4d12-83be-3cf98882541a admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:04.690871 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2a991-59f1-4d12-83be-3cf98882541a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:20:04.691183 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2a991-59f1-4d12-83be-3cf98882541a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:04.698847 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2a991-59f1-4d12-83be-3cf98882541a admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:04.716694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1018/2010] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:20:04.718512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291422f4-e92e-42a6-a840-24c9b18b0879 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:04.734174 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291422f4-e92e-42a6-a840-24c9b18b0879 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:04.739187 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b6bb6-ee42-4354-8026-3640ea956a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:04.739852 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b6bb6-ee42-4354-8026-3640ea956a47 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:04.740132 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b6bb6-ee42-4354-8026-3640ea956a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:04.740406 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b6bb6-ee42-4354-8026-3640ea956a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:04.741138 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b6bb6-ee42-4354-8026-3640ea956a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:04.743226 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b6bb6-ee42-4354-8026-3640ea956a47 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:04.876510 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 993/2011] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:04 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:04.881789 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2a991-59f1-4d12-83be-3cf98882541a admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:04.892113 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2a991-59f1-4d12-83be-3cf98882541a admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:04.947858 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf4ef1-c3ee-4bff-aa9a-f21921778e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:04.948521 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf4ef1-c3ee-4bff-aa9a-f21921778e5b admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:04.948840 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf4ef1-c3ee-4bff-aa9a-f21921778e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:04.949118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf4ef1-c3ee-4bff-aa9a-f21921778e5b admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:04.949836 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf4ef1-c3ee-4bff-aa9a-f21921778e5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:04.951750 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf4ef1-c3ee-4bff-aa9a-f21921778e5b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:05.105792 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1019/2012] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:04 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:05.110138 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b6bb6-ee42-4354-8026-3640ea956a47 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:05.121012 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b6bb6-ee42-4354-8026-3640ea956a47 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:05.125448 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f8ca8-9301-4d3d-8f83-105658bde09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:05.126102 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f8ca8-9301-4d3d-8f83-105658bde09a admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:05.126387 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f8ca8-9301-4d3d-8f83-105658bde09a admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:05.126665 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f8ca8-9301-4d3d-8f83-105658bde09a admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:05.127415 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f8ca8-9301-4d3d-8f83-105658bde09a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:05.129043 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f8ca8-9301-4d3d-8f83-105658bde09a admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:05.139568 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 994/2013] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:05.143389 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf4ef1-c3ee-4bff-aa9a-f21921778e5b admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:05.154382 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf4ef1-c3ee-4bff-aa9a-f21921778e5b admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:05.158934 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d54977-6531-4c4d-907b-80098b628055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:05.159583 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d54977-6531-4c4d-907b-80098b628055 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:05.159878 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d54977-6531-4c4d-907b-80098b628055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:05.160140 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d54977-6531-4c4d-907b-80098b628055 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:05.161452 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d54977-6531-4c4d-907b-80098b628055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:05.163110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d54977-6531-4c4d-907b-80098b628055 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:05.173113 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1020/2014] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:05.177914 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f8ca8-9301-4d3d-8f83-105658bde09a admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:05.187851 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f8ca8-9301-4d3d-8f83-105658bde09a admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:05.193160 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1e226-1b5c-4392-9ec7-2018ebc8302d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:05.194028 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1e226-1b5c-4392-9ec7-2018ebc8302d admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:05.194310 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1e226-1b5c-4392-9ec7-2018ebc8302d admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:05.194585 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1e226-1b5c-4392-9ec7-2018ebc8302d admin admin] PATH_INFO: `/v3/projects/33f2ab0932f54a2496f5a5a08c17f6e6/users/a007806f6c9e4acb8cb81cb575bc4951/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:05.210274 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1e226-1b5c-4392-9ec7-2018ebc8302d admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f2ab0932f54a2496f5a5a08c17f6e6, user_id=a007806f6c9e4acb8cb81cb575bc4951, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:05.213101 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1e226-1b5c-4392-9ec7-2018ebc8302d admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:05.292506 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 995/2015] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:05 2022] PUT /identity/v3/projects/33f2ab0932f54a2496f5a5a08c17f6e6/users/a007806f6c9e4acb8cb81cb575bc4951/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:05.307647 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fba2f6-d497-403a-9df3-d864bb0a6d74 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:05.308026 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fba2f6-d497-403a-9df3-d864bb0a6d74 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:05.308370 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fba2f6-d497-403a-9df3-d864bb0a6d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:05.337006 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-e9fba2f6-d497-403a-9df3-d864bb0a6d74 None None] MFA Rules not processed for user `a007806f6c9e4acb8cb81cb575bc4951`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:05.338242 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e9fba2f6-d497-403a-9df3-d864bb0a6d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:05.420465 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1021/2016] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:05.421402 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1e226-1b5c-4392-9ec7-2018ebc8302d admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:05.423138 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-e9a1e226-1b5c-4392-9ec7-2018ebc8302d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:05.424879 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fba2f6-d497-403a-9df3-d864bb0a6d74 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:05.492477 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fba2f6-d497-403a-9df3-d864bb0a6d74 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:05.493620 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1e226-1b5c-4392-9ec7-2018ebc8302d admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:05.497050 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec4cee-ec3d-4e5b-a9b2-f8991109fb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:05.497692 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec4cee-ec3d-4e5b-a9b2-f8991109fb69 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:05.497976 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec4cee-ec3d-4e5b-a9b2-f8991109fb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:05.498213 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11261d04-4c2f-4dad-8309-6558ce49d1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:05.498351 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec4cee-ec3d-4e5b-a9b2-f8991109fb69 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:05.498936 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec4cee-ec3d-4e5b-a9b2-f8991109fb69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:05.499077 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11261d04-4c2f-4dad-8309-6558ce49d1aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:05.499356 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11261d04-4c2f-4dad-8309-6558ce49d1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:05.499637 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11261d04-4c2f-4dad-8309-6558ce49d1aa admin admin] PATH_INFO: `/v3/users/19b2bcc7dae3482593ec5a299646c9c9` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:05.500869 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec4cee-ec3d-4e5b-a9b2-f8991109fb69 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:05.500975 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11261d04-4c2f-4dad-8309-6558ce49d1aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=19b2bcc7dae3482593ec5a299646c9c9)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:05.502786 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11261d04-4c2f-4dad-8309-6558ce49d1aa admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:05.591985 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1022/2017] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:05 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:05.592832 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec4cee-ec3d-4e5b-a9b2-f8991109fb69 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:05.594348 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-8eec4cee-ec3d-4e5b-a9b2-f8991109fb69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:05.657230 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec4cee-ec3d-4e5b-a9b2-f8991109fb69 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:05.662561 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ddd51-5988-44ab-81dd-3f5d0d5e53c1 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '073a20adde9e41f299b19912ef83874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7acf5af55de648068dc7e0542ee35d7c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:05.663297 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ddd51-5988-44ab-81dd-3f5d0d5e53c1 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:05.663654 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ddd51-5988-44ab-81dd-3f5d0d5e53c1 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:05.664002 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ddd51-5988-44ab-81dd-3f5d0d5e53c1 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:05.664837 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ddd51-5988-44ab-81dd-3f5d0d5e53c1 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:20:05.665152 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ddd51-5988-44ab-81dd-3f5d0d5e53c1 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:05.666773 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ddd51-5988-44ab-81dd-3f5d0d5e53c1 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:05.678885 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1023/2018] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:20:05.679782 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ddd51-5988-44ab-81dd-3f5d0d5e53c1 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:05.759048 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-11261d04-4c2f-4dad-8309-6558ce49d1aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19b2bcc7dae3482593ec5a299646c9c9'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:05.767762 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ddd51-5988-44ab-81dd-3f5d0d5e53c1 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:05.772947 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-11261d04-4c2f-4dad-8309-6558ce49d1aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19b2bcc7dae3482593ec5a299646c9c9'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:05.773082 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d934a09-e475-4b2a-9d96-6df968fd1b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:05.773734 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-11261d04-4c2f-4dad-8309-6558ce49d1aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19b2bcc7dae3482593ec5a299646c9c9'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:05.773838 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d934a09-e475-4b2a-9d96-6df968fd1b25 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:05.774118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d934a09-e475-4b2a-9d96-6df968fd1b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:05.774419 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d934a09-e475-4b2a-9d96-6df968fd1b25 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:05.775127 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d934a09-e475-4b2a-9d96-6df968fd1b25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:05.777111 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d934a09-e475-4b2a-9d96-6df968fd1b25 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:05.916803 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-11261d04-4c2f-4dad-8309-6558ce49d1aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19b2bcc7dae3482593ec5a299646c9c9'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:05.917689 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-11261d04-4c2f-4dad-8309-6558ce49d1aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19b2bcc7dae3482593ec5a299646c9c9'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:05.926856 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1024/2019] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:05 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:05.928210 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d934a09-e475-4b2a-9d96-6df968fd1b25 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:05.931871 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-7d934a09-e475-4b2a-9d96-6df968fd1b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:05.936276 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 996/2020] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:05 2022] DELETE /identity/v3/users/19b2bcc7dae3482593ec5a299646c9c9 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:05.937733 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11261d04-4c2f-4dad-8309-6558ce49d1aa admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:05.939659 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-11261d04-4c2f-4dad-8309-6558ce49d1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:05.953240 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d934a09-e475-4b2a-9d96-6df968fd1b25 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:06.008055 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11261d04-4c2f-4dad-8309-6558ce49d1aa admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:06.012619 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91972a0-6acf-4374-91bb-a2697c0a8172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:06.013485 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91972a0-6acf-4374-91bb-a2697c0a8172 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:06.013768 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91972a0-6acf-4374-91bb-a2697c0a8172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:06.014051 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91972a0-6acf-4374-91bb-a2697c0a8172 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:06.014778 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91972a0-6acf-4374-91bb-a2697c0a8172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:06.016397 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91972a0-6acf-4374-91bb-a2697c0a8172 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:06.017651 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb33bb-9b30-4f60-8470-03d77aabc6c5 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '073a20adde9e41f299b19912ef83874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7acf5af55de648068dc7e0542ee35d7c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:06.018345 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb33bb-9b30-4f60-8470-03d77aabc6c5 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:06.018630 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb33bb-9b30-4f60-8470-03d77aabc6c5 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:06.018903 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb33bb-9b30-4f60-8470-03d77aabc6c5 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:06.019597 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb33bb-9b30-4f60-8470-03d77aabc6c5 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:06.022052 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb33bb-9b30-4f60-8470-03d77aabc6c5 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:06.031100 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 997/2021] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:06.031100 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471f2d7-c0ad-4b10-9eb7-1382fe81a6d1 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:06.031100 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471f2d7-c0ad-4b10-9eb7-1382fe81a6d1 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:06.031100 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471f2d7-c0ad-4b10-9eb7-1382fe81a6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:06.054043 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-1471f2d7-c0ad-4b10-9eb7-1382fe81a6d1 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:06.060763 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1471f2d7-c0ad-4b10-9eb7-1382fe81a6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:06.063211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 998/2022] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:06.063982 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471f2d7-c0ad-4b10-9eb7-1382fe81a6d1 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:06.075947 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471f2d7-c0ad-4b10-9eb7-1382fe81a6d1 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:06.081009 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66fef0-8c8e-444d-b3b0-998f2e5a6a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:06.081682 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66fef0-8c8e-444d-b3b0-998f2e5a6a7f admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:06.082107 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66fef0-8c8e-444d-b3b0-998f2e5a6a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:06.083211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66fef0-8c8e-444d-b3b0-998f2e5a6a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:06.083948 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66fef0-8c8e-444d-b3b0-998f2e5a6a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:06.085863 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66fef0-8c8e-444d-b3b0-998f2e5a6a7f admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:06.096011 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 999/2023] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:06.098056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66fef0-8c8e-444d-b3b0-998f2e5a6a7f admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:06.099826 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6c66fef0-8c8e-444d-b3b0-998f2e5a6a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:06.154693 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66fef0-8c8e-444d-b3b0-998f2e5a6a7f admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:06.158431 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461c41b-c97d-4a70-a047-8e1ae225dee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:06.159066 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461c41b-c97d-4a70-a047-8e1ae225dee4 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:06.159345 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461c41b-c97d-4a70-a047-8e1ae225dee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:06.159625 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461c41b-c97d-4a70-a047-8e1ae225dee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:06.171198 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461c41b-c97d-4a70-a047-8e1ae225dee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:06.171358 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1025/2024] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:05 2022] POST /identity/v3/projects => generated 354 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:06.171358 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb33bb-9b30-4f60-8470-03d77aabc6c5 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:06.171873 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461c41b-c97d-4a70-a047-8e1ae225dee4 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:06.180037 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1000/2025] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:06.180870 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461c41b-c97d-4a70-a047-8e1ae225dee4 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:06.190350 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461c41b-c97d-4a70-a047-8e1ae225dee4 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:06.238049 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb33bb-9b30-4f60-8470-03d77aabc6c5 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:06.243544 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d712d27-772d-4175-96cf-a87b972f5e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:06.244581 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d712d27-772d-4175-96cf-a87b972f5e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:06.244894 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d712d27-772d-4175-96cf-a87b972f5e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:06.245172 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d712d27-772d-4175-96cf-a87b972f5e4a admin admin] PATH_INFO: `/v3/projects/7dfb1a770c6646ad8b7bd95d3237123f/users/8f75ab6c46c944d78489f0893d01de57/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:06.260547 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d712d27-772d-4175-96cf-a87b972f5e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dfb1a770c6646ad8b7bd95d3237123f, user_id=8f75ab6c46c944d78489f0893d01de57, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:06.261788 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66d207-48de-457d-b2cb-46b7bfadfa2d tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '073a20adde9e41f299b19912ef83874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7acf5af55de648068dc7e0542ee35d7c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:06.262875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d207-48de-457d-b2cb-46b7bfadfa2d tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:06.263269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d712d27-772d-4175-96cf-a87b972f5e4a admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:06.263407 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d207-48de-457d-b2cb-46b7bfadfa2d tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:06.263846 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d207-48de-457d-b2cb-46b7bfadfa2d tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:06.264688 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66d207-48de-457d-b2cb-46b7bfadfa2d tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:20:06.265101 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66d207-48de-457d-b2cb-46b7bfadfa2d tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:06.267637 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66d207-48de-457d-b2cb-46b7bfadfa2d tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:06.280317 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1001/2026] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:20:06.314992 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66d207-48de-457d-b2cb-46b7bfadfa2d tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:06.326120 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66d207-48de-457d-b2cb-46b7bfadfa2d tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:06.330807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51361bb2-9890-4caf-96ee-eaf5fd4c1e77 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '073a20adde9e41f299b19912ef83874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7acf5af55de648068dc7e0542ee35d7c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:06.331691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51361bb2-9890-4caf-96ee-eaf5fd4c1e77 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:06.331975 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51361bb2-9890-4caf-96ee-eaf5fd4c1e77 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:06.332961 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51361bb2-9890-4caf-96ee-eaf5fd4c1e77 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] PATH_INFO: `/v3/projects/effac6a9bfda411aa6d1db3c678a413d` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:06.334298 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51361bb2-9890-4caf-96ee-eaf5fd4c1e77 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] RBAC: Authorizing `identity:delete_project(project_id=effac6a9bfda411aa6d1db3c678a413d)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:06.336208 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51361bb2-9890-4caf-96ee-eaf5fd4c1e77 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:06.425722 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1026/2027] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:06 2022] PUT /identity/v3/projects/7dfb1a770c6646ad8b7bd95d3237123f/users/8f75ab6c46c944d78489f0893d01de57/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:06.437659 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9bdff-90e4-483b-89ca-bde72df4f24a None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:06.438026 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9bdff-90e4-483b-89ca-bde72df4f24a None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:06.440757 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9bdff-90e4-483b-89ca-bde72df4f24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:06.475704 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-dce9bdff-90e4-483b-89ca-bde72df4f24a None None] MFA Rules not processed for user `8f75ab6c46c944d78489f0893d01de57`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:06.477185 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-dce9bdff-90e4-483b-89ca-bde72df4f24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:06.543874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-51361bb2-9890-4caf-96ee-eaf5fd4c1e77 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'effac6a9bfda411aa6d1db3c678a413d', 'request_id': 'req-51361bb2-9890-4caf-96ee-eaf5fd4c1e77'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:06.559644 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1027/2028] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:06.564169 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9bdff-90e4-483b-89ca-bde72df4f24a None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:06.625350 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9bdff-90e4-483b-89ca-bde72df4f24a None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:06.657127 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-51361bb2-9890-4caf-96ee-eaf5fd4c1e77 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'effac6a9bfda411aa6d1db3c678a413d', 'request_id': 'req-51361bb2-9890-4caf-96ee-eaf5fd4c1e77'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:06.664777 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-51361bb2-9890-4caf-96ee-eaf5fd4c1e77 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'effac6a9bfda411aa6d1db3c678a413d', 'request_id': 'req-51361bb2-9890-4caf-96ee-eaf5fd4c1e77'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:06.677801 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-51361bb2-9890-4caf-96ee-eaf5fd4c1e77 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] The token cache is being invalidate because project effac6a9bfda411aa6d1db3c678a413d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:06.685765 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d83e6-e4d4-43c4-8d70-abfcfb02f60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:06.686431 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d83e6-e4d4-43c4-8d70-abfcfb02f60d admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:06.686711 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d83e6-e4d4-43c4-8d70-abfcfb02f60d admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:06.686988 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d83e6-e4d4-43c4-8d70-abfcfb02f60d admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:06.687685 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-51361bb2-9890-4caf-96ee-eaf5fd4c1e77 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:06.687824 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d83e6-e4d4-43c4-8d70-abfcfb02f60d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:06.688390 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-51361bb2-9890-4caf-96ee-eaf5fd4c1e77 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:06.689637 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d83e6-e4d4-43c4-8d70-abfcfb02f60d admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:06.696491 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1002/2029] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:06 2022] DELETE /identity/v3/projects/effac6a9bfda411aa6d1db3c678a413d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:06.696491 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51361bb2-9890-4caf-96ee-eaf5fd4c1e77 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:06.696491 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-51361bb2-9890-4caf-96ee-eaf5fd4c1e77 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:06.707995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51361bb2-9890-4caf-96ee-eaf5fd4c1e77 tempest-VolumeQuotaClassesTest-77464174 tempest-VolumeQuotaClassesTest-77464174-project-admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:06.713074 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce73d72-174b-4432-8011-4227390c9327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:06.713932 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce73d72-174b-4432-8011-4227390c9327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:06.714214 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce73d72-174b-4432-8011-4227390c9327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:06.714493 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce73d72-174b-4432-8011-4227390c9327 admin admin] PATH_INFO: `/v3/projects/81767ab29cbc4a21a0844927f7cd9a2a` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:06.715667 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce73d72-174b-4432-8011-4227390c9327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81767ab29cbc4a21a0844927f7cd9a2a)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:06.717631 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce73d72-174b-4432-8011-4227390c9327 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:06.785217 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1028/2030] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:06 2022] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:06.789602 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d83e6-e4d4-43c4-8d70-abfcfb02f60d admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:06.791995 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-6b1d83e6-e4d4-43c4-8d70-abfcfb02f60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:06.860909 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d83e6-e4d4-43c4-8d70-abfcfb02f60d admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:06.866617 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7d297-9291-47f4-a8e3-9a0f4338332e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:06.867701 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7d297-9291-47f4-a8e3-9a0f4338332e admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:06.867701 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7d297-9291-47f4-a8e3-9a0f4338332e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:06.867874 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7d297-9291-47f4-a8e3-9a0f4338332e admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:06.868573 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7d297-9291-47f4-a8e3-9a0f4338332e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:06.870972 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7d297-9291-47f4-a8e3-9a0f4338332e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:06.905405 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-2ce73d72-174b-4432-8011-4227390c9327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81767ab29cbc4a21a0844927f7cd9a2a', 'request_id': 'req-2ce73d72-174b-4432-8011-4227390c9327'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:07.013558 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-2ce73d72-174b-4432-8011-4227390c9327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81767ab29cbc4a21a0844927f7cd9a2a', 'request_id': 'req-2ce73d72-174b-4432-8011-4227390c9327'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:07.020293 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-2ce73d72-174b-4432-8011-4227390c9327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81767ab29cbc4a21a0844927f7cd9a2a', 'request_id': 'req-2ce73d72-174b-4432-8011-4227390c9327'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:07.023274 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1029/2031] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:06 2022] POST /identity/v3/users => generated 295 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:07.025164 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7d297-9291-47f4-a8e3-9a0f4338332e admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:07.033093 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-2ce73d72-174b-4432-8011-4227390c9327 admin admin] The token cache is being invalidate because project 81767ab29cbc4a21a0844927f7cd9a2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:07.033818 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-2ce73d72-174b-4432-8011-4227390c9327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:07.034797 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-2ce73d72-174b-4432-8011-4227390c9327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:07.035985 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7d297-9291-47f4-a8e3-9a0f4338332e admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:07.038037 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1003/2032] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:06 2022] DELETE /identity/v3/projects/81767ab29cbc4a21a0844927f7cd9a2a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:07.042699 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce73d72-174b-4432-8011-4227390c9327 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:07.045115 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-2ce73d72-174b-4432-8011-4227390c9327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:07.103008 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a5c8d-b48d-47af-a997-cc98f2c648d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:07.104024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a5c8d-b48d-47af-a997-cc98f2c648d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:07.104372 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a5c8d-b48d-47af-a997-cc98f2c648d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:07.104751 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a5c8d-b48d-47af-a997-cc98f2c648d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:07.105696 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a5c8d-b48d-47af-a997-cc98f2c648d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:07.107366 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a5c8d-b48d-47af-a997-cc98f2c648d9 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:07.122403 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1030/2033] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:20:07.124058 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a5c8d-b48d-47af-a997-cc98f2c648d9 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:07.126589 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-1c1a5c8d-b48d-47af-a997-cc98f2c648d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:07.127957 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce73d72-174b-4432-8011-4227390c9327 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:07.133823 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b111a-33e2-42fe-ad0d-465cf5d0e52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:07.134695 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b111a-33e2-42fe-ad0d-465cf5d0e52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:07.135007 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b111a-33e2-42fe-ad0d-465cf5d0e52a admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:07.135284 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b111a-33e2-42fe-ad0d-465cf5d0e52a admin admin] PATH_INFO: `/v3/users/b9a546069666456e92edbbe199d35865` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:07.136489 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b111a-33e2-42fe-ad0d-465cf5d0e52a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9a546069666456e92edbbe199d35865)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:07.138672 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b111a-33e2-42fe-ad0d-465cf5d0e52a admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:07.142552 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a5c8d-b48d-47af-a997-cc98f2c648d9 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:07.148065 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b3cff-fb4f-4677-ba14-37eeeff72486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:07.149121 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b3cff-fb4f-4677-ba14-37eeeff72486 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:07.149498 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b3cff-fb4f-4677-ba14-37eeeff72486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:07.149975 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b3cff-fb4f-4677-ba14-37eeeff72486 admin admin] PATH_INFO: `/v3/projects/50f2f77cca1a49afa17bd231d267c584/users/a42f54c3308b45eeab216a15cbe15a91/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:07.165049 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b3cff-fb4f-4677-ba14-37eeeff72486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f2f77cca1a49afa17bd231d267c584, user_id=a42f54c3308b45eeab216a15cbe15a91, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:07.167764 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b3cff-fb4f-4677-ba14-37eeeff72486 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:07.298153 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1031/2034] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:07 2022] PUT /identity/v3/projects/50f2f77cca1a49afa17bd231d267c584/users/a42f54c3308b45eeab216a15cbe15a91/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:07.302794 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b3cff-fb4f-4677-ba14-37eeeff72486 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:07.376330 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b3cff-fb4f-4677-ba14-37eeeff72486 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:07.383735 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d731f3-ba0a-4f94-a5a4-746b626d803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:07.384489 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d731f3-ba0a-4f94-a5a4-746b626d803e admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:07.384986 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d731f3-ba0a-4f94-a5a4-746b626d803e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:07.385851 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d731f3-ba0a-4f94-a5a4-746b626d803e admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:07.386169 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d731f3-ba0a-4f94-a5a4-746b626d803e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:07.387971 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d731f3-ba0a-4f94-a5a4-746b626d803e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:07.398862 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1032/2035] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:07.402709 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d731f3-ba0a-4f94-a5a4-746b626d803e admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:07.413981 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d731f3-ba0a-4f94-a5a4-746b626d803e admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:07.419251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-6b6b111a-33e2-42fe-ad0d-465cf5d0e52a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9a546069666456e92edbbe199d35865'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:07.419728 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff70c7a-13a3-4138-9c0d-25e7cb65f842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:07.420384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff70c7a-13a3-4138-9c0d-25e7cb65f842 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:07.420897 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff70c7a-13a3-4138-9c0d-25e7cb65f842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:07.421307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff70c7a-13a3-4138-9c0d-25e7cb65f842 admin admin] PATH_INFO: `/v3/projects/50f2f77cca1a49afa17bd231d267c584/users/a42f54c3308b45eeab216a15cbe15a91/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:07.423546 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff70c7a-13a3-4138-9c0d-25e7cb65f842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f2f77cca1a49afa17bd231d267c584, user_id=a42f54c3308b45eeab216a15cbe15a91, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:07.426583 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff70c7a-13a3-4138-9c0d-25e7cb65f842 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:07.433072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-6b6b111a-33e2-42fe-ad0d-465cf5d0e52a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9a546069666456e92edbbe199d35865'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:07.433878 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-6b6b111a-33e2-42fe-ad0d-465cf5d0e52a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9a546069666456e92edbbe199d35865'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:07.439321 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1033/2036] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:07 2022] PUT /identity/v3/projects/50f2f77cca1a49afa17bd231d267c584/users/a42f54c3308b45eeab216a15cbe15a91/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:07.457831 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3772c-a625-42f2-9e94-e47609cbf07e None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:07.458448 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3772c-a625-42f2-9e94-e47609cbf07e None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:07.459205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3772c-a625-42f2-9e94-e47609cbf07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:07.487654 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-7dd3772c-a625-42f2-9e94-e47609cbf07e None None] MFA Rules not processed for user `a42f54c3308b45eeab216a15cbe15a91`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:07.489010 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-7dd3772c-a625-42f2-9e94-e47609cbf07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:07.539140 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-6b6b111a-33e2-42fe-ad0d-465cf5d0e52a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9a546069666456e92edbbe199d35865'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:07.539845 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-6b6b111a-33e2-42fe-ad0d-465cf5d0e52a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9a546069666456e92edbbe199d35865'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:07.552513 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1004/2037] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:07 2022] DELETE /identity/v3/users/b9a546069666456e92edbbe199d35865 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:07.553406 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b111a-33e2-42fe-ad0d-465cf5d0e52a admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:07.554800 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6b6b111a-33e2-42fe-ad0d-465cf5d0e52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:07.570645 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1034/2038] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:07.583721 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3772c-a625-42f2-9e94-e47609cbf07e None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:07.585379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-7dd3772c-a625-42f2-9e94-e47609cbf07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:07.628075 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b111a-33e2-42fe-ad0d-465cf5d0e52a admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:07.633750 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac34d16-65dc-407f-bcd4-62ca7dc43fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:07.634698 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac34d16-65dc-407f-bcd4-62ca7dc43fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:07.634916 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac34d16-65dc-407f-bcd4-62ca7dc43fda admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:07.635592 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac34d16-65dc-407f-bcd4-62ca7dc43fda admin admin] PATH_INFO: `/v3/users/ec303fded871454d863b88d5c169b045` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:07.636450 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac34d16-65dc-407f-bcd4-62ca7dc43fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec303fded871454d863b88d5c169b045)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:07.638949 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac34d16-65dc-407f-bcd4-62ca7dc43fda admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:07.665068 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3772c-a625-42f2-9e94-e47609cbf07e None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:07.712841 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f5b30-067f-47c3-b4d3-f88eb346efc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:07.713517 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f5b30-067f-47c3-b4d3-f88eb346efc7 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:07.713827 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f5b30-067f-47c3-b4d3-f88eb346efc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:07.714100 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f5b30-067f-47c3-b4d3-f88eb346efc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:07.778112 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f5b30-067f-47c3-b4d3-f88eb346efc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:07.779617 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f5b30-067f-47c3-b4d3-f88eb346efc7 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:07.793658 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1035/2039] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:20:07.794398 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f5b30-067f-47c3-b4d3-f88eb346efc7 service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:07.796680 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-269f5b30-067f-47c3-b4d3-f88eb346efc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:07.815914 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f5b30-067f-47c3-b4d3-f88eb346efc7 service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:07.822289 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151e93e-2e30-4a45-9050-b9f55f673033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:07.823600 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151e93e-2e30-4a45-9050-b9f55f673033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:07.823909 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151e93e-2e30-4a45-9050-b9f55f673033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:07.824369 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151e93e-2e30-4a45-9050-b9f55f673033 admin admin] PATH_INFO: `/v3/users/8eefbc5ad0b94a8db2878c8e45a2a3e8` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:07.825600 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151e93e-2e30-4a45-9050-b9f55f673033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eefbc5ad0b94a8db2878c8e45a2a3e8)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:07.827563 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151e93e-2e30-4a45-9050-b9f55f673033 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:07.889807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7ac34d16-65dc-407f-bcd4-62ca7dc43fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec303fded871454d863b88d5c169b045'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:07.901757 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7ac34d16-65dc-407f-bcd4-62ca7dc43fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec303fded871454d863b88d5c169b045'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:07.902565 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7ac34d16-65dc-407f-bcd4-62ca7dc43fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec303fded871454d863b88d5c169b045'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.011536 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7ac34d16-65dc-407f-bcd4-62ca7dc43fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec303fded871454d863b88d5c169b045'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.012102 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7ac34d16-65dc-407f-bcd4-62ca7dc43fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec303fded871454d863b88d5c169b045'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.027120 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1005/2040] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:07 2022] DELETE /identity/v3/users/ec303fded871454d863b88d5c169b045 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:08.028099 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac34d16-65dc-407f-bcd4-62ca7dc43fda admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:08.029486 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7ac34d16-65dc-407f-bcd4-62ca7dc43fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:08.094284 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac34d16-65dc-407f-bcd4-62ca7dc43fda admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:08.099443 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5a228-eee7-4f86-bc43-d00cb46f32df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:08.100302 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5a228-eee7-4f86-bc43-d00cb46f32df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:08.100580 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5a228-eee7-4f86-bc43-d00cb46f32df admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:08.100883 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5a228-eee7-4f86-bc43-d00cb46f32df admin admin] PATH_INFO: `/v3/users/d1bbab80576c4e12948e6ef7fb8327b8` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:08.102058 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5a228-eee7-4f86-bc43-d00cb46f32df admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1bbab80576c4e12948e6ef7fb8327b8)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:08.104268 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5a228-eee7-4f86-bc43-d00cb46f32df admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:08.118166 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9151e93e-2e30-4a45-9050-b9f55f673033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eefbc5ad0b94a8db2878c8e45a2a3e8'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.130392 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9151e93e-2e30-4a45-9050-b9f55f673033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eefbc5ad0b94a8db2878c8e45a2a3e8'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.131186 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9151e93e-2e30-4a45-9050-b9f55f673033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eefbc5ad0b94a8db2878c8e45a2a3e8'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.131805 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9151e93e-2e30-4a45-9050-b9f55f673033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eefbc5ad0b94a8db2878c8e45a2a3e8'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.138402 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-9151e93e-2e30-4a45-9050-b9f55f673033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eefbc5ad0b94a8db2878c8e45a2a3e8'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.216830 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1036/2041] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:07 2022] DELETE /identity/v3/users/8eefbc5ad0b94a8db2878c8e45a2a3e8 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:08.217663 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151e93e-2e30-4a45-9050-b9f55f673033 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:08.218962 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9151e93e-2e30-4a45-9050-b9f55f673033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:08.286406 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151e93e-2e30-4a45-9050-b9f55f673033 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:08.291320 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a69c4e-f6a1-466e-8068-4f7a2b918d07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:08.291974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a69c4e-f6a1-466e-8068-4f7a2b918d07 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:08.292399 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a69c4e-f6a1-466e-8068-4f7a2b918d07 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:08.292840 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a69c4e-f6a1-466e-8068-4f7a2b918d07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:08.295279 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-06a69c4e-f6a1-466e-8068-4f7a2b918d07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:08.333789 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-51d5a228-eee7-4f86-bc43-d00cb46f32df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1bbab80576c4e12948e6ef7fb8327b8'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.348435 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-51d5a228-eee7-4f86-bc43-d00cb46f32df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1bbab80576c4e12948e6ef7fb8327b8'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.351095 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-51d5a228-eee7-4f86-bc43-d00cb46f32df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1bbab80576c4e12948e6ef7fb8327b8'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.374990 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a69c4e-f6a1-466e-8068-4f7a2b918d07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:08.376474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a69c4e-f6a1-466e-8068-4f7a2b918d07 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:08.386939 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1037/2042] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:08.387892 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a69c4e-f6a1-466e-8068-4f7a2b918d07 service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:08.389274 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-06a69c4e-f6a1-466e-8068-4f7a2b918d07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:08.439679 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-51d5a228-eee7-4f86-bc43-d00cb46f32df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1bbab80576c4e12948e6ef7fb8327b8'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.440294 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-51d5a228-eee7-4f86-bc43-d00cb46f32df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1bbab80576c4e12948e6ef7fb8327b8'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.454349 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1006/2043] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:08 2022] DELETE /identity/v3/users/d1bbab80576c4e12948e6ef7fb8327b8 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:08.458121 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562b630-4400-401c-9de7-c37b3dc26182 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:08.458230 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a69c4e-f6a1-466e-8068-4f7a2b918d07 service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:08.458361 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562b630-4400-401c-9de7-c37b3dc26182 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:08.458361 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562b630-4400-401c-9de7-c37b3dc26182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:08.474021 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-1562b630-4400-401c-9de7-c37b3dc26182 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:08.475237 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1562b630-4400-401c-9de7-c37b3dc26182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:08.519366 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151642e6-94e3-4687-9d24-35fccc6642ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:08.521143 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151642e6-94e3-4687-9d24-35fccc6642ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:08.521706 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151642e6-94e3-4687-9d24-35fccc6642ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:08.522132 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151642e6-94e3-4687-9d24-35fccc6642ca admin admin] PATH_INFO: `/v3/projects/aa1d495214e34dbeac205f273ecbd929` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:08.523387 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151642e6-94e3-4687-9d24-35fccc6642ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa1d495214e34dbeac205f273ecbd929)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:08.525347 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151642e6-94e3-4687-9d24-35fccc6642ca admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:08.542442 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1007/2044] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:08.542442 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf31d89-51bd-4e66-aceb-fd608e5decba None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:08.542442 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf31d89-51bd-4e66-aceb-fd608e5decba None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:08.542442 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf31d89-51bd-4e66-aceb-fd608e5decba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:08.565301 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-4cf31d89-51bd-4e66-aceb-fd608e5decba None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:08.567330 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-4cf31d89-51bd-4e66-aceb-fd608e5decba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:08.575176 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1008/2045] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:08.576000 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf31d89-51bd-4e66-aceb-fd608e5decba None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:08.577221 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-4cf31d89-51bd-4e66-aceb-fd608e5decba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:08.589611 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf31d89-51bd-4e66-aceb-fd608e5decba None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:08.594188 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94a8d7-8f4d-41c6-9acb-476b613dde6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:08.595146 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94a8d7-8f4d-41c6-9acb-476b613dde6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:08.595426 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94a8d7-8f4d-41c6-9acb-476b613dde6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:08.595698 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94a8d7-8f4d-41c6-9acb-476b613dde6a admin admin] PATH_INFO: `/v3/projects/30ef500d9ef3421eb59d9ce08761298d` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:08.596903 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94a8d7-8f4d-41c6-9acb-476b613dde6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ef500d9ef3421eb59d9ce08761298d)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:08.598968 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94a8d7-8f4d-41c6-9acb-476b613dde6a admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:08.649101 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-151642e6-94e3-4687-9d24-35fccc6642ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa1d495214e34dbeac205f273ecbd929', 'request_id': 'req-151642e6-94e3-4687-9d24-35fccc6642ca'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.654803 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-151642e6-94e3-4687-9d24-35fccc6642ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa1d495214e34dbeac205f273ecbd929', 'request_id': 'req-151642e6-94e3-4687-9d24-35fccc6642ca'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.661112 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-151642e6-94e3-4687-9d24-35fccc6642ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa1d495214e34dbeac205f273ecbd929', 'request_id': 'req-151642e6-94e3-4687-9d24-35fccc6642ca'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.696899 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1d94a8d7-8f4d-41c6-9acb-476b613dde6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ef500d9ef3421eb59d9ce08761298d', 'request_id': 'req-1d94a8d7-8f4d-41c6-9acb-476b613dde6a'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.742294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-151642e6-94e3-4687-9d24-35fccc6642ca admin admin] The token cache is being invalidate because project aa1d495214e34dbeac205f273ecbd929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:08.742622 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-151642e6-94e3-4687-9d24-35fccc6642ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.743233 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-151642e6-94e3-4687-9d24-35fccc6642ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.744819 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1038/2046] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:08 2022] DELETE /identity/v3/projects/aa1d495214e34dbeac205f273ecbd929 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:08.748251 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151642e6-94e3-4687-9d24-35fccc6642ca admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:08.748251 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-151642e6-94e3-4687-9d24-35fccc6642ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:08.801493 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151642e6-94e3-4687-9d24-35fccc6642ca admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:08.822404 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1d94a8d7-8f4d-41c6-9acb-476b613dde6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ef500d9ef3421eb59d9ce08761298d', 'request_id': 'req-1d94a8d7-8f4d-41c6-9acb-476b613dde6a'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.829143 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1d94a8d7-8f4d-41c6-9acb-476b613dde6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ef500d9ef3421eb59d9ce08761298d', 'request_id': 'req-1d94a8d7-8f4d-41c6-9acb-476b613dde6a'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.840273 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1d94a8d7-8f4d-41c6-9acb-476b613dde6a admin admin] The token cache is being invalidate because project 30ef500d9ef3421eb59d9ce08761298d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:08.840560 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1d94a8d7-8f4d-41c6-9acb-476b613dde6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.841252 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1d94a8d7-8f4d-41c6-9acb-476b613dde6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:08.842807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1009/2047] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:08 2022] DELETE /identity/v3/projects/30ef500d9ef3421eb59d9ce08761298d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:08.843567 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94a8d7-8f4d-41c6-9acb-476b613dde6a admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:08.844863 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1d94a8d7-8f4d-41c6-9acb-476b613dde6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:08.850952 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c400d03-6be2-4bc0-8e3f-66c155a16781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:08.851524 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c400d03-6be2-4bc0-8e3f-66c155a16781 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:08.851801 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c400d03-6be2-4bc0-8e3f-66c155a16781 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:08.852337 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c400d03-6be2-4bc0-8e3f-66c155a16781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:08.854100 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-5c400d03-6be2-4bc0-8e3f-66c155a16781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:08.902956 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94a8d7-8f4d-41c6-9acb-476b613dde6a admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:08.906968 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65054d62-4d23-438d-839a-736899662f77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:08.907763 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65054d62-4d23-438d-839a-736899662f77 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:08.908052 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65054d62-4d23-438d-839a-736899662f77 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:08.908327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65054d62-4d23-438d-839a-736899662f77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:08.910803 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-65054d62-4d23-438d-839a-736899662f77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:08.919891 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c400d03-6be2-4bc0-8e3f-66c155a16781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:08.921370 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c400d03-6be2-4bc0-8e3f-66c155a16781 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:08.922673 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65054d62-4d23-438d-839a-736899662f77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:08.924143 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65054d62-4d23-438d-839a-736899662f77 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:08.931265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1039/2048] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:08.932749 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10b30c-000b-412b-b5ba-5ea67e0e627d None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:08.933106 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10b30c-000b-412b-b5ba-5ea67e0e627d None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:08.933451 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10b30c-000b-412b-b5ba-5ea67e0e627d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:08.936148 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1010/2049] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:08.937502 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31a892-0358-4087-80d7-b3b34105cebf None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:08.938004 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31a892-0358-4087-80d7-b3b34105cebf None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:08.938490 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31a892-0358-4087-80d7-b3b34105cebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:08.953791 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-1e10b30c-000b-412b-b5ba-5ea67e0e627d None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:08.955314 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-1e10b30c-000b-412b-b5ba-5ea67e0e627d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:08.957662 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-7b31a892-0358-4087-80d7-b3b34105cebf None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:08.958190 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7b31a892-0358-4087-80d7-b3b34105cebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:08.966535 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1011/2050] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:08.972193 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1040/2051] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:08.973898 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffd5bd-d36a-42cd-8f5f-263b57ae7875 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:08.974180 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffd5bd-d36a-42cd-8f5f-263b57ae7875 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:08.974477 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffd5bd-d36a-42cd-8f5f-263b57ae7875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:08.974581 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925b1c4-525c-4ff4-928c-dae56cc924f0 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:08.974773 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925b1c4-525c-4ff4-928c-dae56cc924f0 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:08.975056 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925b1c4-525c-4ff4-928c-dae56cc924f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:08.996566 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-1bffd5bd-d36a-42cd-8f5f-263b57ae7875 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:08.997854 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1bffd5bd-d36a-42cd-8f5f-263b57ae7875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:08.998772 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-b925b1c4-525c-4ff4-928c-dae56cc924f0 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:09.000032 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b925b1c4-525c-4ff4-928c-dae56cc924f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:09.009238 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1012/2052] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:09.014265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1041/2053] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:09.014403 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bffd5bd-d36a-42cd-8f5f-263b57ae7875 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:09.015556 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925b1c4-525c-4ff4-928c-dae56cc924f0 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:09.025514 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925b1c4-525c-4ff4-928c-dae56cc924f0 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:09.031799 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19654cf1-35c0-4546-845d-9eb19fd8864d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:09.032582 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19654cf1-35c0-4546-845d-9eb19fd8864d admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:09.038171 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19654cf1-35c0-4546-845d-9eb19fd8864d admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:09.038171 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19654cf1-35c0-4546-845d-9eb19fd8864d admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:09.038171 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19654cf1-35c0-4546-845d-9eb19fd8864d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:20:09.038171 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19654cf1-35c0-4546-845d-9eb19fd8864d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:09.038467 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bffd5bd-d36a-42cd-8f5f-263b57ae7875 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:09.038577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19654cf1-35c0-4546-845d-9eb19fd8864d admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:09.043349 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0c11d-84ee-467c-b441-c15e76f7a7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:09.044333 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0c11d-84ee-467c-b441-c15e76f7a7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:09.045226 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0c11d-84ee-467c-b441-c15e76f7a7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:09.046219 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0c11d-84ee-467c-b441-c15e76f7a7f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:09.047599 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0c11d-84ee-467c-b441-c15e76f7a7f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:20:09.048495 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0c11d-84ee-467c-b441-c15e76f7a7f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:09.052830 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1042/2054] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:20:09.054558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19654cf1-35c0-4546-845d-9eb19fd8864d admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:09.055049 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0c11d-84ee-467c-b441-c15e76f7a7f2 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:09.067115 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19654cf1-35c0-4546-845d-9eb19fd8864d admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:09.068690 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1013/2055] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:20:09.072702 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0c11d-84ee-467c-b441-c15e76f7a7f2 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:09.077230 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186fa80-2414-4c09-8efb-ee96078583d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:09.078090 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186fa80-2414-4c09-8efb-ee96078583d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:09.078517 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186fa80-2414-4c09-8efb-ee96078583d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:09.078936 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186fa80-2414-4c09-8efb-ee96078583d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:09.079760 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186fa80-2414-4c09-8efb-ee96078583d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:09.081996 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186fa80-2414-4c09-8efb-ee96078583d7 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:09.083494 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0c11d-84ee-467c-b441-c15e76f7a7f2 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:09.088879 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbf055-211e-49ac-947e-8edaaed369f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:09.089675 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbf055-211e-49ac-947e-8edaaed369f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:09.089966 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbf055-211e-49ac-947e-8edaaed369f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:09.090365 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbf055-211e-49ac-947e-8edaaed369f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:09.091216 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbf055-211e-49ac-947e-8edaaed369f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:09.093261 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbf055-211e-49ac-947e-8edaaed369f9 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:09.215886 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1014/2056] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:09 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:09.219365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1043/2057] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:09 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:09.220771 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbf055-211e-49ac-947e-8edaaed369f9 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:09.220916 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186fa80-2414-4c09-8efb-ee96078583d7 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:09.288228 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbf055-211e-49ac-947e-8edaaed369f9 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:09.292622 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186fa80-2414-4c09-8efb-ee96078583d7 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:09.312962 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6a8da-893e-4f78-a6bf-277592500dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:09.315088 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6a8da-893e-4f78-a6bf-277592500dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:09.315375 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6a8da-893e-4f78-a6bf-277592500dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:09.315654 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6a8da-893e-4f78-a6bf-277592500dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:09.317710 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6a8da-893e-4f78-a6bf-277592500dc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:09.319373 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b9c44-7eb3-4444-a7dd-45d5955fb5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:09.321636 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b9c44-7eb3-4444-a7dd-45d5955fb5ac admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:09.323526 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b9c44-7eb3-4444-a7dd-45d5955fb5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:09.323836 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b9c44-7eb3-4444-a7dd-45d5955fb5ac admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:09.324863 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b9c44-7eb3-4444-a7dd-45d5955fb5ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:09.325845 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6a8da-893e-4f78-a6bf-277592500dc7 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:09.327135 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b9c44-7eb3-4444-a7dd-45d5955fb5ac admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:09.420494 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1015/2058] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:09 2022] POST /identity/v3/users => generated 284 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:09.424180 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b9c44-7eb3-4444-a7dd-45d5955fb5ac admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:09.436027 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b9c44-7eb3-4444-a7dd-45d5955fb5ac admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:09.444212 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d2a81-f7b9-4c0e-a632-0fa19bc63937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:09.445632 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d2a81-f7b9-4c0e-a632-0fa19bc63937 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:09.446896 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d2a81-f7b9-4c0e-a632-0fa19bc63937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:09.447320 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d2a81-f7b9-4c0e-a632-0fa19bc63937 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:09.448198 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1044/2059] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:09 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:09.448942 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d2a81-f7b9-4c0e-a632-0fa19bc63937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:09.449312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6a8da-893e-4f78-a6bf-277592500dc7 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:09.451169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d2a81-f7b9-4c0e-a632-0fa19bc63937 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:09.461643 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6a8da-893e-4f78-a6bf-277592500dc7 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:09.467716 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c7a44-fc2d-4ae2-928f-82d660333784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:09.468025 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1016/2060] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:09.468473 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c7a44-fc2d-4ae2-928f-82d660333784 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:09.468976 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c7a44-fc2d-4ae2-928f-82d660333784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:09.469717 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c7a44-fc2d-4ae2-928f-82d660333784 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:09.470115 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d2a81-f7b9-4c0e-a632-0fa19bc63937 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:09.470487 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c7a44-fc2d-4ae2-928f-82d660333784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:09.473784 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c7a44-fc2d-4ae2-928f-82d660333784 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:09.483297 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d2a81-f7b9-4c0e-a632-0fa19bc63937 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:09.486166 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1045/2061] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:09.496412 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaba264-a2fc-43df-a169-f624561b7414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:09.497137 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaba264-a2fc-43df-a169-f624561b7414 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:09.497247 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c7a44-fc2d-4ae2-928f-82d660333784 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:09.497426 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaba264-a2fc-43df-a169-f624561b7414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:09.497694 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaba264-a2fc-43df-a169-f624561b7414 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:09.498430 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaba264-a2fc-43df-a169-f624561b7414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:09.500042 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaba264-a2fc-43df-a169-f624561b7414 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:09.512703 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1017/2062] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:09.521449 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaba264-a2fc-43df-a169-f624561b7414 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:09.524246 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-ffaba264-a2fc-43df-a169-f624561b7414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:09.526363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c7a44-fc2d-4ae2-928f-82d660333784 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:09.532039 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd18e2e-bd81-4178-8d3f-e93975449b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:09.538496 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaba264-a2fc-43df-a169-f624561b7414 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:09.539656 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd18e2e-bd81-4178-8d3f-e93975449b17 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:09.539943 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd18e2e-bd81-4178-8d3f-e93975449b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:09.540246 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd18e2e-bd81-4178-8d3f-e93975449b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:09.543255 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd18e2e-bd81-4178-8d3f-e93975449b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:09.543255 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd18e2e-bd81-4178-8d3f-e93975449b17 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:09.549248 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866abc4-04ee-4091-906a-00249c3cc023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:09.550554 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866abc4-04ee-4091-906a-00249c3cc023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:09.550554 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866abc4-04ee-4091-906a-00249c3cc023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:09.552319 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866abc4-04ee-4091-906a-00249c3cc023 admin admin] PATH_INFO: `/v3/projects/8ea74095e4554caf8bacf9364f72eb90` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:09.554723 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866abc4-04ee-4091-906a-00249c3cc023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea74095e4554caf8bacf9364f72eb90)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:09.554723 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866abc4-04ee-4091-906a-00249c3cc023 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:09.560528 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1046/2063] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:09.560528 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd18e2e-bd81-4178-8d3f-e93975449b17 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:09.571261 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd18e2e-bd81-4178-8d3f-e93975449b17 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:09.576464 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a3ef0-6899-4a6c-93a9-71c237865e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:09.577458 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a3ef0-6899-4a6c-93a9-71c237865e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:09.577808 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a3ef0-6899-4a6c-93a9-71c237865e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:09.579643 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a3ef0-6899-4a6c-93a9-71c237865e41 admin admin] PATH_INFO: `/v3/projects/d6bbbe44158f4db3855012faa4b1d9e0/users/05edc58237674712ae8988580c813d66/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:09.597218 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a3ef0-6899-4a6c-93a9-71c237865e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6bbbe44158f4db3855012faa4b1d9e0, user_id=05edc58237674712ae8988580c813d66, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:09.600431 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a3ef0-6899-4a6c-93a9-71c237865e41 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:09.653452 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1047/2064] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:09 2022] PUT /identity/v3/projects/d6bbbe44158f4db3855012faa4b1d9e0/users/05edc58237674712ae8988580c813d66/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:09.654579 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a3ef0-6899-4a6c-93a9-71c237865e41 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:09.673669 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e866abc4-04ee-4091-906a-00249c3cc023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea74095e4554caf8bacf9364f72eb90', 'request_id': 'req-e866abc4-04ee-4091-906a-00249c3cc023'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:09.718895 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a3ef0-6899-4a6c-93a9-71c237865e41 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:09.772768 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb6e26-a837-4499-854c-a23d263c27be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:09.773332 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e866abc4-04ee-4091-906a-00249c3cc023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea74095e4554caf8bacf9364f72eb90', 'request_id': 'req-e866abc4-04ee-4091-906a-00249c3cc023'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:09.773651 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb6e26-a837-4499-854c-a23d263c27be admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:09.773929 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb6e26-a837-4499-854c-a23d263c27be admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:09.774200 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb6e26-a837-4499-854c-a23d263c27be admin admin] PATH_INFO: `/v3/projects/c8fbd3c9487c4904bcd561726dff99d3/users/9e91bf5c56e74d268286d1b7c99934c9/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:09.779304 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e866abc4-04ee-4091-906a-00249c3cc023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea74095e4554caf8bacf9364f72eb90', 'request_id': 'req-e866abc4-04ee-4091-906a-00249c3cc023'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:09.789195 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb6e26-a837-4499-854c-a23d263c27be admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8fbd3c9487c4904bcd561726dff99d3, user_id=9e91bf5c56e74d268286d1b7c99934c9, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:09.791659 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e866abc4-04ee-4091-906a-00249c3cc023 admin admin] The token cache is being invalidate because project 8ea74095e4554caf8bacf9364f72eb90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:09.791960 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb6e26-a837-4499-854c-a23d263c27be admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:09.792070 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e866abc4-04ee-4091-906a-00249c3cc023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:09.792612 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e866abc4-04ee-4091-906a-00249c3cc023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:09.794267 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1018/2065] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:09 2022] DELETE /identity/v3/projects/8ea74095e4554caf8bacf9364f72eb90 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:09.797939 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866abc4-04ee-4091-906a-00249c3cc023 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:09.799338 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-e866abc4-04ee-4091-906a-00249c3cc023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:09.812384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866abc4-04ee-4091-906a-00249c3cc023 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:09.817127 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053ffc4-5200-44c9-b491-9f475f58976f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:09.818006 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053ffc4-5200-44c9-b491-9f475f58976f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:09.818280 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053ffc4-5200-44c9-b491-9f475f58976f admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:09.818548 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053ffc4-5200-44c9-b491-9f475f58976f admin admin] PATH_INFO: `/v3/projects/40a8637d47d046a4bc80e4bfc3a6824b` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:09.819701 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053ffc4-5200-44c9-b491-9f475f58976f admin admin] RBAC: Authorizing `identity:delete_project(project_id=40a8637d47d046a4bc80e4bfc3a6824b)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:09.821636 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053ffc4-5200-44c9-b491-9f475f58976f admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:09.887515 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1048/2066] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:09 2022] PUT /identity/v3/projects/c8fbd3c9487c4904bcd561726dff99d3/users/9e91bf5c56e74d268286d1b7c99934c9/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:09.888891 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96c9a2-06fa-4a0b-b8ea-fdcfd71423aa None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:09.889179 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96c9a2-06fa-4a0b-b8ea-fdcfd71423aa None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:09.889486 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96c9a2-06fa-4a0b-b8ea-fdcfd71423aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:09.915353 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-9d96c9a2-06fa-4a0b-b8ea-fdcfd71423aa None None] MFA Rules not processed for user `05edc58237674712ae8988580c813d66`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:09.916579 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9d96c9a2-06fa-4a0b-b8ea-fdcfd71423aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:09.979164 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1049/2067] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:09.980081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96c9a2-06fa-4a0b-b8ea-fdcfd71423aa None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:09.981359 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9d96c9a2-06fa-4a0b-b8ea-fdcfd71423aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:09.988248 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e053ffc4-5200-44c9-b491-9f475f58976f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40a8637d47d046a4bc80e4bfc3a6824b', 'request_id': 'req-e053ffc4-5200-44c9-b491-9f475f58976f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:10.043549 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96c9a2-06fa-4a0b-b8ea-fdcfd71423aa None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:10.096071 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673cafb-ee35-482e-8d9c-86fa7b2376b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:10.096883 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673cafb-ee35-482e-8d9c-86fa7b2376b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:10.097161 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673cafb-ee35-482e-8d9c-86fa7b2376b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:10.097945 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673cafb-ee35-482e-8d9c-86fa7b2376b3 admin admin] PATH_INFO: `/v3/users/82f2e6b97d704bf994e37046e8e7e67a` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:10.099224 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673cafb-ee35-482e-8d9c-86fa7b2376b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f2e6b97d704bf994e37046e8e7e67a)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:10.101239 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673cafb-ee35-482e-8d9c-86fa7b2376b3 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:10.119633 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e053ffc4-5200-44c9-b491-9f475f58976f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40a8637d47d046a4bc80e4bfc3a6824b', 'request_id': 'req-e053ffc4-5200-44c9-b491-9f475f58976f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:10.125627 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e053ffc4-5200-44c9-b491-9f475f58976f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40a8637d47d046a4bc80e4bfc3a6824b', 'request_id': 'req-e053ffc4-5200-44c9-b491-9f475f58976f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:10.136501 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e053ffc4-5200-44c9-b491-9f475f58976f admin admin] The token cache is being invalidate because project 40a8637d47d046a4bc80e4bfc3a6824b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:10.136849 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e053ffc4-5200-44c9-b491-9f475f58976f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:10.137500 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e053ffc4-5200-44c9-b491-9f475f58976f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:10.139043 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1019/2068] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:09 2022] DELETE /identity/v3/projects/40a8637d47d046a4bc80e4bfc3a6824b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:10.140335 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649220c-ce85-420c-9627-c7329231e224 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:10.140629 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649220c-ce85-420c-9627-c7329231e224 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:10.140939 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649220c-ce85-420c-9627-c7329231e224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:10.166256 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-3649220c-ce85-420c-9627-c7329231e224 None None] MFA Rules not processed for user `9e91bf5c56e74d268286d1b7c99934c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:10.167446 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-3649220c-ce85-420c-9627-c7329231e224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:10.229742 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1020/2069] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:10.230563 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649220c-ce85-420c-9627-c7329231e224 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:10.231791 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-3649220c-ce85-420c-9627-c7329231e224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:10.245297 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649220c-ce85-420c-9627-c7329231e224 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:10.249869 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9ee5b-0132-4f00-a1cc-112c32e49dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:10.250509 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9ee5b-0132-4f00-a1cc-112c32e49dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:10.250791 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9ee5b-0132-4f00-a1cc-112c32e49dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:10.251066 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9ee5b-0132-4f00-a1cc-112c32e49dc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:10.251750 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9ee5b-0132-4f00-a1cc-112c32e49dc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:10.253743 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9ee5b-0132-4f00-a1cc-112c32e49dc1 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:10.327292 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f673cafb-ee35-482e-8d9c-86fa7b2376b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f2e6b97d704bf994e37046e8e7e67a'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:10.339568 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f673cafb-ee35-482e-8d9c-86fa7b2376b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f2e6b97d704bf994e37046e8e7e67a'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:10.340274 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f673cafb-ee35-482e-8d9c-86fa7b2376b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f2e6b97d704bf994e37046e8e7e67a'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:10.340908 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f673cafb-ee35-482e-8d9c-86fa7b2376b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f2e6b97d704bf994e37046e8e7e67a'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:10.348470 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f673cafb-ee35-482e-8d9c-86fa7b2376b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f2e6b97d704bf994e37046e8e7e67a'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:10.355259 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1021/2070] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:10 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:10.355259 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9ee5b-0132-4f00-a1cc-112c32e49dc1 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:10.355259 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-bde9ee5b-0132-4f00-a1cc-112c32e49dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:10.417070 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9ee5b-0132-4f00-a1cc-112c32e49dc1 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:10.421766 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f311b9-526e-44dd-9343-e4b055151fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:10.422632 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f311b9-526e-44dd-9343-e4b055151fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:10.422954 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f311b9-526e-44dd-9343-e4b055151fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:10.423192 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f311b9-526e-44dd-9343-e4b055151fd6 admin admin] PATH_INFO: `/v3/users/073a20adde9e41f299b19912ef83874e` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:10.424395 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f311b9-526e-44dd-9343-e4b055151fd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=073a20adde9e41f299b19912ef83874e)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:10.426555 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f311b9-526e-44dd-9343-e4b055151fd6 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:10.431215 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1050/2071] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:09 2022] DELETE /identity/v3/users/82f2e6b97d704bf994e37046e8e7e67a => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:10.434272 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673cafb-ee35-482e-8d9c-86fa7b2376b3 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:10.434272 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f673cafb-ee35-482e-8d9c-86fa7b2376b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:10.521948 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673cafb-ee35-482e-8d9c-86fa7b2376b3 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:10.528031 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26a7d3-67c3-471e-9094-2056275ffd40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:10.528696 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26a7d3-67c3-471e-9094-2056275ffd40 service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:10.528979 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26a7d3-67c3-471e-9094-2056275ffd40 service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:10.529260 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26a7d3-67c3-471e-9094-2056275ffd40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:10.531194 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9e26a7d3-67c3-471e-9094-2056275ffd40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:10.590902 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26a7d3-67c3-471e-9094-2056275ffd40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:10.592520 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26a7d3-67c3-471e-9094-2056275ffd40 service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:10.602888 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1051/2072] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:10.603596 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26a7d3-67c3-471e-9094-2056275ffd40 service nova] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:10.605021 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9e26a7d3-67c3-471e-9094-2056275ffd40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:10.680577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26a7d3-67c3-471e-9094-2056275ffd40 service nova] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:10.683309 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-40f311b9-526e-44dd-9343-e4b055151fd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '073a20adde9e41f299b19912ef83874e'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:10.687912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b837a76-80e9-416c-88f3-0a260d304c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:10.688918 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b837a76-80e9-416c-88f3-0a260d304c9c admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:10.689081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b837a76-80e9-416c-88f3-0a260d304c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:10.689652 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b837a76-80e9-416c-88f3-0a260d304c9c admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:10.690445 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b837a76-80e9-416c-88f3-0a260d304c9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:10.694191 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b837a76-80e9-416c-88f3-0a260d304c9c admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:10.698563 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-40f311b9-526e-44dd-9343-e4b055151fd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '073a20adde9e41f299b19912ef83874e'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:10.699411 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-40f311b9-526e-44dd-9343-e4b055151fd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '073a20adde9e41f299b19912ef83874e'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:10.787961 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-40f311b9-526e-44dd-9343-e4b055151fd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '073a20adde9e41f299b19912ef83874e'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:10.788713 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-40f311b9-526e-44dd-9343-e4b055151fd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '073a20adde9e41f299b19912ef83874e'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:10.802036 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1022/2073] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:10 2022] DELETE /identity/v3/users/073a20adde9e41f299b19912ef83874e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:10.823260 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1052/2074] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:10 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:10.825267 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f311b9-526e-44dd-9343-e4b055151fd6 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:10.827341 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-40f311b9-526e-44dd-9343-e4b055151fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:10.913584 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f311b9-526e-44dd-9343-e4b055151fd6 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:10.918468 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff13a28-6acd-4068-aa44-e78cdb196ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:10.919355 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff13a28-6acd-4068-aa44-e78cdb196ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:10.919638 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff13a28-6acd-4068-aa44-e78cdb196ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:10.919914 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff13a28-6acd-4068-aa44-e78cdb196ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:10.920672 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff13a28-6acd-4068-aa44-e78cdb196ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:10.922347 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff13a28-6acd-4068-aa44-e78cdb196ad1 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:10.933177 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1023/2075] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:10.938793 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b837a76-80e9-416c-88f3-0a260d304c9c admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:10.947958 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b837a76-80e9-416c-88f3-0a260d304c9c admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:10.952758 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1876086-7f27-4d58-9de5-28764625d5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:10.953716 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1876086-7f27-4d58-9de5-28764625d5b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:10.953999 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1876086-7f27-4d58-9de5-28764625d5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:10.954274 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1876086-7f27-4d58-9de5-28764625d5b8 admin admin] PATH_INFO: `/v3/projects/a2f42fbc590f4ae88e34f0b3903c6de7/users/8eb63bfa0b7b440bbb8258fcbad43a13/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:10.969867 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1876086-7f27-4d58-9de5-28764625d5b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f42fbc590f4ae88e34f0b3903c6de7, user_id=8eb63bfa0b7b440bbb8258fcbad43a13, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:10.972630 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1876086-7f27-4d58-9de5-28764625d5b8 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:11.118464 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff13a28-6acd-4068-aa44-e78cdb196ad1 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:11.120422 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-4ff13a28-6acd-4068-aa44-e78cdb196ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:11.142754 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff13a28-6acd-4068-aa44-e78cdb196ad1 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:11.150527 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d622854-a5f9-492e-8f40-7cb9951e3540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:11.151557 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d622854-a5f9-492e-8f40-7cb9951e3540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:11.151837 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d622854-a5f9-492e-8f40-7cb9951e3540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:11.152177 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d622854-a5f9-492e-8f40-7cb9951e3540 admin admin] PATH_INFO: `/v3/projects/c4df1c324b7e47af824bc90522d07049` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:11.153500 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d622854-a5f9-492e-8f40-7cb9951e3540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4df1c324b7e47af824bc90522d07049)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:11.155775 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d622854-a5f9-492e-8f40-7cb9951e3540 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:11.169659 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1053/2076] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:10 2022] PUT /identity/v3/projects/a2f42fbc590f4ae88e34f0b3903c6de7/users/8eb63bfa0b7b440bbb8258fcbad43a13/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:11.170588 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1876086-7f27-4d58-9de5-28764625d5b8 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:11.249461 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1876086-7f27-4d58-9de5-28764625d5b8 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:11.254608 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6e142-54fc-46c9-ad60-e1b36ccbf5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:11.255293 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6e142-54fc-46c9-ad60-e1b36ccbf5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:11.255604 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6e142-54fc-46c9-ad60-e1b36ccbf5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:11.255880 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6e142-54fc-46c9-ad60-e1b36ccbf5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:11.256649 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6e142-54fc-46c9-ad60-e1b36ccbf5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:11.258373 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6e142-54fc-46c9-ad60-e1b36ccbf5d5 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:11.268528 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1054/2077] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:11.273596 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6e142-54fc-46c9-ad60-e1b36ccbf5d5 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:11.284466 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6e142-54fc-46c9-ad60-e1b36ccbf5d5 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:11.289835 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6400d2-4e85-406b-95e0-675559875032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:11.290735 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6400d2-4e85-406b-95e0-675559875032 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:11.291050 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6400d2-4e85-406b-95e0-675559875032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:11.291300 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6400d2-4e85-406b-95e0-675559875032 admin admin] PATH_INFO: `/v3/projects/a2f42fbc590f4ae88e34f0b3903c6de7/users/8eb63bfa0b7b440bbb8258fcbad43a13/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:11.293297 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6400d2-4e85-406b-95e0-675559875032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f42fbc590f4ae88e34f0b3903c6de7, user_id=8eb63bfa0b7b440bbb8258fcbad43a13, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:11.295945 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6400d2-4e85-406b-95e0-675559875032 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:11.311176 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1055/2078] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:11 2022] PUT /identity/v3/projects/a2f42fbc590f4ae88e34f0b3903c6de7/users/8eb63bfa0b7b440bbb8258fcbad43a13/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:11.323387 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c0acf-aa10-4220-8e37-06c0929f122b None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:11.323679 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c0acf-aa10-4220-8e37-06c0929f122b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:11.323987 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c0acf-aa10-4220-8e37-06c0929f122b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:11.352632 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-002c0acf-aa10-4220-8e37-06c0929f122b None None] MFA Rules not processed for user `8eb63bfa0b7b440bbb8258fcbad43a13`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:11.353882 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-002c0acf-aa10-4220-8e37-06c0929f122b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:11.368379 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1d622854-a5f9-492e-8f40-7cb9951e3540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4df1c324b7e47af824bc90522d07049', 'request_id': 'req-1d622854-a5f9-492e-8f40-7cb9951e3540'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:11.421822 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1056/2079] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:11.422676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c0acf-aa10-4220-8e37-06c0929f122b None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:11.423972 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-002c0acf-aa10-4220-8e37-06c0929f122b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:11.485599 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1d622854-a5f9-492e-8f40-7cb9951e3540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4df1c324b7e47af824bc90522d07049', 'request_id': 'req-1d622854-a5f9-492e-8f40-7cb9951e3540'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:11.489160 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c0acf-aa10-4220-8e37-06c0929f122b None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:11.493721 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1d622854-a5f9-492e-8f40-7cb9951e3540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4df1c324b7e47af824bc90522d07049', 'request_id': 'req-1d622854-a5f9-492e-8f40-7cb9951e3540'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:11.495111 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed48d14-bc8c-4fc0-bbd9-c9594a96956c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:11.495984 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed48d14-bc8c-4fc0-bbd9-c9594a96956c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:11.496272 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed48d14-bc8c-4fc0-bbd9-c9594a96956c admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:11.496568 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed48d14-bc8c-4fc0-bbd9-c9594a96956c admin admin] PATH_INFO: `/v3/projects/7acf5af55de648068dc7e0542ee35d7c` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:11.497885 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed48d14-bc8c-4fc0-bbd9-c9594a96956c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7acf5af55de648068dc7e0542ee35d7c)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:11.500023 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed48d14-bc8c-4fc0-bbd9-c9594a96956c admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:11.508980 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1d622854-a5f9-492e-8f40-7cb9951e3540 admin admin] The token cache is being invalidate because project c4df1c324b7e47af824bc90522d07049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:11.509506 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1d622854-a5f9-492e-8f40-7cb9951e3540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:11.510668 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1d622854-a5f9-492e-8f40-7cb9951e3540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:11.513385 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1024/2080] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:11 2022] DELETE /identity/v3/projects/c4df1c324b7e47af824bc90522d07049 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:11.514403 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d622854-a5f9-492e-8f40-7cb9951e3540 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:11.516246 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1d622854-a5f9-492e-8f40-7cb9951e3540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:11.603275 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d622854-a5f9-492e-8f40-7cb9951e3540 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:11.611101 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b95f9-fe1f-4ae6-8e9b-4eaba9648bcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:11.611101 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b95f9-fe1f-4ae6-8e9b-4eaba9648bcb service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:11.611101 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b95f9-fe1f-4ae6-8e9b-4eaba9648bcb service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:11.611101 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b95f9-fe1f-4ae6-8e9b-4eaba9648bcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:11.611524 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-df4b95f9-fe1f-4ae6-8e9b-4eaba9648bcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:11.621946 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b95f9-fe1f-4ae6-8e9b-4eaba9648bcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:11.623312 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b95f9-fe1f-4ae6-8e9b-4eaba9648bcb service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:11.633059 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1025/2081] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:11.633858 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b95f9-fe1f-4ae6-8e9b-4eaba9648bcb service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:11.635266 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-df4b95f9-fe1f-4ae6-8e9b-4eaba9648bcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:11.648471 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b95f9-fe1f-4ae6-8e9b-4eaba9648bcb service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:11.651623 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1ed48d14-bc8c-4fc0-bbd9-c9594a96956c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7acf5af55de648068dc7e0542ee35d7c', 'request_id': 'req-1ed48d14-bc8c-4fc0-bbd9-c9594a96956c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:11.657682 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1ed48d14-bc8c-4fc0-bbd9-c9594a96956c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7acf5af55de648068dc7e0542ee35d7c', 'request_id': 'req-1ed48d14-bc8c-4fc0-bbd9-c9594a96956c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:11.663854 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1ed48d14-bc8c-4fc0-bbd9-c9594a96956c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7acf5af55de648068dc7e0542ee35d7c', 'request_id': 'req-1ed48d14-bc8c-4fc0-bbd9-c9594a96956c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:11.706333 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1e2f2-c0e7-4fc2-9006-c45641292d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:11.707454 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1e2f2-c0e7-4fc2-9006-c45641292d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:11.707759 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1e2f2-c0e7-4fc2-9006-c45641292d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:11.708031 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1e2f2-c0e7-4fc2-9006-c45641292d40 admin admin] PATH_INFO: `/v3/users/a3cb2b65417748bdb482492ae1bf4d34` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:11.709335 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1e2f2-c0e7-4fc2-9006-c45641292d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3cb2b65417748bdb482492ae1bf4d34)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:11.711305 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1e2f2-c0e7-4fc2-9006-c45641292d40 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:11.795433 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1ed48d14-bc8c-4fc0-bbd9-c9594a96956c admin admin] The token cache is being invalidate because project 7acf5af55de648068dc7e0542ee35d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:11.795721 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1ed48d14-bc8c-4fc0-bbd9-c9594a96956c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:11.796357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1ed48d14-bc8c-4fc0-bbd9-c9594a96956c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:11.798019 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1057/2082] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:11 2022] DELETE /identity/v3/projects/7acf5af55de648068dc7e0542ee35d7c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:11.803183 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ca4d6-25b9-4a45-b28b-a00ee59dd2ef None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:11.803474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ca4d6-25b9-4a45-b28b-a00ee59dd2ef None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:11.805935 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ca4d6-25b9-4a45-b28b-a00ee59dd2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:11.822459 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-0b1ca4d6-25b9-4a45-b28b-a00ee59dd2ef None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:11.823660 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0b1ca4d6-25b9-4a45-b28b-a00ee59dd2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:11.831559 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1058/2083] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:11.839758 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b03c83-0ac8-4463-a79f-a82243d2c633 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:11.840114 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b03c83-0ac8-4463-a79f-a82243d2c633 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:11.840319 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b03c83-0ac8-4463-a79f-a82243d2c633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:11.858899 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-66b03c83-0ac8-4463-a79f-a82243d2c633 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:11.860121 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-66b03c83-0ac8-4463-a79f-a82243d2c633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:11.868946 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1059/2084] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:11.872992 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b03c83-0ac8-4463-a79f-a82243d2c633 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:11.882599 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b03c83-0ac8-4463-a79f-a82243d2c633 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:11.888679 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11622cf-3921-4c52-bc2b-6dd940685824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:11.889370 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11622cf-3921-4c52-bc2b-6dd940685824 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:11.889655 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11622cf-3921-4c52-bc2b-6dd940685824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:11.889934 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11622cf-3921-4c52-bc2b-6dd940685824 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:11.890668 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11622cf-3921-4c52-bc2b-6dd940685824 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:20:11.890974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11622cf-3921-4c52-bc2b-6dd940685824 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:11.892579 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11622cf-3921-4c52-bc2b-6dd940685824 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:11.905033 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1060/2085] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:20:11.909230 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11622cf-3921-4c52-bc2b-6dd940685824 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:11.919328 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11622cf-3921-4c52-bc2b-6dd940685824 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:11.924308 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0cd7e-b099-4bae-99cf-51460fe233cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:11.925071 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0cd7e-b099-4bae-99cf-51460fe233cb admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:11.926953 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0cd7e-b099-4bae-99cf-51460fe233cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:11.926953 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0cd7e-b099-4bae-99cf-51460fe233cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:11.927154 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0cd7e-b099-4bae-99cf-51460fe233cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:11.929149 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0cd7e-b099-4bae-99cf-51460fe233cb admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:11.954740 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f4c1e2f2-c0e7-4fc2-9006-c45641292d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3cb2b65417748bdb482492ae1bf4d34'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:11.969633 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f4c1e2f2-c0e7-4fc2-9006-c45641292d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3cb2b65417748bdb482492ae1bf4d34'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:11.970346 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f4c1e2f2-c0e7-4fc2-9006-c45641292d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3cb2b65417748bdb482492ae1bf4d34'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:12.036129 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1061/2086] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:11 2022] POST /identity/v3/projects => generated 399 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:12.039636 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0cd7e-b099-4bae-99cf-51460fe233cb admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:12.040905 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a9b0cd7e-b099-4bae-99cf-51460fe233cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:12.087180 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f4c1e2f2-c0e7-4fc2-9006-c45641292d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3cb2b65417748bdb482492ae1bf4d34'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:12.087794 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f4c1e2f2-c0e7-4fc2-9006-c45641292d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3cb2b65417748bdb482492ae1bf4d34'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:12.100793 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0cd7e-b099-4bae-99cf-51460fe233cb admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:12.101807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1026/2087] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:11 2022] DELETE /identity/v3/users/a3cb2b65417748bdb482492ae1bf4d34 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:12.105077 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1e2f2-c0e7-4fc2-9006-c45641292d40 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:12.105077 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f4c1e2f2-c0e7-4fc2-9006-c45641292d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:12.159966 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbf865-f06f-4d90-8c2f-c794b58d74f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:12.160550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbf865-f06f-4d90-8c2f-c794b58d74f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:12.161096 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbf865-f06f-4d90-8c2f-c794b58d74f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:12.161379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbf865-f06f-4d90-8c2f-c794b58d74f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:12.163391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-11fbf865-f06f-4d90-8c2f-c794b58d74f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:12.170657 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1e2f2-c0e7-4fc2-9006-c45641292d40 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:12.175878 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a399d23-9bb7-4978-9c40-70da02d1ec0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:12.176538 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a399d23-9bb7-4978-9c40-70da02d1ec0f admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:12.176998 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a399d23-9bb7-4978-9c40-70da02d1ec0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:12.177134 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a399d23-9bb7-4978-9c40-70da02d1ec0f admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:12.177809 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a399d23-9bb7-4978-9c40-70da02d1ec0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:12.179740 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a399d23-9bb7-4978-9c40-70da02d1ec0f admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:12.227907 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbf865-f06f-4d90-8c2f-c794b58d74f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:12.229588 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbf865-f06f-4d90-8c2f-c794b58d74f8 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:12.239575 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1062/2088] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:12.296501 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1027/2089] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:12 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:12.297691 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbf865-f06f-4d90-8c2f-c794b58d74f8 service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:12.309718 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbf865-f06f-4d90-8c2f-c794b58d74f8 service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:12.315081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0258782-cfe9-4103-9d1a-a23361b24325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:12.322005 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0258782-cfe9-4103-9d1a-a23361b24325 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:12.322005 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0258782-cfe9-4103-9d1a-a23361b24325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:12.322005 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0258782-cfe9-4103-9d1a-a23361b24325 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:12.322005 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0258782-cfe9-4103-9d1a-a23361b24325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:12.322005 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0258782-cfe9-4103-9d1a-a23361b24325 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:12.335137 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1063/2090] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:12.339226 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a399d23-9bb7-4978-9c40-70da02d1ec0f admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:12.355297 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a399d23-9bb7-4978-9c40-70da02d1ec0f admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:12.367180 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dcbef-cd7b-4cf3-924a-6944bc1121b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:12.367695 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dcbef-cd7b-4cf3-924a-6944bc1121b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:12.368085 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dcbef-cd7b-4cf3-924a-6944bc1121b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:12.368711 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dcbef-cd7b-4cf3-924a-6944bc1121b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:12.369131 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dcbef-cd7b-4cf3-924a-6944bc1121b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:12.370841 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dcbef-cd7b-4cf3-924a-6944bc1121b9 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:12.385577 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1028/2091] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:12.386790 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0258782-cfe9-4103-9d1a-a23361b24325 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:12.398363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0258782-cfe9-4103-9d1a-a23361b24325 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:12.403344 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad303a7-9a78-491c-b4ce-2d8eea722160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:12.404240 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad303a7-9a78-491c-b4ce-2d8eea722160 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:12.404517 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad303a7-9a78-491c-b4ce-2d8eea722160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:12.404834 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad303a7-9a78-491c-b4ce-2d8eea722160 admin admin] PATH_INFO: `/v3/projects/d1d47cf972574639a23135b54f92c99e/users/3d9fd1bb10b24cb68241cb513be446b4/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:12.421200 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad303a7-9a78-491c-b4ce-2d8eea722160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d47cf972574639a23135b54f92c99e, user_id=3d9fd1bb10b24cb68241cb513be446b4, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:12.423932 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad303a7-9a78-491c-b4ce-2d8eea722160 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:12.567669 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1064/2092] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:12 2022] PUT /identity/v3/projects/d1d47cf972574639a23135b54f92c99e/users/3d9fd1bb10b24cb68241cb513be446b4/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:12.579335 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba45e8-0152-468d-881d-e5e76081b5c4 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:12.579625 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba45e8-0152-468d-881d-e5e76081b5c4 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:12.579901 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba45e8-0152-468d-881d-e5e76081b5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:12.600915 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad303a7-9a78-491c-b4ce-2d8eea722160 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:12.604093 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-7ad303a7-9a78-491c-b4ce-2d8eea722160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:12.625444 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-00ba45e8-0152-468d-881d-e5e76081b5c4 None None] MFA Rules not processed for user `3d9fd1bb10b24cb68241cb513be446b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:12.626584 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-00ba45e8-0152-468d-881d-e5e76081b5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:12.689866 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad303a7-9a78-491c-b4ce-2d8eea722160 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:12.692113 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1029/2093] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:12.696541 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba45e8-0152-468d-881d-e5e76081b5c4 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:12.699059 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d0d1f-1bc3-497b-9d4b-8c27a2b3cd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:12.700005 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d0d1f-1bc3-497b-9d4b-8c27a2b3cd65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:12.700357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d0d1f-1bc3-497b-9d4b-8c27a2b3cd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:12.700755 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d0d1f-1bc3-497b-9d4b-8c27a2b3cd65 admin admin] PATH_INFO: `/v3/projects/be906962b5ab45fa83825760ff47e76b` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:12.702036 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d0d1f-1bc3-497b-9d4b-8c27a2b3cd65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be906962b5ab45fa83825760ff47e76b)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:12.704122 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d0d1f-1bc3-497b-9d4b-8c27a2b3cd65 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:12.707508 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba45e8-0152-468d-881d-e5e76081b5c4 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:12.712079 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7d4e5-e8cf-4193-8a84-e932da1e4889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:12.712750 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7d4e5-e8cf-4193-8a84-e932da1e4889 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:12.713037 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7d4e5-e8cf-4193-8a84-e932da1e4889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:12.713310 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7d4e5-e8cf-4193-8a84-e932da1e4889 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:12.713994 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7d4e5-e8cf-4193-8a84-e932da1e4889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:12.715914 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7d4e5-e8cf-4193-8a84-e932da1e4889 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:12.814373 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1030/2094] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:12 2022] POST /identity/v3/projects => generated 399 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:12.819129 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7d4e5-e8cf-4193-8a84-e932da1e4889 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:12.870860 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-311d0d1f-1bc3-497b-9d4b-8c27a2b3cd65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be906962b5ab45fa83825760ff47e76b', 'request_id': 'req-311d0d1f-1bc3-497b-9d4b-8c27a2b3cd65'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:12.876818 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-311d0d1f-1bc3-497b-9d4b-8c27a2b3cd65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be906962b5ab45fa83825760ff47e76b', 'request_id': 'req-311d0d1f-1bc3-497b-9d4b-8c27a2b3cd65'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:12.885307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-311d0d1f-1bc3-497b-9d4b-8c27a2b3cd65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be906962b5ab45fa83825760ff47e76b', 'request_id': 'req-311d0d1f-1bc3-497b-9d4b-8c27a2b3cd65'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:12.891795 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7d4e5-e8cf-4193-8a84-e932da1e4889 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:12.953377 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001d742-2a78-4f41-948c-447514a9a78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:12.955822 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001d742-2a78-4f41-948c-447514a9a78f admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:12.955822 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001d742-2a78-4f41-948c-447514a9a78f admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:12.955822 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001d742-2a78-4f41-948c-447514a9a78f admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:12.956289 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001d742-2a78-4f41-948c-447514a9a78f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:12.959012 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001d742-2a78-4f41-948c-447514a9a78f admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:12.984468 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-311d0d1f-1bc3-497b-9d4b-8c27a2b3cd65 admin admin] The token cache is being invalidate because project be906962b5ab45fa83825760ff47e76b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:12.984468 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-311d0d1f-1bc3-497b-9d4b-8c27a2b3cd65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:12.984468 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-311d0d1f-1bc3-497b-9d4b-8c27a2b3cd65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:12.985034 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1065/2095] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:12 2022] DELETE /identity/v3/projects/be906962b5ab45fa83825760ff47e76b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:12.990493 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f1116-53a5-4990-b7fa-ee7cf3dc399f None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:12.990970 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f1116-53a5-4990-b7fa-ee7cf3dc399f None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:12.991297 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f1116-53a5-4990-b7fa-ee7cf3dc399f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:13.011808 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-f37f1116-53a5-4990-b7fa-ee7cf3dc399f None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:13.024729 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f37f1116-53a5-4990-b7fa-ee7cf3dc399f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:13.024729 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1066/2096] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:13.031726 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c47926-7976-49b1-b5a2-0bc1943761a9 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:13.032019 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c47926-7976-49b1-b5a2-0bc1943761a9 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:13.032297 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c47926-7976-49b1-b5a2-0bc1943761a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:13.051872 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-49c47926-7976-49b1-b5a2-0bc1943761a9 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:13.053111 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-49c47926-7976-49b1-b5a2-0bc1943761a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:13.063165 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1067/2097] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:13.069452 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c47926-7976-49b1-b5a2-0bc1943761a9 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:13.079274 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c47926-7976-49b1-b5a2-0bc1943761a9 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:13.084832 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf57e67-586e-4daf-a9e7-2c61799c4c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:13.085495 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf57e67-586e-4daf-a9e7-2c61799c4c9e admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:13.085778 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf57e67-586e-4daf-a9e7-2c61799c4c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:13.086053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf57e67-586e-4daf-a9e7-2c61799c4c9e admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:13.086781 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf57e67-586e-4daf-a9e7-2c61799c4c9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:20:13.087088 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf57e67-586e-4daf-a9e7-2c61799c4c9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:13.088726 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf57e67-586e-4daf-a9e7-2c61799c4c9e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:13.098762 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1031/2098] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:12 2022] POST /identity/v3/users => generated 306 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:13.103173 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001d742-2a78-4f41-948c-447514a9a78f admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:13.107038 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1068/2099] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:20:13.108974 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-9001d742-2a78-4f41-948c-447514a9a78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:13.113109 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf57e67-586e-4daf-a9e7-2c61799c4c9e admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:13.122731 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001d742-2a78-4f41-948c-447514a9a78f admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:13.124169 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf57e67-586e-4daf-a9e7-2c61799c4c9e admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:13.131278 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d40ca-5ae0-42b7-87e2-3003685e777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:13.132221 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d40ca-5ae0-42b7-87e2-3003685e777a admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:13.132813 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d40ca-5ae0-42b7-87e2-3003685e777a admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:13.133262 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d40ca-5ae0-42b7-87e2-3003685e777a admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:13.134161 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d40ca-5ae0-42b7-87e2-3003685e777a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:13.135293 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b389cca-3ec9-4d16-b967-06aac67c13ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:13.136019 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b389cca-3ec9-4d16-b967-06aac67c13ca admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:13.136309 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b389cca-3ec9-4d16-b967-06aac67c13ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:13.136834 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d40ca-5ae0-42b7-87e2-3003685e777a admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:13.137235 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b389cca-3ec9-4d16-b967-06aac67c13ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:13.139139 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b389cca-3ec9-4d16-b967-06aac67c13ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:13.143615 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b389cca-3ec9-4d16-b967-06aac67c13ca admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:13.154343 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1032/2100] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:13.155399 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d40ca-5ae0-42b7-87e2-3003685e777a admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:13.168229 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d40ca-5ae0-42b7-87e2-3003685e777a admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:13.173656 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6fbb8-16b6-4ba8-b7e6-579765e15fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:13.174661 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6fbb8-16b6-4ba8-b7e6-579765e15fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:13.174941 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6fbb8-16b6-4ba8-b7e6-579765e15fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:13.175211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6fbb8-16b6-4ba8-b7e6-579765e15fd7 admin admin] PATH_INFO: `/v3/projects/d56ced5f199643798a118ba57df363ea/users/41b37145b0fd45b9821dfcf07283371c/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:13.192065 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6fbb8-16b6-4ba8-b7e6-579765e15fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d56ced5f199643798a118ba57df363ea, user_id=41b37145b0fd45b9821dfcf07283371c, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:13.194732 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6fbb8-16b6-4ba8-b7e6-579765e15fd7 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:13.257149 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1069/2101] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:13 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:13.258073 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b389cca-3ec9-4d16-b967-06aac67c13ca admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:13.261745 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-2b389cca-3ec9-4d16-b967-06aac67c13ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:13.309948 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1033/2102] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:13 2022] PUT /identity/v3/projects/d56ced5f199643798a118ba57df363ea/users/41b37145b0fd45b9821dfcf07283371c/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:13.310744 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6fbb8-16b6-4ba8-b7e6-579765e15fd7 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:13.334639 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b389cca-3ec9-4d16-b967-06aac67c13ca admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:13.373279 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6fbb8-16b6-4ba8-b7e6-579765e15fd7 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:13.378111 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9190d58-7504-4354-8857-3a83c87050cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:13.379408 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9190d58-7504-4354-8857-3a83c87050cc admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:13.385285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9190d58-7504-4354-8857-3a83c87050cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:13.385285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9190d58-7504-4354-8857-3a83c87050cc admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:13.385285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9190d58-7504-4354-8857-3a83c87050cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:13.385285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9190d58-7504-4354-8857-3a83c87050cc admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:13.391294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fb0b1-d4c2-48f8-8789-0529e5071edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:13.392240 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fb0b1-d4c2-48f8-8789-0529e5071edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:13.392515 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fb0b1-d4c2-48f8-8789-0529e5071edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:13.392831 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fb0b1-d4c2-48f8-8789-0529e5071edb admin admin] PATH_INFO: `/v3/users/a007806f6c9e4acb8cb81cb575bc4951` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:13.394231 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0fb0b1-d4c2-48f8-8789-0529e5071edb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a007806f6c9e4acb8cb81cb575bc4951)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:13.396427 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0fb0b1-d4c2-48f8-8789-0529e5071edb admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:13.476023 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1034/2103] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:13 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:13.477341 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9190d58-7504-4354-8857-3a83c87050cc admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:13.486953 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9190d58-7504-4354-8857-3a83c87050cc admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:13.492196 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636f62f-c188-461c-8963-93b16d145c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:13.492871 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636f62f-c188-461c-8963-93b16d145c33 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:13.493174 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636f62f-c188-461c-8963-93b16d145c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:13.493450 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636f62f-c188-461c-8963-93b16d145c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:13.494231 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636f62f-c188-461c-8963-93b16d145c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:13.495825 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636f62f-c188-461c-8963-93b16d145c33 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:13.507057 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1035/2104] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:13.507841 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636f62f-c188-461c-8963-93b16d145c33 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:13.517587 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636f62f-c188-461c-8963-93b16d145c33 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:13.522914 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201357c-b184-4139-91f5-d2ece0924259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:13.523549 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201357c-b184-4139-91f5-d2ece0924259 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:13.523833 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201357c-b184-4139-91f5-d2ece0924259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:13.524109 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201357c-b184-4139-91f5-d2ece0924259 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:13.524856 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201357c-b184-4139-91f5-d2ece0924259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:13.526447 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201357c-b184-4139-91f5-d2ece0924259 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:13.539633 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1036/2105] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:13.539633 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201357c-b184-4139-91f5-d2ece0924259 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:13.546781 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201357c-b184-4139-91f5-d2ece0924259 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:13.551478 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68118537-bc19-4578-b0a2-04cb200dbe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:13.555675 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68118537-bc19-4578-b0a2-04cb200dbe7e admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:13.555675 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68118537-bc19-4578-b0a2-04cb200dbe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:13.555675 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68118537-bc19-4578-b0a2-04cb200dbe7e admin admin] PATH_INFO: `/v3/projects/d56ced5f199643798a118ba57df363ea/users/41b37145b0fd45b9821dfcf07283371c/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:13.555675 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68118537-bc19-4578-b0a2-04cb200dbe7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d56ced5f199643798a118ba57df363ea, user_id=41b37145b0fd45b9821dfcf07283371c, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:13.557484 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68118537-bc19-4578-b0a2-04cb200dbe7e admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:13.569110 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1037/2106] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:13 2022] PUT /identity/v3/projects/d56ced5f199643798a118ba57df363ea/users/41b37145b0fd45b9821dfcf07283371c/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:13.570116 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68118537-bc19-4578-b0a2-04cb200dbe7e admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:13.585331 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-fa0fb0b1-d4c2-48f8-8789-0529e5071edb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a007806f6c9e4acb8cb81cb575bc4951'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:13.596896 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-fa0fb0b1-d4c2-48f8-8789-0529e5071edb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a007806f6c9e4acb8cb81cb575bc4951'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:13.598159 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-fa0fb0b1-d4c2-48f8-8789-0529e5071edb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a007806f6c9e4acb8cb81cb575bc4951'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:13.598785 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-fa0fb0b1-d4c2-48f8-8789-0529e5071edb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a007806f6c9e4acb8cb81cb575bc4951'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:13.605945 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-fa0fb0b1-d4c2-48f8-8789-0529e5071edb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a007806f6c9e4acb8cb81cb575bc4951'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:13.632804 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68118537-bc19-4578-b0a2-04cb200dbe7e admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:13.637364 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313222a-e71b-4b7f-9287-79a340afb87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:13.638019 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313222a-e71b-4b7f-9287-79a340afb87a admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:13.638300 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313222a-e71b-4b7f-9287-79a340afb87a admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:13.638573 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313222a-e71b-4b7f-9287-79a340afb87a admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:13.639287 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313222a-e71b-4b7f-9287-79a340afb87a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:13.641302 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313222a-e71b-4b7f-9287-79a340afb87a admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:13.651552 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1038/2107] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:13.652908 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ecab7-de78-4cb8-b48c-4400c6cd0ecf None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:13.653194 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ecab7-de78-4cb8-b48c-4400c6cd0ecf None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:13.653472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ecab7-de78-4cb8-b48c-4400c6cd0ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:13.680089 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-4c6ecab7-de78-4cb8-b48c-4400c6cd0ecf None None] MFA Rules not processed for user `41b37145b0fd45b9821dfcf07283371c`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:13.681300 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-4c6ecab7-de78-4cb8-b48c-4400c6cd0ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:13.703997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1070/2108] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:13 2022] DELETE /identity/v3/users/a007806f6c9e4acb8cb81cb575bc4951 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:13.705394 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fb0b1-d4c2-48f8-8789-0529e5071edb admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:13.708184 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-fa0fb0b1-d4c2-48f8-8789-0529e5071edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:13.753118 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1039/2109] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:13.758021 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109fffa-66b9-43f9-87c2-1b2e899652f7 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:13.758312 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109fffa-66b9-43f9-87c2-1b2e899652f7 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:13.758826 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109fffa-66b9-43f9-87c2-1b2e899652f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:13.776948 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fb0b1-d4c2-48f8-8789-0529e5071edb admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:13.778412 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-1109fffa-66b9-43f9-87c2-1b2e899652f7 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:13.779618 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1109fffa-66b9-43f9-87c2-1b2e899652f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:13.781634 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf197571-5e64-40cc-82ae-bcd75655b822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:13.782547 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf197571-5e64-40cc-82ae-bcd75655b822 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:13.782824 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf197571-5e64-40cc-82ae-bcd75655b822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:13.783093 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf197571-5e64-40cc-82ae-bcd75655b822 admin admin] PATH_INFO: `/v3/projects/603ba73fe63b4e12899fc7887299731a/users/d695d66f59f442439080aebc7abd6332/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:13.788114 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1040/2110] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:13.788930 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109fffa-66b9-43f9-87c2-1b2e899652f7 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:13.790170 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1109fffa-66b9-43f9-87c2-1b2e899652f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:13.798378 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf197571-5e64-40cc-82ae-bcd75655b822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=603ba73fe63b4e12899fc7887299731a, user_id=d695d66f59f442439080aebc7abd6332, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:13.802009 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf197571-5e64-40cc-82ae-bcd75655b822 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:13.847858 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109fffa-66b9-43f9-87c2-1b2e899652f7 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:13.852071 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967c951-c6e8-4d31-831c-7be140b334f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:13.852739 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967c951-c6e8-4d31-831c-7be140b334f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:13.853041 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967c951-c6e8-4d31-831c-7be140b334f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:13.853312 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967c951-c6e8-4d31-831c-7be140b334f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:13.909108 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1071/2111] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:13 2022] PUT /identity/v3/projects/603ba73fe63b4e12899fc7887299731a/users/d695d66f59f442439080aebc7abd6332/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:13.910322 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf197571-5e64-40cc-82ae-bcd75655b822 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:13.911934 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-bf197571-5e64-40cc-82ae-bcd75655b822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:13.920899 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967c951-c6e8-4d31-831c-7be140b334f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:13.922403 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967c951-c6e8-4d31-831c-7be140b334f9 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:13.933386 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1041/2112] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:13 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:13.942242 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dff82-af1a-421f-9ea7-cb8e90c419a9 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:13.942538 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dff82-af1a-421f-9ea7-cb8e90c419a9 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:13.942933 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dff82-af1a-421f-9ea7-cb8e90c419a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:13.969581 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-724dff82-af1a-421f-9ea7-cb8e90c419a9 None None] MFA Rules not processed for user `d695d66f59f442439080aebc7abd6332`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:13.970785 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-724dff82-af1a-421f-9ea7-cb8e90c419a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:13.972003 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf197571-5e64-40cc-82ae-bcd75655b822 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:13.977682 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ea5c3-d3f8-4177-88d5-8f811315c4af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:13.985333 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ea5c3-d3f8-4177-88d5-8f811315c4af service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:13.985834 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ea5c3-d3f8-4177-88d5-8f811315c4af service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:13.986268 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ea5c3-d3f8-4177-88d5-8f811315c4af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:14.042438 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1042/2113] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:14.050088 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ea5c3-d3f8-4177-88d5-8f811315c4af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:14.051961 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ea5c3-d3f8-4177-88d5-8f811315c4af service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:14.055590 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dff82-af1a-421f-9ea7-cb8e90c419a9 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:14.058370 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-724dff82-af1a-421f-9ea7-cb8e90c419a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:14.061962 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1072/2114] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:14.120293 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dff82-af1a-421f-9ea7-cb8e90c419a9 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:14.123978 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e5b98-61bf-4e6d-b309-158c0ae8cacf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:14.124621 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e5b98-61bf-4e6d-b309-158c0ae8cacf service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:14.124948 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e5b98-61bf-4e6d-b309-158c0ae8cacf service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:14.125223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e5b98-61bf-4e6d-b309-158c0ae8cacf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:14.133953 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e5b98-61bf-4e6d-b309-158c0ae8cacf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:14.135438 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e5b98-61bf-4e6d-b309-158c0ae8cacf service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:14.145075 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1043/2115] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:20:14.172707 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ea5c3-d3f8-4177-88d5-8f811315c4af service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:14.182025 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ea5c3-d3f8-4177-88d5-8f811315c4af service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:14.184067 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e5b98-61bf-4e6d-b309-158c0ae8cacf service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:14.186883 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae20f6-c79d-4189-aa64-71533f06d0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:14.187836 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae20f6-c79d-4189-aa64-71533f06d0c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:14.188244 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae20f6-c79d-4189-aa64-71533f06d0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:14.188782 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae20f6-c79d-4189-aa64-71533f06d0c2 admin admin] PATH_INFO: `/v3/users/d695d66f59f442439080aebc7abd6332` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:14.190061 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae20f6-c79d-4189-aa64-71533f06d0c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d695d66f59f442439080aebc7abd6332)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:14.192504 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae20f6-c79d-4189-aa64-71533f06d0c2 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:14.193268 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e5b98-61bf-4e6d-b309-158c0ae8cacf service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:14.197631 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91092ea-3a86-4138-ba4a-0e73107d37fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:14.200512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91092ea-3a86-4138-ba4a-0e73107d37fe service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:14.200512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91092ea-3a86-4138-ba4a-0e73107d37fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:14.200512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91092ea-3a86-4138-ba4a-0e73107d37fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:14.200790 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b91092ea-3a86-4138-ba4a-0e73107d37fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:14.262868 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91092ea-3a86-4138-ba4a-0e73107d37fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:14.264336 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91092ea-3a86-4138-ba4a-0e73107d37fe service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:14.274498 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1044/2116] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:20:14.417802 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-55ae20f6-c79d-4189-aa64-71533f06d0c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd695d66f59f442439080aebc7abd6332'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:14.434218 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-55ae20f6-c79d-4189-aa64-71533f06d0c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd695d66f59f442439080aebc7abd6332'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:14.435570 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-55ae20f6-c79d-4189-aa64-71533f06d0c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd695d66f59f442439080aebc7abd6332'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:14.436323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-55ae20f6-c79d-4189-aa64-71533f06d0c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd695d66f59f442439080aebc7abd6332'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:14.444214 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-55ae20f6-c79d-4189-aa64-71533f06d0c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd695d66f59f442439080aebc7abd6332'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:14.511840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91092ea-3a86-4138-ba4a-0e73107d37fe service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:14.513338 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b91092ea-3a86-4138-ba4a-0e73107d37fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:14.527458 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1073/2117] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:14 2022] DELETE /identity/v3/users/d695d66f59f442439080aebc7abd6332 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:14.533200 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82b106-8b12-405c-8bc7-d9b6675637e9 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:14.533833 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82b106-8b12-405c-8bc7-d9b6675637e9 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:14.534322 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82b106-8b12-405c-8bc7-d9b6675637e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:14.539213 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91092ea-3a86-4138-ba4a-0e73107d37fe service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:14.557265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-0b82b106-8b12-405c-8bc7-d9b6675637e9 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:14.559634 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0b82b106-8b12-405c-8bc7-d9b6675637e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:14.598405 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d354b1-b826-4179-958e-659ad412887f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:14.599265 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d354b1-b826-4179-958e-659ad412887f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:14.599547 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d354b1-b826-4179-958e-659ad412887f admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:14.599824 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d354b1-b826-4179-958e-659ad412887f admin admin] PATH_INFO: `/v3/projects/33f2ab0932f54a2496f5a5a08c17f6e6` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:14.601055 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d354b1-b826-4179-958e-659ad412887f admin admin] RBAC: Authorizing `identity:delete_project(project_id=33f2ab0932f54a2496f5a5a08c17f6e6)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:14.603275 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d354b1-b826-4179-958e-659ad412887f admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:14.618110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1074/2118] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:14.629969 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82b106-8b12-405c-8bc7-d9b6675637e9 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:14.631378 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0b82b106-8b12-405c-8bc7-d9b6675637e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:14.686839 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82b106-8b12-405c-8bc7-d9b6675637e9 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:14.690395 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d9dc7-d5a6-42ba-ad66-1549ccb1a5f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:14.691748 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d9dc7-d5a6-42ba-ad66-1549ccb1a5f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:14.692025 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d9dc7-d5a6-42ba-ad66-1549ccb1a5f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:14.692298 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d9dc7-d5a6-42ba-ad66-1549ccb1a5f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:14.701417 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d9dc7-d5a6-42ba-ad66-1549ccb1a5f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:14.702922 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d9dc7-d5a6-42ba-ad66-1549ccb1a5f5 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:14.712305 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1075/2119] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:20:14.772902 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-73d354b1-b826-4179-958e-659ad412887f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33f2ab0932f54a2496f5a5a08c17f6e6', 'request_id': 'req-73d354b1-b826-4179-958e-659ad412887f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:14.899947 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-73d354b1-b826-4179-958e-659ad412887f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33f2ab0932f54a2496f5a5a08c17f6e6', 'request_id': 'req-73d354b1-b826-4179-958e-659ad412887f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:14.907837 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-73d354b1-b826-4179-958e-659ad412887f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33f2ab0932f54a2496f5a5a08c17f6e6', 'request_id': 'req-73d354b1-b826-4179-958e-659ad412887f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:14.930878 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d9dc7-d5a6-42ba-ad66-1549ccb1a5f5 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:14.933116 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-73d354b1-b826-4179-958e-659ad412887f admin admin] The token cache is being invalidate because project 33f2ab0932f54a2496f5a5a08c17f6e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:14.933613 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-c79d9dc7-d5a6-42ba-ad66-1549ccb1a5f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:14.934074 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-73d354b1-b826-4179-958e-659ad412887f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:14.935402 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-73d354b1-b826-4179-958e-659ad412887f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:14.951196 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1045/2120] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:14 2022] DELETE /identity/v3/projects/33f2ab0932f54a2496f5a5a08c17f6e6 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:14.954946 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d354b1-b826-4179-958e-659ad412887f admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:14.959411 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-73d354b1-b826-4179-958e-659ad412887f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:14.962978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d9dc7-d5a6-42ba-ad66-1549ccb1a5f5 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:15.030055 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98d482-7d96-4862-805a-70263dce3850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:15.031248 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98d482-7d96-4862-805a-70263dce3850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:15.031476 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98d482-7d96-4862-805a-70263dce3850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:15.031828 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98d482-7d96-4862-805a-70263dce3850 admin admin] PATH_INFO: `/v3/users/9e91bf5c56e74d268286d1b7c99934c9` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:15.033695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98d482-7d96-4862-805a-70263dce3850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e91bf5c56e74d268286d1b7c99934c9)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:15.037134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98d482-7d96-4862-805a-70263dce3850 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:15.042799 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d354b1-b826-4179-958e-659ad412887f admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:15.048948 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a2d85-8ffa-4f47-9207-260d7cde7779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:15.049822 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a2d85-8ffa-4f47-9207-260d7cde7779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:15.050099 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a2d85-8ffa-4f47-9207-260d7cde7779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:15.050730 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a2d85-8ffa-4f47-9207-260d7cde7779 admin admin] PATH_INFO: `/v3/users/8f75ab6c46c944d78489f0893d01de57` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:15.052217 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a2d85-8ffa-4f47-9207-260d7cde7779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f75ab6c46c944d78489f0893d01de57)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:15.054137 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a2d85-8ffa-4f47-9207-260d7cde7779 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:15.293216 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ef6a2d85-8ffa-4f47-9207-260d7cde7779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f75ab6c46c944d78489f0893d01de57'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:15.306645 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ef6a2d85-8ffa-4f47-9207-260d7cde7779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f75ab6c46c944d78489f0893d01de57'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:15.307269 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ef6a2d85-8ffa-4f47-9207-260d7cde7779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f75ab6c46c944d78489f0893d01de57'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:15.323121 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-fc98d482-7d96-4862-805a-70263dce3850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e91bf5c56e74d268286d1b7c99934c9'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:15.339923 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-fc98d482-7d96-4862-805a-70263dce3850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e91bf5c56e74d268286d1b7c99934c9'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:15.340731 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-fc98d482-7d96-4862-805a-70263dce3850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e91bf5c56e74d268286d1b7c99934c9'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:15.341457 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-fc98d482-7d96-4862-805a-70263dce3850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e91bf5c56e74d268286d1b7c99934c9'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:15.348975 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-fc98d482-7d96-4862-805a-70263dce3850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e91bf5c56e74d268286d1b7c99934c9'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:15.361215 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ef6a2d85-8ffa-4f47-9207-260d7cde7779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f75ab6c46c944d78489f0893d01de57'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:15.361907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ef6a2d85-8ffa-4f47-9207-260d7cde7779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f75ab6c46c944d78489f0893d01de57'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:15.375154 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1046/2121] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:14 2022] DELETE /identity/v3/users/8f75ab6c46c944d78489f0893d01de57 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:15.376197 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a2d85-8ffa-4f47-9207-260d7cde7779 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:15.377617 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-ef6a2d85-8ffa-4f47-9207-260d7cde7779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:15.424960 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1076/2122] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:14 2022] DELETE /identity/v3/users/9e91bf5c56e74d268286d1b7c99934c9 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:15.429794 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b729c-b81a-4dda-85b3-65e0ccbbb4f0 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:15.430080 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b729c-b81a-4dda-85b3-65e0ccbbb4f0 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:15.430740 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b729c-b81a-4dda-85b3-65e0ccbbb4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:15.445309 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a2d85-8ffa-4f47-9207-260d7cde7779 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:15.449661 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-9c6b729c-b81a-4dda-85b3-65e0ccbbb4f0 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:15.451004 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9c6b729c-b81a-4dda-85b3-65e0ccbbb4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:15.507163 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87827103-6719-453a-a816-dce1e6ed99c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:15.508042 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87827103-6719-453a-a816-dce1e6ed99c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:15.508326 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87827103-6719-453a-a816-dce1e6ed99c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:15.511380 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87827103-6719-453a-a816-dce1e6ed99c4 admin admin] PATH_INFO: `/v3/projects/603ba73fe63b4e12899fc7887299731a` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:15.511380 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87827103-6719-453a-a816-dce1e6ed99c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=603ba73fe63b4e12899fc7887299731a)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:15.512161 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87827103-6719-453a-a816-dce1e6ed99c4 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:15.513689 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1077/2123] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:15.524798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b729c-b81a-4dda-85b3-65e0ccbbb4f0 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:15.526557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9c6b729c-b81a-4dda-85b3-65e0ccbbb4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:15.620635 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b729c-b81a-4dda-85b3-65e0ccbbb4f0 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:15.626608 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-87827103-6719-453a-a816-dce1e6ed99c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '603ba73fe63b4e12899fc7887299731a', 'request_id': 'req-87827103-6719-453a-a816-dce1e6ed99c4'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:15.678833 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6b38f-7c8c-4a13-8e88-69b260c068fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:15.679505 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6b38f-7c8c-4a13-8e88-69b260c068fa service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:15.679788 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6b38f-7c8c-4a13-8e88-69b260c068fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:15.680073 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6b38f-7c8c-4a13-8e88-69b260c068fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:15.721474 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-87827103-6719-453a-a816-dce1e6ed99c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '603ba73fe63b4e12899fc7887299731a', 'request_id': 'req-87827103-6719-453a-a816-dce1e6ed99c4'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:15.729317 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-87827103-6719-453a-a816-dce1e6ed99c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '603ba73fe63b4e12899fc7887299731a', 'request_id': 'req-87827103-6719-453a-a816-dce1e6ed99c4'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:15.741165 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-87827103-6719-453a-a816-dce1e6ed99c4 admin admin] The token cache is being invalidate because project 603ba73fe63b4e12899fc7887299731a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:15.741557 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-87827103-6719-453a-a816-dce1e6ed99c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:15.742294 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-87827103-6719-453a-a816-dce1e6ed99c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:15.745010 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1047/2124] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:15 2022] DELETE /identity/v3/projects/603ba73fe63b4e12899fc7887299731a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:15.747441 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6b38f-7c8c-4a13-8e88-69b260c068fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:15.749499 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da94e41-da8b-494e-aba9-44ce3de9caf8 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:15.749749 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6b38f-7c8c-4a13-8e88-69b260c068fa service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:15.750299 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da94e41-da8b-494e-aba9-44ce3de9caf8 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:15.750779 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da94e41-da8b-494e-aba9-44ce3de9caf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:15.761109 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1078/2125] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:20:15.773329 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-0da94e41-da8b-494e-aba9-44ce3de9caf8 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:15.774696 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-0da94e41-da8b-494e-aba9-44ce3de9caf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:15.782830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1048/2126] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:15.791020 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f996e54-1760-40ab-a2a3-d20fcbeb1567 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:15.791312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f996e54-1760-40ab-a2a3-d20fcbeb1567 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:15.791587 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f996e54-1760-40ab-a2a3-d20fcbeb1567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:15.809945 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-8f996e54-1760-40ab-a2a3-d20fcbeb1567 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:15.811149 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-8f996e54-1760-40ab-a2a3-d20fcbeb1567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:15.819895 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1079/2127] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:15.824102 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da94e41-da8b-494e-aba9-44ce3de9caf8 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:15.834040 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da94e41-da8b-494e-aba9-44ce3de9caf8 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:15.840815 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa388d0b-51c0-49ec-80cb-15a95d2293d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:15.841479 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa388d0b-51c0-49ec-80cb-15a95d2293d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:15.842627 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa388d0b-51c0-49ec-80cb-15a95d2293d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:15.842901 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa388d0b-51c0-49ec-80cb-15a95d2293d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:15.843677 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa388d0b-51c0-49ec-80cb-15a95d2293d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:20:15.843980 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa388d0b-51c0-49ec-80cb-15a95d2293d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:15.845617 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa388d0b-51c0-49ec-80cb-15a95d2293d1 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:15.861429 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1049/2128] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:20:15.862596 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f996e54-1760-40ab-a2a3-d20fcbeb1567 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:15.872474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f996e54-1760-40ab-a2a3-d20fcbeb1567 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:15.877149 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f95ce-e329-48a9-9708-3e1332127191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:15.877796 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f95ce-e329-48a9-9708-3e1332127191 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:15.878077 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f95ce-e329-48a9-9708-3e1332127191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:15.878376 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f95ce-e329-48a9-9708-3e1332127191 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:15.879071 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f95ce-e329-48a9-9708-3e1332127191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:15.881171 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f95ce-e329-48a9-9708-3e1332127191 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:15.947212 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa388d0b-51c0-49ec-80cb-15a95d2293d1 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:15.949049 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-aa388d0b-51c0-49ec-80cb-15a95d2293d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:15.962457 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa388d0b-51c0-49ec-80cb-15a95d2293d1 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:15.969226 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38c49a-e9c7-4dc7-98d4-e8d267408e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:15.970363 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38c49a-e9c7-4dc7-98d4-e8d267408e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:15.970828 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38c49a-e9c7-4dc7-98d4-e8d267408e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:15.971321 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38c49a-e9c7-4dc7-98d4-e8d267408e70 admin admin] PATH_INFO: `/v3/projects/7dfb1a770c6646ad8b7bd95d3237123f` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:15.973285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38c49a-e9c7-4dc7-98d4-e8d267408e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dfb1a770c6646ad8b7bd95d3237123f)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:15.975226 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38c49a-e9c7-4dc7-98d4-e8d267408e70 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:16.093947 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1080/2129] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:15 2022] POST /identity/v3/projects => generated 389 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:16.108702 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f95ce-e329-48a9-9708-3e1332127191 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:16.146528 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-bd38c49a-e9c7-4dc7-98d4-e8d267408e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dfb1a770c6646ad8b7bd95d3237123f', 'request_id': 'req-bd38c49a-e9c7-4dc7-98d4-e8d267408e70'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:16.172441 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f95ce-e329-48a9-9708-3e1332127191 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:16.238184 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-bd38c49a-e9c7-4dc7-98d4-e8d267408e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dfb1a770c6646ad8b7bd95d3237123f', 'request_id': 'req-bd38c49a-e9c7-4dc7-98d4-e8d267408e70'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:16.244842 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-bd38c49a-e9c7-4dc7-98d4-e8d267408e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dfb1a770c6646ad8b7bd95d3237123f', 'request_id': 'req-bd38c49a-e9c7-4dc7-98d4-e8d267408e70'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:16.247812 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516a1b1-0a16-4836-88d5-565112fbf21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:16.248540 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516a1b1-0a16-4836-88d5-565112fbf21b admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:16.248952 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516a1b1-0a16-4836-88d5-565112fbf21b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:16.249308 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516a1b1-0a16-4836-88d5-565112fbf21b admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:16.250116 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516a1b1-0a16-4836-88d5-565112fbf21b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:16.252394 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516a1b1-0a16-4836-88d5-565112fbf21b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:16.271852 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-bd38c49a-e9c7-4dc7-98d4-e8d267408e70 admin admin] The token cache is being invalidate because project 7dfb1a770c6646ad8b7bd95d3237123f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:16.272025 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-bd38c49a-e9c7-4dc7-98d4-e8d267408e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:16.272895 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-bd38c49a-e9c7-4dc7-98d4-e8d267408e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:16.277247 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1050/2130] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:15 2022] DELETE /identity/v3/projects/7dfb1a770c6646ad8b7bd95d3237123f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:16.278510 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38c49a-e9c7-4dc7-98d4-e8d267408e70 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:16.279880 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-bd38c49a-e9c7-4dc7-98d4-e8d267408e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:16.295175 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38c49a-e9c7-4dc7-98d4-e8d267408e70 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:16.310409 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac4b7f-ae3a-4f7e-9e07-268d167ebbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:16.310409 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac4b7f-ae3a-4f7e-9e07-268d167ebbcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:16.310409 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac4b7f-ae3a-4f7e-9e07-268d167ebbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:16.310409 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac4b7f-ae3a-4f7e-9e07-268d167ebbcb admin admin] PATH_INFO: `/v3/users/a42f54c3308b45eeab216a15cbe15a91` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:16.310736 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac4b7f-ae3a-4f7e-9e07-268d167ebbcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a42f54c3308b45eeab216a15cbe15a91)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:16.310736 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac4b7f-ae3a-4f7e-9e07-268d167ebbcb admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:16.338208 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1081/2131] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:16 2022] POST /identity/v3/users => generated 295 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:16.338740 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516a1b1-0a16-4836-88d5-565112fbf21b admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:16.340507 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-6516a1b1-0a16-4836-88d5-565112fbf21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:16.353359 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516a1b1-0a16-4836-88d5-565112fbf21b admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:16.358167 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775eedf-f211-4ad8-a916-50c52999ac15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:16.358823 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775eedf-f211-4ad8-a916-50c52999ac15 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:16.359155 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775eedf-f211-4ad8-a916-50c52999ac15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:16.359365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775eedf-f211-4ad8-a916-50c52999ac15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:16.360949 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775eedf-f211-4ad8-a916-50c52999ac15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:16.362699 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775eedf-f211-4ad8-a916-50c52999ac15 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:16.373312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1082/2132] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:20:16.377093 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775eedf-f211-4ad8-a916-50c52999ac15 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:16.390545 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775eedf-f211-4ad8-a916-50c52999ac15 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:16.396558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e920861-6c1d-4da5-85b0-29eb78d2f8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:16.397260 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e920861-6c1d-4da5-85b0-29eb78d2f8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:16.397548 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e920861-6c1d-4da5-85b0-29eb78d2f8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:16.397833 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e920861-6c1d-4da5-85b0-29eb78d2f8b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:16.398559 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e920861-6c1d-4da5-85b0-29eb78d2f8b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:16.400186 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e920861-6c1d-4da5-85b0-29eb78d2f8b3 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:16.411274 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1083/2133] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:20:16.415447 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e920861-6c1d-4da5-85b0-29eb78d2f8b3 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:16.426125 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e920861-6c1d-4da5-85b0-29eb78d2f8b3 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:16.432150 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35484ac4-68de-4ad7-97c5-9350d2789e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:16.433169 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35484ac4-68de-4ad7-97c5-9350d2789e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:16.433419 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35484ac4-68de-4ad7-97c5-9350d2789e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:16.433702 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35484ac4-68de-4ad7-97c5-9350d2789e21 admin admin] PATH_INFO: `/v3/projects/6d1fb249b64646038e7f536790add994/users/9c69db83e28c4d76a4db621da73f7a58/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:16.449311 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35484ac4-68de-4ad7-97c5-9350d2789e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d1fb249b64646038e7f536790add994, user_id=9c69db83e28c4d76a4db621da73f7a58, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:16.452079 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35484ac4-68de-4ad7-97c5-9350d2789e21 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:16.563875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-78ac4b7f-ae3a-4f7e-9e07-268d167ebbcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a42f54c3308b45eeab216a15cbe15a91'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:16.576517 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-78ac4b7f-ae3a-4f7e-9e07-268d167ebbcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a42f54c3308b45eeab216a15cbe15a91'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:16.577351 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-78ac4b7f-ae3a-4f7e-9e07-268d167ebbcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a42f54c3308b45eeab216a15cbe15a91'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:16.632054 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1084/2134] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:16 2022] PUT /identity/v3/projects/6d1fb249b64646038e7f536790add994/users/9c69db83e28c4d76a4db621da73f7a58/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:16.632054 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35484ac4-68de-4ad7-97c5-9350d2789e21 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:16.633187 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-35484ac4-68de-4ad7-97c5-9350d2789e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:16.650940 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-78ac4b7f-ae3a-4f7e-9e07-268d167ebbcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a42f54c3308b45eeab216a15cbe15a91'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:16.651965 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-78ac4b7f-ae3a-4f7e-9e07-268d167ebbcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a42f54c3308b45eeab216a15cbe15a91'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:16.673981 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1051/2135] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:16 2022] DELETE /identity/v3/users/a42f54c3308b45eeab216a15cbe15a91 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:16.678843 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec41cd-2c31-4917-86c6-87f66b0b8c63 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:16.679533 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec41cd-2c31-4917-86c6-87f66b0b8c63 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:16.680022 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec41cd-2c31-4917-86c6-87f66b0b8c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:16.709854 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35484ac4-68de-4ad7-97c5-9350d2789e21 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:16.711650 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-e0ec41cd-2c31-4917-86c6-87f66b0b8c63 None None] MFA Rules not processed for user `9c69db83e28c4d76a4db621da73f7a58`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:16.712903 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-e0ec41cd-2c31-4917-86c6-87f66b0b8c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:16.783861 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ad200-efe2-4b7b-a28e-27e9410c0db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:16.785090 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ad200-efe2-4b7b-a28e-27e9410c0db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:16.785371 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ad200-efe2-4b7b-a28e-27e9410c0db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:16.785833 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ad200-efe2-4b7b-a28e-27e9410c0db1 admin admin] PATH_INFO: `/v3/projects/c8fbd3c9487c4904bcd561726dff99d3` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:16.787129 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ad200-efe2-4b7b-a28e-27e9410c0db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8fbd3c9487c4904bcd561726dff99d3)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:16.789161 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ad200-efe2-4b7b-a28e-27e9410c0db1 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:16.848501 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1052/2136] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:16.894223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec41cd-2c31-4917-86c6-87f66b0b8c63 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:16.894223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-e0ec41cd-2c31-4917-86c6-87f66b0b8c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:16.942365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-2a5ad200-efe2-4b7b-a28e-27e9410c0db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8fbd3c9487c4904bcd561726dff99d3', 'request_id': 'req-2a5ad200-efe2-4b7b-a28e-27e9410c0db1'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:16.948332 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-2a5ad200-efe2-4b7b-a28e-27e9410c0db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8fbd3c9487c4904bcd561726dff99d3', 'request_id': 'req-2a5ad200-efe2-4b7b-a28e-27e9410c0db1'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:16.955295 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-2a5ad200-efe2-4b7b-a28e-27e9410c0db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8fbd3c9487c4904bcd561726dff99d3', 'request_id': 'req-2a5ad200-efe2-4b7b-a28e-27e9410c0db1'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:16.959996 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec41cd-2c31-4917-86c6-87f66b0b8c63 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:17.045529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c3f40-8d60-4714-8811-9f531c7b4c91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:17.046188 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c3f40-8d60-4714-8811-9f531c7b4c91 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:17.046491 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c3f40-8d60-4714-8811-9f531c7b4c91 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:17.046770 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c3f40-8d60-4714-8811-9f531c7b4c91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:17.110839 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-2a5ad200-efe2-4b7b-a28e-27e9410c0db1 admin admin] The token cache is being invalidate because project c8fbd3c9487c4904bcd561726dff99d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:17.111099 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c3f40-8d60-4714-8811-9f531c7b4c91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:17.112035 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-2a5ad200-efe2-4b7b-a28e-27e9410c0db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:17.113046 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c3f40-8d60-4714-8811-9f531c7b4c91 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:17.113908 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-2a5ad200-efe2-4b7b-a28e-27e9410c0db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:17.115810 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1085/2137] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:16 2022] DELETE /identity/v3/projects/c8fbd3c9487c4904bcd561726dff99d3 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:17.120580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b614b2a-d954-4310-af4d-c4687395b621 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:17.120917 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b614b2a-d954-4310-af4d-c4687395b621 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:17.121205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b614b2a-d954-4310-af4d-c4687395b621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:17.123417 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1053/2138] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:20:17.153997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-3b614b2a-d954-4310-af4d-c4687395b621 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:17.154179 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-3b614b2a-d954-4310-af4d-c4687395b621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:17.253323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1086/2139] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:17.257704 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac7bbc-9fb5-4225-920e-09b2a5658e49 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:17.257880 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac7bbc-9fb5-4225-920e-09b2a5658e49 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:17.258162 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac7bbc-9fb5-4225-920e-09b2a5658e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:17.279177 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-15ac7bbc-9fb5-4225-920e-09b2a5658e49 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:17.280384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-15ac7bbc-9fb5-4225-920e-09b2a5658e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:17.290906 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1054/2140] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:17.295024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b614b2a-d954-4310-af4d-c4687395b621 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:17.308061 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b614b2a-d954-4310-af4d-c4687395b621 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:17.314945 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78b261-e8d2-4e9a-a140-19511581f3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:17.317110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78b261-e8d2-4e9a-a140-19511581f3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:17.317432 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78b261-e8d2-4e9a-a140-19511581f3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:17.317799 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78b261-e8d2-4e9a-a140-19511581f3d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:17.318550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78b261-e8d2-4e9a-a140-19511581f3d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:20:17.318853 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78b261-e8d2-4e9a-a140-19511581f3d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:17.320635 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78b261-e8d2-4e9a-a140-19511581f3d3 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:17.335758 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1087/2141] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:20:17.340245 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac7bbc-9fb5-4225-920e-09b2a5658e49 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:17.350259 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac7bbc-9fb5-4225-920e-09b2a5658e49 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:17.355257 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1083d-c539-4d73-aae7-8943438696bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:17.355908 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1083d-c539-4d73-aae7-8943438696bc admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:17.356215 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1083d-c539-4d73-aae7-8943438696bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:17.356490 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1083d-c539-4d73-aae7-8943438696bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:17.357251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1083d-c539-4d73-aae7-8943438696bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:17.359227 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1083d-c539-4d73-aae7-8943438696bc admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:17.412165 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78b261-e8d2-4e9a-a140-19511581f3d3 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:17.413944 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-1a78b261-e8d2-4e9a-a140-19511581f3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:17.431013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78b261-e8d2-4e9a-a140-19511581f3d3 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:17.435841 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35f1b7-6ecd-45b6-87a9-d64a10522d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:17.436722 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35f1b7-6ecd-45b6-87a9-d64a10522d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:17.437011 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35f1b7-6ecd-45b6-87a9-d64a10522d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:17.442815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35f1b7-6ecd-45b6-87a9-d64a10522d25 admin admin] PATH_INFO: `/v3/projects/50f2f77cca1a49afa17bd231d267c584` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:17.442815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35f1b7-6ecd-45b6-87a9-d64a10522d25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f2f77cca1a49afa17bd231d267c584)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:17.442815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35f1b7-6ecd-45b6-87a9-d64a10522d25 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:17.469314 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1055/2142] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:17 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:17.473450 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1083d-c539-4d73-aae7-8943438696bc admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:17.539794 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1083d-c539-4d73-aae7-8943438696bc admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:17.544436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c39435-6eb4-45af-b70a-f5793ebeba5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:17.545136 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c39435-6eb4-45af-b70a-f5793ebeba5f admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:17.545421 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c39435-6eb4-45af-b70a-f5793ebeba5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:17.545692 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c39435-6eb4-45af-b70a-f5793ebeba5f admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:17.546376 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c39435-6eb4-45af-b70a-f5793ebeba5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:17.548316 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c39435-6eb4-45af-b70a-f5793ebeba5f admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:17.589762 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dd35f1b7-6ecd-45b6-87a9-d64a10522d25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f2f77cca1a49afa17bd231d267c584', 'request_id': 'req-dd35f1b7-6ecd-45b6-87a9-d64a10522d25'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:17.594936 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dd35f1b7-6ecd-45b6-87a9-d64a10522d25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f2f77cca1a49afa17bd231d267c584', 'request_id': 'req-dd35f1b7-6ecd-45b6-87a9-d64a10522d25'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:17.602774 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dd35f1b7-6ecd-45b6-87a9-d64a10522d25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f2f77cca1a49afa17bd231d267c584', 'request_id': 'req-dd35f1b7-6ecd-45b6-87a9-d64a10522d25'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:17.681936 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1056/2143] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:17 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:17.686175 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c39435-6eb4-45af-b70a-f5793ebeba5f admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:17.695990 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c39435-6eb4-45af-b70a-f5793ebeba5f admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:17.705569 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dd35f1b7-6ecd-45b6-87a9-d64a10522d25 admin admin] The token cache is being invalidate because project 50f2f77cca1a49afa17bd231d267c584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:17.705569 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dd35f1b7-6ecd-45b6-87a9-d64a10522d25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:17.705569 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dd35f1b7-6ecd-45b6-87a9-d64a10522d25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:17.707273 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1088/2144] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:17 2022] DELETE /identity/v3/projects/50f2f77cca1a49afa17bd231d267c584 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:17.712742 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ec391-c193-4f44-ba27-ebc8c659ec58 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:17.713033 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ec391-c193-4f44-ba27-ebc8c659ec58 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:17.713345 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ec391-c193-4f44-ba27-ebc8c659ec58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:17.732108 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-020ec391-c193-4f44-ba27-ebc8c659ec58 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:17.733346 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-020ec391-c193-4f44-ba27-ebc8c659ec58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:17.763202 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c973a3-4ac0-4cbe-84f4-2908a65611ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:17.763725 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c973a3-4ac0-4cbe-84f4-2908a65611ce admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:17.764005 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c973a3-4ac0-4cbe-84f4-2908a65611ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:17.764277 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c973a3-4ac0-4cbe-84f4-2908a65611ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:17.765033 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c973a3-4ac0-4cbe-84f4-2908a65611ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:17.766639 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c973a3-4ac0-4cbe-84f4-2908a65611ce admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:17.777401 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1057/2145] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:20:17.781277 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c973a3-4ac0-4cbe-84f4-2908a65611ce admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:17.782955 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-71c973a3-4ac0-4cbe-84f4-2908a65611ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:17.795021 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c973a3-4ac0-4cbe-84f4-2908a65611ce admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:17.799851 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71494e28-4963-4bea-acb6-bf06fb1bfaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:17.801200 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71494e28-4963-4bea-acb6-bf06fb1bfaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:17.801486 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71494e28-4963-4bea-acb6-bf06fb1bfaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:17.801760 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71494e28-4963-4bea-acb6-bf06fb1bfaa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:17.802473 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71494e28-4963-4bea-acb6-bf06fb1bfaa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:17.804070 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71494e28-4963-4bea-acb6-bf06fb1bfaa6 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:17.804264 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1089/2146] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:17.812633 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249a00b-6e31-4821-966f-0af204c44746 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:17.812980 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249a00b-6e31-4821-966f-0af204c44746 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:17.813246 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249a00b-6e31-4821-966f-0af204c44746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:17.817999 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1058/2147] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:20:17.818783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71494e28-4963-4bea-acb6-bf06fb1bfaa6 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:17.828110 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71494e28-4963-4bea-acb6-bf06fb1bfaa6 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:17.833436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7644a7-72d1-462c-abcc-865b05d1e521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:17.833833 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-5249a00b-6e31-4821-966f-0af204c44746 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:17.836554 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7644a7-72d1-462c-abcc-865b05d1e521 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:17.836554 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7644a7-72d1-462c-abcc-865b05d1e521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:17.836554 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7644a7-72d1-462c-abcc-865b05d1e521 admin admin] PATH_INFO: `/v3/projects/e8ae287c699d464a80c5026e2ebfd7f2/users/de591c1b2feb46779c4eb3a867c262b8/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:17.836897 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-5249a00b-6e31-4821-966f-0af204c44746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:17.843068 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1090/2148] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:17.847908 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249a00b-6e31-4821-966f-0af204c44746 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:17.850166 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7644a7-72d1-462c-abcc-865b05d1e521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ae287c699d464a80c5026e2ebfd7f2, user_id=de591c1b2feb46779c4eb3a867c262b8, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:17.853213 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7644a7-72d1-462c-abcc-865b05d1e521 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:17.857012 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249a00b-6e31-4821-966f-0af204c44746 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:17.861781 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfaa5b7-3404-41ce-9c52-990b0d8daa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:17.865038 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaa5b7-3404-41ce-9c52-990b0d8daa87 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:17.865038 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaa5b7-3404-41ce-9c52-990b0d8daa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:17.865038 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaa5b7-3404-41ce-9c52-990b0d8daa87 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:17.865038 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfaa5b7-3404-41ce-9c52-990b0d8daa87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:20:17.865038 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfaa5b7-3404-41ce-9c52-990b0d8daa87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:17.865888 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfaa5b7-3404-41ce-9c52-990b0d8daa87 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:17.882748 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1091/2149] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:20:17.887066 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfaa5b7-3404-41ce-9c52-990b0d8daa87 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:17.905068 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfaa5b7-3404-41ce-9c52-990b0d8daa87 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:17.905068 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994d482-99c9-4518-9d03-602c25e106ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:17.905068 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994d482-99c9-4518-9d03-602c25e106ee admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:17.905068 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994d482-99c9-4518-9d03-602c25e106ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:17.905495 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994d482-99c9-4518-9d03-602c25e106ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:17.905495 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994d482-99c9-4518-9d03-602c25e106ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:17.906607 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994d482-99c9-4518-9d03-602c25e106ee admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:17.964898 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1059/2150] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:17 2022] PUT /identity/v3/projects/e8ae287c699d464a80c5026e2ebfd7f2/users/de591c1b2feb46779c4eb3a867c262b8/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:17.990852 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afdfe3-257c-4537-b893-e9a6914dc4a6 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:17.996592 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afdfe3-257c-4537-b893-e9a6914dc4a6 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:17.996592 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afdfe3-257c-4537-b893-e9a6914dc4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:18.029077 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-31afdfe3-257c-4537-b893-e9a6914dc4a6 None None] MFA Rules not processed for user `de591c1b2feb46779c4eb3a867c262b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:18.030542 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-31afdfe3-257c-4537-b893-e9a6914dc4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:18.057168 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1092/2151] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:17 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:18.058216 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994d482-99c9-4518-9d03-602c25e106ee admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:18.125146 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1060/2152] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:18.131458 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afdfe3-257c-4537-b893-e9a6914dc4a6 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:18.144013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994d482-99c9-4518-9d03-602c25e106ee admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:18.144750 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa7c86-c816-4f09-b61b-a979885971b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:18.146037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa7c86-c816-4f09-b61b-a979885971b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:18.146496 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa7c86-c816-4f09-b61b-a979885971b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:18.146769 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa7c86-c816-4f09-b61b-a979885971b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:18.147476 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa7c86-c816-4f09-b61b-a979885971b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:18.149577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa7c86-c816-4f09-b61b-a979885971b3 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:18.199225 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afdfe3-257c-4537-b893-e9a6914dc4a6 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:18.203890 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bfeba-8733-4a52-be37-f15a8cc664a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:18.204455 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bfeba-8733-4a52-be37-f15a8cc664a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:18.204768 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bfeba-8733-4a52-be37-f15a8cc664a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:18.205139 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bfeba-8733-4a52-be37-f15a8cc664a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:18.205840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bfeba-8733-4a52-be37-f15a8cc664a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:18.208016 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bfeba-8733-4a52-be37-f15a8cc664a3 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:18.344721 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1061/2153] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:18 2022] POST /identity/v3/projects => generated 371 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:18.349049 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1093/2154] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:18 2022] POST /identity/v3/users => generated 291 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:18.349959 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bfeba-8733-4a52-be37-f15a8cc664a3 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:18.351324 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa7c86-c816-4f09-b61b-a979885971b3 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:18.362492 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa7c86-c816-4f09-b61b-a979885971b3 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:18.429306 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc3b5c-6149-4d6f-803c-b977dda67200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:18.429995 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc3b5c-6149-4d6f-803c-b977dda67200 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:18.430280 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc3b5c-6149-4d6f-803c-b977dda67200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:18.430536 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc3b5c-6149-4d6f-803c-b977dda67200 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:18.431200 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bfeba-8733-4a52-be37-f15a8cc664a3 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:18.431299 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc3b5c-6149-4d6f-803c-b977dda67200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:18.432880 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc3b5c-6149-4d6f-803c-b977dda67200 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:18.435802 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e84d16-4f0c-4b2b-9e6e-f9536143bf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:18.436454 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e84d16-4f0c-4b2b-9e6e-f9536143bf73 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:18.436763 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e84d16-4f0c-4b2b-9e6e-f9536143bf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:18.437040 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e84d16-4f0c-4b2b-9e6e-f9536143bf73 admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:18.437731 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e84d16-4f0c-4b2b-9e6e-f9536143bf73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:18.439707 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e84d16-4f0c-4b2b-9e6e-f9536143bf73 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:18.446083 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1094/2155] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:18.447162 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc3b5c-6149-4d6f-803c-b977dda67200 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:18.458160 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc3b5c-6149-4d6f-803c-b977dda67200 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:18.463057 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73c65c-ee53-4902-b88a-fb853f93d4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:18.463719 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73c65c-ee53-4902-b88a-fb853f93d4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:18.463998 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73c65c-ee53-4902-b88a-fb853f93d4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:18.464353 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73c65c-ee53-4902-b88a-fb853f93d4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:18.465024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73c65c-ee53-4902-b88a-fb853f93d4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:18.466636 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73c65c-ee53-4902-b88a-fb853f93d4a2 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:18.478902 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1095/2156] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:18.483364 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73c65c-ee53-4902-b88a-fb853f93d4a2 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:18.494949 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73c65c-ee53-4902-b88a-fb853f93d4a2 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:18.501360 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc8219-d8e1-4b09-b8f7-6091114ed27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:18.504806 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc8219-d8e1-4b09-b8f7-6091114ed27e admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:18.505146 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc8219-d8e1-4b09-b8f7-6091114ed27e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:18.505439 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc8219-d8e1-4b09-b8f7-6091114ed27e admin admin] PATH_INFO: `/v3/projects/79b5b498a60248d3aedb25d879c5c923/users/5f1befc68f5a43c492efef77b1ec480a/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:18.523948 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc8219-d8e1-4b09-b8f7-6091114ed27e admin admin] RBAC: Authorizing `identity:create_grant(project_id=79b5b498a60248d3aedb25d879c5c923, user_id=5f1befc68f5a43c492efef77b1ec480a, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:18.526985 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc8219-d8e1-4b09-b8f7-6091114ed27e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:18.559486 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1062/2157] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:18 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:18.566056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e84d16-4f0c-4b2b-9e6e-f9536143bf73 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:18.583818 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e84d16-4f0c-4b2b-9e6e-f9536143bf73 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:18.592764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6d2bc-3549-4533-bfee-cfa3d84c1521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:18.593797 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6d2bc-3549-4533-bfee-cfa3d84c1521 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:18.594248 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6d2bc-3549-4533-bfee-cfa3d84c1521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:18.594473 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6d2bc-3549-4533-bfee-cfa3d84c1521 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:18.604729 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6d2bc-3549-4533-bfee-cfa3d84c1521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:18.607995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6d2bc-3549-4533-bfee-cfa3d84c1521 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:18.623614 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1063/2158] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:20:18.628177 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6d2bc-3549-4533-bfee-cfa3d84c1521 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:18.632213 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1096/2159] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:18 2022] PUT /identity/v3/projects/79b5b498a60248d3aedb25d879c5c923/users/5f1befc68f5a43c492efef77b1ec480a/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:18.633740 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca98394-4904-4d20-aecb-cedb8e16d5aa None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:18.634038 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca98394-4904-4d20-aecb-cedb8e16d5aa None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:18.634320 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca98394-4904-4d20-aecb-cedb8e16d5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:18.637735 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6d2bc-3549-4533-bfee-cfa3d84c1521 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:18.652542 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-8ca98394-4904-4d20-aecb-cedb8e16d5aa None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:18.653778 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-8ca98394-4904-4d20-aecb-cedb8e16d5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:18.710533 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4343b-4acb-4895-9ede-37fd022508f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:18.711414 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4343b-4acb-4895-9ede-37fd022508f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:18.711834 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4343b-4acb-4895-9ede-37fd022508f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:18.712114 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4343b-4acb-4895-9ede-37fd022508f2 admin admin] PATH_INFO: `/v3/projects/5374c2da70494b5fa3d31271826f1c97/users/4a820fdf6e2b4c989ffb2dd1aac7b686/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:18.728270 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1097/2160] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:18.732062 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4343b-4acb-4895-9ede-37fd022508f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5374c2da70494b5fa3d31271826f1c97, user_id=4a820fdf6e2b4c989ffb2dd1aac7b686, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:18.734858 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4343b-4acb-4895-9ede-37fd022508f2 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:18.738040 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca98394-4904-4d20-aecb-cedb8e16d5aa None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:18.739442 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-8ca98394-4904-4d20-aecb-cedb8e16d5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:18.796592 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca98394-4904-4d20-aecb-cedb8e16d5aa None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:18.800004 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1064/2161] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:18 2022] PUT /identity/v3/projects/5374c2da70494b5fa3d31271826f1c97/users/4a820fdf6e2b4c989ffb2dd1aac7b686/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:18.804220 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4343b-4acb-4895-9ede-37fd022508f2 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:18.848315 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e05df-30fc-4c87-b572-bb1538443365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:18.849026 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e05df-30fc-4c87-b572-bb1538443365 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:18.849267 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e05df-30fc-4c87-b572-bb1538443365 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:18.849595 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e05df-30fc-4c87-b572-bb1538443365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:18.865161 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4343b-4acb-4895-9ede-37fd022508f2 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:18.871486 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c77ecf-585e-4dd7-89a0-8a8717a1596b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:18.872228 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c77ecf-585e-4dd7-89a0-8a8717a1596b admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:18.872512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c77ecf-585e-4dd7-89a0-8a8717a1596b admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:18.872826 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c77ecf-585e-4dd7-89a0-8a8717a1596b admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:18.873570 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c77ecf-585e-4dd7-89a0-8a8717a1596b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:18.875209 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c77ecf-585e-4dd7-89a0-8a8717a1596b admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:18.887001 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1065/2162] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:20:18.896082 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c77ecf-585e-4dd7-89a0-8a8717a1596b admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:18.906305 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c77ecf-585e-4dd7-89a0-8a8717a1596b admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:18.911423 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3506b-64ab-4c65-b415-65d0678258bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:18.912307 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3506b-64ab-4c65-b415-65d0678258bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:18.912605 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3506b-64ab-4c65-b415-65d0678258bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:18.912931 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3506b-64ab-4c65-b415-65d0678258bc admin admin] PATH_INFO: `/v3/projects/5374c2da70494b5fa3d31271826f1c97/users/4a820fdf6e2b4c989ffb2dd1aac7b686/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:18.914978 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3506b-64ab-4c65-b415-65d0678258bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5374c2da70494b5fa3d31271826f1c97, user_id=4a820fdf6e2b4c989ffb2dd1aac7b686, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:18.915097 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e05df-30fc-4c87-b572-bb1538443365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:18.917107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e05df-30fc-4c87-b572-bb1538443365 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:18.917719 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3506b-64ab-4c65-b415-65d0678258bc admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:18.929274 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1066/2163] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:18 2022] PUT /identity/v3/projects/5374c2da70494b5fa3d31271826f1c97/users/4a820fdf6e2b4c989ffb2dd1aac7b686/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:18.932275 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1098/2164] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:20:18.945136 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b350a-fa7c-4519-b33d-c73d239c050e None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:18.945431 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b350a-fa7c-4519-b33d-c73d239c050e None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:18.945721 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b350a-fa7c-4519-b33d-c73d239c050e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:18.973889 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-457b350a-fa7c-4519-b33d-c73d239c050e None None] MFA Rules not processed for user `4a820fdf6e2b4c989ffb2dd1aac7b686`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:18.975093 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-457b350a-fa7c-4519-b33d-c73d239c050e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:19.052183 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1067/2165] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:18 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:19.328259 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e05df-30fc-4c87-b572-bb1538443365 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:19.329739 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-408e05df-30fc-4c87-b572-bb1538443365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:19.391315 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e05df-30fc-4c87-b572-bb1538443365 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:19.448173 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967edad8-41d0-4411-b7c0-347a3d4edd8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:19.448863 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967edad8-41d0-4411-b7c0-347a3d4edd8a service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:19.449214 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967edad8-41d0-4411-b7c0-347a3d4edd8a service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:19.449418 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967edad8-41d0-4411-b7c0-347a3d4edd8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:19.461621 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967edad8-41d0-4411-b7c0-347a3d4edd8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:19.463336 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967edad8-41d0-4411-b7c0-347a3d4edd8a service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:19.473374 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1099/2166] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:19.815010 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b350a-fa7c-4519-b33d-c73d239c050e None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:19.825093 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b350a-fa7c-4519-b33d-c73d239c050e None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:19.828730 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02846a93-86c6-4647-b678-b30fdcdddedb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:19.829373 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02846a93-86c6-4647-b678-b30fdcdddedb service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:19.829658 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02846a93-86c6-4647-b678-b30fdcdddedb service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:19.829935 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02846a93-86c6-4647-b678-b30fdcdddedb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:19.887224 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02846a93-86c6-4647-b678-b30fdcdddedb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:19.888682 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02846a93-86c6-4647-b678-b30fdcdddedb service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:19.898363 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1068/2167] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:20.258712 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967edad8-41d0-4411-b7c0-347a3d4edd8a service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:20.260854 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-967edad8-41d0-4411-b7c0-347a3d4edd8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:20.273302 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02846a93-86c6-4647-b678-b30fdcdddedb service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:20.274722 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-02846a93-86c6-4647-b678-b30fdcdddedb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:20.330164 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967edad8-41d0-4411-b7c0-347a3d4edd8a service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:20.335387 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d195c-26c0-4985-8768-e460d6756110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:20.336257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d195c-26c0-4985-8768-e460d6756110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:20.336575 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d195c-26c0-4985-8768-e460d6756110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:20.337060 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d195c-26c0-4985-8768-e460d6756110 admin admin] PATH_INFO: `/v3/users/3d9fd1bb10b24cb68241cb513be446b4` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:20.338627 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d195c-26c0-4985-8768-e460d6756110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d9fd1bb10b24cb68241cb513be446b4)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:20.340411 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d195c-26c0-4985-8768-e460d6756110 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:20.345310 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02846a93-86c6-4647-b678-b30fdcdddedb service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:20.350896 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d4dd5-973a-47a6-8d93-27d79e4b0431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:20.352056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d4dd5-973a-47a6-8d93-27d79e4b0431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:20.352308 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d4dd5-973a-47a6-8d93-27d79e4b0431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:20.352967 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d4dd5-973a-47a6-8d93-27d79e4b0431 admin admin] PATH_INFO: `/v3/users/05edc58237674712ae8988580c813d66` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:20.354204 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d4dd5-973a-47a6-8d93-27d79e4b0431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05edc58237674712ae8988580c813d66)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:20.357193 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d4dd5-973a-47a6-8d93-27d79e4b0431 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:20.559303 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d51d195c-26c0-4985-8768-e460d6756110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d9fd1bb10b24cb68241cb513be446b4'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:20.559948 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1e4d4dd5-973a-47a6-8d93-27d79e4b0431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05edc58237674712ae8988580c813d66'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:20.572599 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d51d195c-26c0-4985-8768-e460d6756110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d9fd1bb10b24cb68241cb513be446b4'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:20.573606 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d51d195c-26c0-4985-8768-e460d6756110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d9fd1bb10b24cb68241cb513be446b4'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:20.577124 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1e4d4dd5-973a-47a6-8d93-27d79e4b0431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05edc58237674712ae8988580c813d66'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:20.577245 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d51d195c-26c0-4985-8768-e460d6756110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d9fd1bb10b24cb68241cb513be446b4'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:20.577339 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1e4d4dd5-973a-47a6-8d93-27d79e4b0431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05edc58237674712ae8988580c813d66'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:20.581887 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d51d195c-26c0-4985-8768-e460d6756110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d9fd1bb10b24cb68241cb513be446b4'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:20.662563 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1e4d4dd5-973a-47a6-8d93-27d79e4b0431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05edc58237674712ae8988580c813d66'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:20.663188 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1e4d4dd5-973a-47a6-8d93-27d79e4b0431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05edc58237674712ae8988580c813d66'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:20.682104 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1069/2168] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:20 2022] DELETE /identity/v3/users/05edc58237674712ae8988580c813d66 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:20.683499 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245f4e5-e3f4-4cda-9052-ff4a481735b6 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:20.683782 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245f4e5-e3f4-4cda-9052-ff4a481735b6 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:20.684055 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245f4e5-e3f4-4cda-9052-ff4a481735b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:20.710951 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-b245f4e5-e3f4-4cda-9052-ff4a481735b6 None None] MFA Rules not processed for user `5f1befc68f5a43c492efef77b1ec480a`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:20.712157 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b245f4e5-e3f4-4cda-9052-ff4a481735b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:20.727120 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1100/2169] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:20 2022] DELETE /identity/v3/users/3d9fd1bb10b24cb68241cb513be446b4 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:20.731761 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87526718-901d-4f7f-8558-ce504c430f64 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:20.732073 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87526718-901d-4f7f-8558-ce504c430f64 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:20.732442 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87526718-901d-4f7f-8558-ce504c430f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:20.752944 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-87526718-901d-4f7f-8558-ce504c430f64 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:20.754919 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-87526718-901d-4f7f-8558-ce504c430f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:20.780941 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1070/2170] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:20.782651 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd564dd9-18e2-41be-bb34-637bef152b46 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:20.783098 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd564dd9-18e2-41be-bb34-637bef152b46 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:20.783400 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd564dd9-18e2-41be-bb34-637bef152b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:20.801605 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-cd564dd9-18e2-41be-bb34-637bef152b46 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:20.802793 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-cd564dd9-18e2-41be-bb34-637bef152b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:20.818978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1101/2171] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:20.818978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87526718-901d-4f7f-8558-ce504c430f64 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:20.818978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-87526718-901d-4f7f-8558-ce504c430f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:20.865294 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1071/2172] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:20.866149 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd564dd9-18e2-41be-bb34-637bef152b46 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:20.869488 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-cd564dd9-18e2-41be-bb34-637bef152b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:20.883678 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87526718-901d-4f7f-8558-ce504c430f64 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:20.888164 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330496af-657c-4341-a3cb-3eddd36e9c89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:20.892248 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330496af-657c-4341-a3cb-3eddd36e9c89 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:20.892248 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330496af-657c-4341-a3cb-3eddd36e9c89 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:20.892248 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330496af-657c-4341-a3cb-3eddd36e9c89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:20.926435 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd564dd9-18e2-41be-bb34-637bef152b46 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:20.930331 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea2366-6384-4769-846b-b5ab923fa127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:20.930989 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea2366-6384-4769-846b-b5ab923fa127 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:20.931529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea2366-6384-4769-846b-b5ab923fa127 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:20.931754 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea2366-6384-4769-846b-b5ab923fa127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:20.942326 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea2366-6384-4769-846b-b5ab923fa127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:20.943780 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea2366-6384-4769-846b-b5ab923fa127 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:20.945825 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330496af-657c-4341-a3cb-3eddd36e9c89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:20.947258 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330496af-657c-4341-a3cb-3eddd36e9c89 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:20.953350 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1072/2173] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:20.954141 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea2366-6384-4769-846b-b5ab923fa127 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:20.955437 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f4ea2366-6384-4769-846b-b5ab923fa127 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:20.956256 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1102/2174] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:20.967841 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea2366-6384-4769-846b-b5ab923fa127 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:20.971886 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac74d46-101a-4975-8778-393f7043b6a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:20.972597 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac74d46-101a-4975-8778-393f7043b6a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:20.973403 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac74d46-101a-4975-8778-393f7043b6a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:20.973679 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac74d46-101a-4975-8778-393f7043b6a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:20.983944 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac74d46-101a-4975-8778-393f7043b6a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:20.985470 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac74d46-101a-4975-8778-393f7043b6a2 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:20.996905 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1073/2175] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:21.484095 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330496af-657c-4341-a3cb-3eddd36e9c89 service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:21.485662 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-330496af-657c-4341-a3cb-3eddd36e9c89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:21.499942 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330496af-657c-4341-a3cb-3eddd36e9c89 service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:21.517179 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea149316-fa44-4f51-99df-e82ae30b85dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:21.518736 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea149316-fa44-4f51-99df-e82ae30b85dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:21.519125 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea149316-fa44-4f51-99df-e82ae30b85dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:21.520254 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea149316-fa44-4f51-99df-e82ae30b85dd admin admin] PATH_INFO: `/v3/projects/d1d47cf972574639a23135b54f92c99e` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:21.526632 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea149316-fa44-4f51-99df-e82ae30b85dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d47cf972574639a23135b54f92c99e)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:21.529294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea149316-fa44-4f51-99df-e82ae30b85dd admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:21.659148 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ea149316-fa44-4f51-99df-e82ae30b85dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d47cf972574639a23135b54f92c99e', 'request_id': 'req-ea149316-fa44-4f51-99df-e82ae30b85dd'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:21.665262 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ea149316-fa44-4f51-99df-e82ae30b85dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d47cf972574639a23135b54f92c99e', 'request_id': 'req-ea149316-fa44-4f51-99df-e82ae30b85dd'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:21.671392 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ea149316-fa44-4f51-99df-e82ae30b85dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d47cf972574639a23135b54f92c99e', 'request_id': 'req-ea149316-fa44-4f51-99df-e82ae30b85dd'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:21.687429 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac74d46-101a-4975-8778-393f7043b6a2 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:21.689117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-9ac74d46-101a-4975-8778-393f7043b6a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:21.725081 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac74d46-101a-4975-8778-393f7043b6a2 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:21.733006 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ea149316-fa44-4f51-99df-e82ae30b85dd admin admin] The token cache is being invalidate because project d1d47cf972574639a23135b54f92c99e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:21.733392 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ea149316-fa44-4f51-99df-e82ae30b85dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:21.734122 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ea149316-fa44-4f51-99df-e82ae30b85dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:21.735802 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1103/2176] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:21 2022] DELETE /identity/v3/projects/d1d47cf972574639a23135b54f92c99e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:21.740953 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea149316-fa44-4f51-99df-e82ae30b85dd admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:21.742373 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-ea149316-fa44-4f51-99df-e82ae30b85dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:21.791839 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1b9f7-d6f7-4548-93fd-a39fe34cb0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:21.792712 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1b9f7-d6f7-4548-93fd-a39fe34cb0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:21.793075 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1b9f7-d6f7-4548-93fd-a39fe34cb0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:21.793353 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1b9f7-d6f7-4548-93fd-a39fe34cb0f3 admin admin] PATH_INFO: `/v3/projects/d6bbbe44158f4db3855012faa4b1d9e0` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:21.794514 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1b9f7-d6f7-4548-93fd-a39fe34cb0f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6bbbe44158f4db3855012faa4b1d9e0)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:21.796554 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1b9f7-d6f7-4548-93fd-a39fe34cb0f3 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:21.810700 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea149316-fa44-4f51-99df-e82ae30b85dd admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:21.816551 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739016f-d62c-49f5-b3cc-edb545696b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:21.818140 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739016f-d62c-49f5-b3cc-edb545696b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:21.818579 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739016f-d62c-49f5-b3cc-edb545696b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:21.819031 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739016f-d62c-49f5-b3cc-edb545696b81 admin admin] PATH_INFO: `/v3/users/41b37145b0fd45b9821dfcf07283371c` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:21.820797 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739016f-d62c-49f5-b3cc-edb545696b81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b37145b0fd45b9821dfcf07283371c)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:21.822961 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739016f-d62c-49f5-b3cc-edb545696b81 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:21.897318 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-43c1b9f7-d6f7-4548-93fd-a39fe34cb0f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6bbbe44158f4db3855012faa4b1d9e0', 'request_id': 'req-43c1b9f7-d6f7-4548-93fd-a39fe34cb0f3'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:22.027994 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-43c1b9f7-d6f7-4548-93fd-a39fe34cb0f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6bbbe44158f4db3855012faa4b1d9e0', 'request_id': 'req-43c1b9f7-d6f7-4548-93fd-a39fe34cb0f3'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:22.037881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-43c1b9f7-d6f7-4548-93fd-a39fe34cb0f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6bbbe44158f4db3855012faa4b1d9e0', 'request_id': 'req-43c1b9f7-d6f7-4548-93fd-a39fe34cb0f3'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:22.045758 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f739016f-d62c-49f5-b3cc-edb545696b81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b37145b0fd45b9821dfcf07283371c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:22.057630 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f739016f-d62c-49f5-b3cc-edb545696b81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b37145b0fd45b9821dfcf07283371c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:22.058645 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f739016f-d62c-49f5-b3cc-edb545696b81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b37145b0fd45b9821dfcf07283371c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:22.059458 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f739016f-d62c-49f5-b3cc-edb545696b81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b37145b0fd45b9821dfcf07283371c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:22.063106 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-43c1b9f7-d6f7-4548-93fd-a39fe34cb0f3 admin admin] The token cache is being invalidate because project d6bbbe44158f4db3855012faa4b1d9e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:22.063785 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-43c1b9f7-d6f7-4548-93fd-a39fe34cb0f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:22.065101 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-43c1b9f7-d6f7-4548-93fd-a39fe34cb0f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:22.067903 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f739016f-d62c-49f5-b3cc-edb545696b81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b37145b0fd45b9821dfcf07283371c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:22.070719 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1074/2177] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:21 2022] DELETE /identity/v3/projects/d6bbbe44158f4db3855012faa4b1d9e0 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:22.071859 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1b9f7-d6f7-4548-93fd-a39fe34cb0f3 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:22.073595 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-43c1b9f7-d6f7-4548-93fd-a39fe34cb0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:22.138684 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1b9f7-d6f7-4548-93fd-a39fe34cb0f3 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:22.143302 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d695ad-f792-4bed-bd67-a63f6f5b6576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:22.144168 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d695ad-f792-4bed-bd67-a63f6f5b6576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:22.145078 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d695ad-f792-4bed-bd67-a63f6f5b6576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:22.145402 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d695ad-f792-4bed-bd67-a63f6f5b6576 admin admin] PATH_INFO: `/v3/users/8eb63bfa0b7b440bbb8258fcbad43a13` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:22.146600 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d695ad-f792-4bed-bd67-a63f6f5b6576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eb63bfa0b7b440bbb8258fcbad43a13)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:22.148549 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d695ad-f792-4bed-bd67-a63f6f5b6576 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:22.167338 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1104/2178] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:21 2022] DELETE /identity/v3/users/41b37145b0fd45b9821dfcf07283371c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:22.336979 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e0d695ad-f792-4bed-bd67-a63f6f5b6576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eb63bfa0b7b440bbb8258fcbad43a13'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:22.349846 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e0d695ad-f792-4bed-bd67-a63f6f5b6576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eb63bfa0b7b440bbb8258fcbad43a13'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:22.350811 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e0d695ad-f792-4bed-bd67-a63f6f5b6576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eb63bfa0b7b440bbb8258fcbad43a13'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:22.412785 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e0d695ad-f792-4bed-bd67-a63f6f5b6576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eb63bfa0b7b440bbb8258fcbad43a13'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:22.413807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e0d695ad-f792-4bed-bd67-a63f6f5b6576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eb63bfa0b7b440bbb8258fcbad43a13'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:22.431606 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1075/2179] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:22 2022] DELETE /identity/v3/users/8eb63bfa0b7b440bbb8258fcbad43a13 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:22.606818 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739016f-d62c-49f5-b3cc-edb545696b81 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:22.608385 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f739016f-d62c-49f5-b3cc-edb545696b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:22.675632 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739016f-d62c-49f5-b3cc-edb545696b81 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:22.734453 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c900b-215c-4bd1-86da-b59a4ad1efee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:22.735386 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c900b-215c-4bd1-86da-b59a4ad1efee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:22.735791 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c900b-215c-4bd1-86da-b59a4ad1efee admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:22.736063 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c900b-215c-4bd1-86da-b59a4ad1efee admin admin] PATH_INFO: `/v3/projects/d56ced5f199643798a118ba57df363ea` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:22.737296 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c900b-215c-4bd1-86da-b59a4ad1efee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d56ced5f199643798a118ba57df363ea)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:22.739761 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c900b-215c-4bd1-86da-b59a4ad1efee admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:22.870984 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a22c900b-215c-4bd1-86da-b59a4ad1efee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd56ced5f199643798a118ba57df363ea', 'request_id': 'req-a22c900b-215c-4bd1-86da-b59a4ad1efee'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:22.877140 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a22c900b-215c-4bd1-86da-b59a4ad1efee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd56ced5f199643798a118ba57df363ea', 'request_id': 'req-a22c900b-215c-4bd1-86da-b59a4ad1efee'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:22.883275 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a22c900b-215c-4bd1-86da-b59a4ad1efee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd56ced5f199643798a118ba57df363ea', 'request_id': 'req-a22c900b-215c-4bd1-86da-b59a4ad1efee'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:23.024364 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a22c900b-215c-4bd1-86da-b59a4ad1efee admin admin] The token cache is being invalidate because project d56ced5f199643798a118ba57df363ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:23.024682 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a22c900b-215c-4bd1-86da-b59a4ad1efee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:23.025323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a22c900b-215c-4bd1-86da-b59a4ad1efee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:23.026874 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1105/2180] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:22 2022] DELETE /identity/v3/projects/d56ced5f199643798a118ba57df363ea => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:23.032104 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33e985-a460-4725-bdbf-41fcd8bd6529 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:23.032907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33e985-a460-4725-bdbf-41fcd8bd6529 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:23.033388 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33e985-a460-4725-bdbf-41fcd8bd6529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:23.053084 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-fe33e985-a460-4725-bdbf-41fcd8bd6529 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:23.057801 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-fe33e985-a460-4725-bdbf-41fcd8bd6529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:23.114588 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1076/2181] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:23.122735 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a45fc4-c58e-4ee7-8420-e9dbcd5fcdd4 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:23.123032 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a45fc4-c58e-4ee7-8420-e9dbcd5fcdd4 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:23.123321 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a45fc4-c58e-4ee7-8420-e9dbcd5fcdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:23.141304 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-57a45fc4-c58e-4ee7-8420-e9dbcd5fcdd4 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:23.142561 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-57a45fc4-c58e-4ee7-8420-e9dbcd5fcdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:23.151684 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1106/2182] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:23.158305 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33e985-a460-4725-bdbf-41fcd8bd6529 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:23.163787 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a45fc4-c58e-4ee7-8420-e9dbcd5fcdd4 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:23.165545 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-57a45fc4-c58e-4ee7-8420-e9dbcd5fcdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:23.178349 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33e985-a460-4725-bdbf-41fcd8bd6529 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:23.180593 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a45fc4-c58e-4ee7-8420-e9dbcd5fcdd4 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:23.186319 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a9e09-5b93-4bfb-ac3a-ca25f8f4b91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:23.187192 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a9e09-5b93-4bfb-ac3a-ca25f8f4b91d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:23.187923 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a9e09-5b93-4bfb-ac3a-ca25f8f4b91d admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:23.188259 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a9e09-5b93-4bfb-ac3a-ca25f8f4b91d admin admin] PATH_INFO: `/v3/projects/a2f42fbc590f4ae88e34f0b3903c6de7` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:23.190410 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a9e09-5b93-4bfb-ac3a-ca25f8f4b91d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f42fbc590f4ae88e34f0b3903c6de7)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:23.194194 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a9e09-5b93-4bfb-ac3a-ca25f8f4b91d admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:23.218536 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89be2f1-db83-4b46-9374-21a3791a6597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:23.218536 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89be2f1-db83-4b46-9374-21a3791a6597 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:23.220035 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89be2f1-db83-4b46-9374-21a3791a6597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:23.220452 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89be2f1-db83-4b46-9374-21a3791a6597 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:23.221485 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89be2f1-db83-4b46-9374-21a3791a6597 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:20:23.222007 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89be2f1-db83-4b46-9374-21a3791a6597 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:23.224902 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89be2f1-db83-4b46-9374-21a3791a6597 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:23.237442 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1077/2183] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:20:23.241946 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89be2f1-db83-4b46-9374-21a3791a6597 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:23.251852 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89be2f1-db83-4b46-9374-21a3791a6597 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:23.256623 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d24459-16fd-4a6f-9ab6-c683157e9d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:23.258331 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d24459-16fd-4a6f-9ab6-c683157e9d54 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:23.258331 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d24459-16fd-4a6f-9ab6-c683157e9d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:23.258331 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d24459-16fd-4a6f-9ab6-c683157e9d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:23.258737 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d24459-16fd-4a6f-9ab6-c683157e9d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:23.260675 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d24459-16fd-4a6f-9ab6-c683157e9d54 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:23.327548 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-5f5a9e09-5b93-4bfb-ac3a-ca25f8f4b91d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f42fbc590f4ae88e34f0b3903c6de7', 'request_id': 'req-5f5a9e09-5b93-4bfb-ac3a-ca25f8f4b91d'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:23.334565 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-5f5a9e09-5b93-4bfb-ac3a-ca25f8f4b91d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f42fbc590f4ae88e34f0b3903c6de7', 'request_id': 'req-5f5a9e09-5b93-4bfb-ac3a-ca25f8f4b91d'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:23.340759 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-5f5a9e09-5b93-4bfb-ac3a-ca25f8f4b91d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f42fbc590f4ae88e34f0b3903c6de7', 'request_id': 'req-5f5a9e09-5b93-4bfb-ac3a-ca25f8f4b91d'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:23.376426 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1078/2184] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:23 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:23.377591 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d24459-16fd-4a6f-9ab6-c683157e9d54 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:23.439084 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d24459-16fd-4a6f-9ab6-c683157e9d54 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:23.444849 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6f34e-1e73-4210-8f7e-e032a143f88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:23.446372 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6f34e-1e73-4210-8f7e-e032a143f88b admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:23.446624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6f34e-1e73-4210-8f7e-e032a143f88b admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:23.446950 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6f34e-1e73-4210-8f7e-e032a143f88b admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:23.448045 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6f34e-1e73-4210-8f7e-e032a143f88b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:23.450112 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-5f5a9e09-5b93-4bfb-ac3a-ca25f8f4b91d admin admin] The token cache is being invalidate because project a2f42fbc590f4ae88e34f0b3903c6de7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:23.456297 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-5f5a9e09-5b93-4bfb-ac3a-ca25f8f4b91d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:23.457718 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6f34e-1e73-4210-8f7e-e032a143f88b admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:23.457921 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-5f5a9e09-5b93-4bfb-ac3a-ca25f8f4b91d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:23.457921 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1107/2185] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:23 2022] DELETE /identity/v3/projects/a2f42fbc590f4ae88e34f0b3903c6de7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:23.463266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b267d3-962d-4efd-b702-6bac5d8bfb4e None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:23.463266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b267d3-962d-4efd-b702-6bac5d8bfb4e None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:23.463567 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b267d3-962d-4efd-b702-6bac5d8bfb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:23.484541 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-e5b267d3-962d-4efd-b702-6bac5d8bfb4e None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:23.485765 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e5b267d3-962d-4efd-b702-6bac5d8bfb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:23.494570 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1108/2186] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:23.502230 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52463ec-0203-49fd-a3fc-bccffed8fe2b None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:23.502618 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52463ec-0203-49fd-a3fc-bccffed8fe2b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:23.502888 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52463ec-0203-49fd-a3fc-bccffed8fe2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:23.522995 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-e52463ec-0203-49fd-a3fc-bccffed8fe2b None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:23.524146 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e52463ec-0203-49fd-a3fc-bccffed8fe2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:23.532331 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1109/2187] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:23.537307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52463ec-0203-49fd-a3fc-bccffed8fe2b None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:23.538691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1079/2188] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:23 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:23.542663 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6f34e-1e73-4210-8f7e-e032a143f88b admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:23.544293 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-19d6f34e-1e73-4210-8f7e-e032a143f88b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:23.547052 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52463ec-0203-49fd-a3fc-bccffed8fe2b None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:23.552320 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b4e0c-dfe4-45ef-9c5e-86e26ee6d104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:23.553032 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b4e0c-dfe4-45ef-9c5e-86e26ee6d104 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:23.553307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b4e0c-dfe4-45ef-9c5e-86e26ee6d104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:23.553584 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b4e0c-dfe4-45ef-9c5e-86e26ee6d104 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:23.554315 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b4e0c-dfe4-45ef-9c5e-86e26ee6d104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:20:23.554624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b4e0c-dfe4-45ef-9c5e-86e26ee6d104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:23.556251 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b4e0c-dfe4-45ef-9c5e-86e26ee6d104 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:23.556849 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6f34e-1e73-4210-8f7e-e032a143f88b admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:23.561412 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6888f5-d858-4704-be5d-92786ed611bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:23.562091 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6888f5-d858-4704-be5d-92786ed611bd admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:23.562375 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6888f5-d858-4704-be5d-92786ed611bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:23.562648 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6888f5-d858-4704-be5d-92786ed611bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:23.563451 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6888f5-d858-4704-be5d-92786ed611bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:23.565069 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6888f5-d858-4704-be5d-92786ed611bd admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:23.569302 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1110/2189] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:20:23.573455 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b4e0c-dfe4-45ef-9c5e-86e26ee6d104 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:23.578893 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1080/2190] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:23.580528 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6888f5-d858-4704-be5d-92786ed611bd admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:23.586311 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b4e0c-dfe4-45ef-9c5e-86e26ee6d104 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:23.591249 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03958cb5-3796-4e02-b808-e8d1cf3389c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:23.591952 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03958cb5-3796-4e02-b808-e8d1cf3389c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:23.592244 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03958cb5-3796-4e02-b808-e8d1cf3389c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:23.592526 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03958cb5-3796-4e02-b808-e8d1cf3389c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:23.593256 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03958cb5-3796-4e02-b808-e8d1cf3389c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:23.593362 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6888f5-d858-4704-be5d-92786ed611bd admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:23.595247 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03958cb5-3796-4e02-b808-e8d1cf3389c5 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:23.598403 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fb8d2-dc08-4cb6-9b2c-fbf9a83d9de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:23.599054 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fb8d2-dc08-4cb6-9b2c-fbf9a83d9de3 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:23.599335 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fb8d2-dc08-4cb6-9b2c-fbf9a83d9de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:23.599609 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fb8d2-dc08-4cb6-9b2c-fbf9a83d9de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:23.600360 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fb8d2-dc08-4cb6-9b2c-fbf9a83d9de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:23.602250 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fb8d2-dc08-4cb6-9b2c-fbf9a83d9de3 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:23.612270 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1081/2191] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:23.616536 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fb8d2-dc08-4cb6-9b2c-fbf9a83d9de3 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:23.626305 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fb8d2-dc08-4cb6-9b2c-fbf9a83d9de3 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:23.631671 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020cef6-b793-42c1-9b56-0f4d96ec68f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:23.632591 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020cef6-b793-42c1-9b56-0f4d96ec68f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:23.632931 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020cef6-b793-42c1-9b56-0f4d96ec68f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:23.633202 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020cef6-b793-42c1-9b56-0f4d96ec68f2 admin admin] PATH_INFO: `/v3/projects/1efdfab83dd1400a85b3b2576edac53f/users/ec4ecf68c495457cb72357041f13d342/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:23.649056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020cef6-b793-42c1-9b56-0f4d96ec68f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1efdfab83dd1400a85b3b2576edac53f, user_id=ec4ecf68c495457cb72357041f13d342, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:23.651758 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020cef6-b793-42c1-9b56-0f4d96ec68f2 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:23.700535 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1111/2192] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:23 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:23.704404 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03958cb5-3796-4e02-b808-e8d1cf3389c5 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:23.751760 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1082/2193] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:23 2022] PUT /identity/v3/projects/1efdfab83dd1400a85b3b2576edac53f/users/ec4ecf68c495457cb72357041f13d342/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:23.765006 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872ed9c-1d1e-439e-824b-61590f86e452 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:23.765551 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872ed9c-1d1e-439e-824b-61590f86e452 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:23.765923 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872ed9c-1d1e-439e-824b-61590f86e452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:23.776274 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03958cb5-3796-4e02-b808-e8d1cf3389c5 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:23.823983 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-c872ed9c-1d1e-439e-824b-61590f86e452 None None] MFA Rules not processed for user `ec4ecf68c495457cb72357041f13d342`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:23.826169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c872ed9c-1d1e-439e-824b-61590f86e452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:23.835779 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bceb7-6e68-4ac2-89d7-1685b90e29c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:23.836465 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bceb7-6e68-4ac2-89d7-1685b90e29c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:23.836765 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bceb7-6e68-4ac2-89d7-1685b90e29c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:23.837044 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bceb7-6e68-4ac2-89d7-1685b90e29c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:23.837737 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bceb7-6e68-4ac2-89d7-1685b90e29c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:23.839801 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bceb7-6e68-4ac2-89d7-1685b90e29c5 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:23.889370 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1083/2194] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:23.890646 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd33030-b11b-4eb6-9633-1318cd2e5235 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:23.890933 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd33030-b11b-4eb6-9633-1318cd2e5235 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:23.891211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd33030-b11b-4eb6-9633-1318cd2e5235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:23.908772 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-5dd33030-b11b-4eb6-9633-1318cd2e5235 None None] MFA Rules not processed for user `5f1befc68f5a43c492efef77b1ec480a`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:23.910008 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-5dd33030-b11b-4eb6-9633-1318cd2e5235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:23.963122 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1084/2195] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:23.963936 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd33030-b11b-4eb6-9633-1318cd2e5235 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:23.974435 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd33030-b11b-4eb6-9633-1318cd2e5235 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:23.980468 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1112/2196] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:23 2022] POST /identity/v3/users => generated 294 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:23.982527 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e82a9-8108-493e-b2b2-9440d7143e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:23.982745 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e82a9-8108-493e-b2b2-9440d7143e14 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:23.983207 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e82a9-8108-493e-b2b2-9440d7143e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:23.983492 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e82a9-8108-493e-b2b2-9440d7143e14 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:23.984426 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e82a9-8108-493e-b2b2-9440d7143e14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:23.985372 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bceb7-6e68-4ac2-89d7-1685b90e29c5 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:23.986168 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e82a9-8108-493e-b2b2-9440d7143e14 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:23.997049 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bceb7-6e68-4ac2-89d7-1685b90e29c5 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:24.003238 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d1f03-9a27-4707-8990-100e84d5908d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:24.011296 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d1f03-9a27-4707-8990-100e84d5908d admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:24.011296 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d1f03-9a27-4707-8990-100e84d5908d admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:24.011296 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d1f03-9a27-4707-8990-100e84d5908d admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:24.011296 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d1f03-9a27-4707-8990-100e84d5908d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:24.011296 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d1f03-9a27-4707-8990-100e84d5908d admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:24.018206 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1113/2197] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:24.021982 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d1f03-9a27-4707-8990-100e84d5908d admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:24.032844 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d1f03-9a27-4707-8990-100e84d5908d admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:24.038594 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97627d-4f5a-4934-98d8-1a379c7472e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:24.039264 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97627d-4f5a-4934-98d8-1a379c7472e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:24.039546 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97627d-4f5a-4934-98d8-1a379c7472e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:24.039822 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97627d-4f5a-4934-98d8-1a379c7472e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:24.040548 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97627d-4f5a-4934-98d8-1a379c7472e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:24.042195 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97627d-4f5a-4934-98d8-1a379c7472e6 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:24.053979 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1114/2198] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:20:24.058667 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97627d-4f5a-4934-98d8-1a379c7472e6 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:24.068515 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97627d-4f5a-4934-98d8-1a379c7472e6 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:24.073206 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bb44b-d7a4-4d40-8a9e-6805e8333a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:24.074083 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bb44b-d7a4-4d40-8a9e-6805e8333a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:24.080077 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bb44b-d7a4-4d40-8a9e-6805e8333a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:24.080077 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bb44b-d7a4-4d40-8a9e-6805e8333a86 admin admin] PATH_INFO: `/v3/projects/8e0f515487d645f6982b659ba19a3090/users/78a86b1e701343f19d519e6d1dfa63b0/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:24.089058 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bb44b-d7a4-4d40-8a9e-6805e8333a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0f515487d645f6982b659ba19a3090, user_id=78a86b1e701343f19d519e6d1dfa63b0, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:24.091729 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bb44b-d7a4-4d40-8a9e-6805e8333a86 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:24.106886 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1085/2199] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:23 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:24.110806 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e82a9-8108-493e-b2b2-9440d7143e14 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:24.171041 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e82a9-8108-493e-b2b2-9440d7143e14 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:24.178795 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da65b34-3086-4d86-b7b7-2b36f13f0bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:24.178795 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da65b34-3086-4d86-b7b7-2b36f13f0bad admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:24.180931 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da65b34-3086-4d86-b7b7-2b36f13f0bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:24.181379 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da65b34-3086-4d86-b7b7-2b36f13f0bad admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:24.182937 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da65b34-3086-4d86-b7b7-2b36f13f0bad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:24.186752 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da65b34-3086-4d86-b7b7-2b36f13f0bad admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:24.205418 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1115/2200] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:24 2022] PUT /identity/v3/projects/8e0f515487d645f6982b659ba19a3090/users/78a86b1e701343f19d519e6d1dfa63b0/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:24.217185 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49129724-b70f-4cb5-b08e-d664fd5ed382 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:24.217477 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49129724-b70f-4cb5-b08e-d664fd5ed382 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:24.217756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49129724-b70f-4cb5-b08e-d664fd5ed382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:24.246527 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-49129724-b70f-4cb5-b08e-d664fd5ed382 None None] MFA Rules not processed for user `78a86b1e701343f19d519e6d1dfa63b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:24.247760 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-49129724-b70f-4cb5-b08e-d664fd5ed382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:24.308920 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1086/2201] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:24 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:24.312515 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da65b34-3086-4d86-b7b7-2b36f13f0bad admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:24.338318 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1116/2202] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:24.339058 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da65b34-3086-4d86-b7b7-2b36f13f0bad admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:24.342502 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49129724-b70f-4cb5-b08e-d664fd5ed382 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:24.412064 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49129724-b70f-4cb5-b08e-d664fd5ed382 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:24.413391 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b7625-bb3b-426d-9f90-c42509412b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:24.414026 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b7625-bb3b-426d-9f90-c42509412b56 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:24.414331 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b7625-bb3b-426d-9f90-c42509412b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:24.414578 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b7625-bb3b-426d-9f90-c42509412b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:24.415305 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b7625-bb3b-426d-9f90-c42509412b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:24.416941 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b7625-bb3b-426d-9f90-c42509412b56 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:24.417156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726b235-5876-4f63-98b6-de09f356355e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:24.417820 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726b235-5876-4f63-98b6-de09f356355e admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:24.418141 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726b235-5876-4f63-98b6-de09f356355e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:24.418363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726b235-5876-4f63-98b6-de09f356355e admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:24.419055 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726b235-5876-4f63-98b6-de09f356355e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:24.421094 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726b235-5876-4f63-98b6-de09f356355e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:24.427891 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1087/2203] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:20:24.431612 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b7625-bb3b-426d-9f90-c42509412b56 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:24.441482 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b7625-bb3b-426d-9f90-c42509412b56 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:24.446280 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89f7b1-268f-4b49-a600-7c0ba18ed726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:24.447344 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89f7b1-268f-4b49-a600-7c0ba18ed726 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:24.447728 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89f7b1-268f-4b49-a600-7c0ba18ed726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:24.448063 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89f7b1-268f-4b49-a600-7c0ba18ed726 admin admin] PATH_INFO: `/v3/projects/4f587cd70f334f1bbf8e80ef66c3811d/users/ab48cdc496fe43df877fbbe3b07f8114/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:24.463925 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89f7b1-268f-4b49-a600-7c0ba18ed726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f587cd70f334f1bbf8e80ef66c3811d, user_id=ab48cdc496fe43df877fbbe3b07f8114, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:24.466767 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89f7b1-268f-4b49-a600-7c0ba18ed726 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:24.500708 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1117/2204] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:24 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:24.503195 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726b235-5876-4f63-98b6-de09f356355e admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:24.549514 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1088/2205] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:24 2022] PUT /identity/v3/projects/4f587cd70f334f1bbf8e80ef66c3811d/users/ab48cdc496fe43df877fbbe3b07f8114/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:24.553314 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89f7b1-268f-4b49-a600-7c0ba18ed726 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:24.565254 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726b235-5876-4f63-98b6-de09f356355e admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:24.631542 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83070e65-4346-4825-99bd-ab02eba3dd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:24.632218 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83070e65-4346-4825-99bd-ab02eba3dd33 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:24.632792 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83070e65-4346-4825-99bd-ab02eba3dd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:24.632792 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83070e65-4346-4825-99bd-ab02eba3dd33 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:24.633510 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83070e65-4346-4825-99bd-ab02eba3dd33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:24.635643 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83070e65-4346-4825-99bd-ab02eba3dd33 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:24.647613 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89f7b1-268f-4b49-a600-7c0ba18ed726 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:24.654271 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f10e5-4142-4d0e-bf32-3317cfb0c0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:24.654974 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f10e5-4142-4d0e-bf32-3317cfb0c0ef admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:24.655258 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f10e5-4142-4d0e-bf32-3317cfb0c0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:24.655535 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f10e5-4142-4d0e-bf32-3317cfb0c0ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:24.656272 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f10e5-4142-4d0e-bf32-3317cfb0c0ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:24.657960 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f10e5-4142-4d0e-bf32-3317cfb0c0ef admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:24.669075 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1089/2206] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:20:24.673904 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f10e5-4142-4d0e-bf32-3317cfb0c0ef admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:24.691846 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f10e5-4142-4d0e-bf32-3317cfb0c0ef admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:24.697547 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b7df1-aede-461f-8c5b-930eb17d58fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:24.698431 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b7df1-aede-461f-8c5b-930eb17d58fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:24.698717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b7df1-aede-461f-8c5b-930eb17d58fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:24.698995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b7df1-aede-461f-8c5b-930eb17d58fc admin admin] PATH_INFO: `/v3/projects/4f587cd70f334f1bbf8e80ef66c3811d/users/ab48cdc496fe43df877fbbe3b07f8114/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:24.701166 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b7df1-aede-461f-8c5b-930eb17d58fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f587cd70f334f1bbf8e80ef66c3811d, user_id=ab48cdc496fe43df877fbbe3b07f8114, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:24.703832 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b7df1-aede-461f-8c5b-930eb17d58fc admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:24.717702 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1090/2207] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:24 2022] PUT /identity/v3/projects/4f587cd70f334f1bbf8e80ef66c3811d/users/ab48cdc496fe43df877fbbe3b07f8114/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:24.728184 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b2f2f-0d8d-46dc-9a98-05fe930c4834 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:24.728477 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b2f2f-0d8d-46dc-9a98-05fe930c4834 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:24.729092 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b2f2f-0d8d-46dc-9a98-05fe930c4834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:24.742264 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1118/2208] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:24 2022] POST /identity/v3/users => generated 300 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:24.744906 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83070e65-4346-4825-99bd-ab02eba3dd33 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:24.755767 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83070e65-4346-4825-99bd-ab02eba3dd33 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:24.760998 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-d23b2f2f-0d8d-46dc-9a98-05fe930c4834 None None] MFA Rules not processed for user `ab48cdc496fe43df877fbbe3b07f8114`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:24.762355 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-d23b2f2f-0d8d-46dc-9a98-05fe930c4834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:24.840855 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87539769-f990-4912-a586-84a7b5a69bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:24.842280 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87539769-f990-4912-a586-84a7b5a69bbb admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:24.842280 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87539769-f990-4912-a586-84a7b5a69bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:24.842457 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87539769-f990-4912-a586-84a7b5a69bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:24.843339 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87539769-f990-4912-a586-84a7b5a69bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:24.844872 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1091/2209] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:24.844984 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87539769-f990-4912-a586-84a7b5a69bbb admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:24.857981 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b2f2f-0d8d-46dc-9a98-05fe930c4834 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:24.859594 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-d23b2f2f-0d8d-46dc-9a98-05fe930c4834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:24.865446 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1119/2210] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:20:24.871362 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87539769-f990-4912-a586-84a7b5a69bbb admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:24.883532 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87539769-f990-4912-a586-84a7b5a69bbb admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:24.892389 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecd149-a424-44d9-90ba-b00ef8b998ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:24.893482 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecd149-a424-44d9-90ba-b00ef8b998ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:24.893812 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecd149-a424-44d9-90ba-b00ef8b998ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:24.894169 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecd149-a424-44d9-90ba-b00ef8b998ff admin admin] PATH_INFO: `/v3/projects/6d76d4e99071405186084b2c397037c6/users/0112e7c191b14145847269e878b534bb/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:24.916328 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ecd149-a424-44d9-90ba-b00ef8b998ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d76d4e99071405186084b2c397037c6, user_id=0112e7c191b14145847269e878b534bb, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:24.919173 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ecd149-a424-44d9-90ba-b00ef8b998ff admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:24.943408 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b2f2f-0d8d-46dc-9a98-05fe930c4834 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:24.947051 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78b069-a826-411a-8b6a-cdf3385eb3e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:24.947694 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78b069-a826-411a-8b6a-cdf3385eb3e3 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:24.947973 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78b069-a826-411a-8b6a-cdf3385eb3e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:24.948249 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78b069-a826-411a-8b6a-cdf3385eb3e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:24.957717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78b069-a826-411a-8b6a-cdf3385eb3e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:24.959145 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78b069-a826-411a-8b6a-cdf3385eb3e3 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:24.968419 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1092/2211] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:20:25.011636 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1120/2212] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:24 2022] PUT /identity/v3/projects/6d76d4e99071405186084b2c397037c6/users/0112e7c191b14145847269e878b534bb/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:25.015660 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78b069-a826-411a-8b6a-cdf3385eb3e3 service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:25.026656 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78b069-a826-411a-8b6a-cdf3385eb3e3 service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:25.079551 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d32e40-ba14-4829-8619-b2a753eb4308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:25.080202 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d32e40-ba14-4829-8619-b2a753eb4308 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:25.080483 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d32e40-ba14-4829-8619-b2a753eb4308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:25.080792 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d32e40-ba14-4829-8619-b2a753eb4308 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:25.081598 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d32e40-ba14-4829-8619-b2a753eb4308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:25.083684 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d32e40-ba14-4829-8619-b2a753eb4308 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:25.093232 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1093/2213] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:25.097254 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecd149-a424-44d9-90ba-b00ef8b998ff admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:25.107661 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecd149-a424-44d9-90ba-b00ef8b998ff admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:25.112521 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1cf57-acff-4fd6-8335-b616cc076163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:25.116450 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1cf57-acff-4fd6-8335-b616cc076163 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:25.116450 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1cf57-acff-4fd6-8335-b616cc076163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:25.116450 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1cf57-acff-4fd6-8335-b616cc076163 admin admin] PATH_INFO: `/v3/projects/6d76d4e99071405186084b2c397037c6/users/0112e7c191b14145847269e878b534bb/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:25.116450 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1cf57-acff-4fd6-8335-b616cc076163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d76d4e99071405186084b2c397037c6, user_id=0112e7c191b14145847269e878b534bb, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:25.118725 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1cf57-acff-4fd6-8335-b616cc076163 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:25.129777 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1121/2214] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:25 2022] PUT /identity/v3/projects/6d76d4e99071405186084b2c397037c6/users/0112e7c191b14145847269e878b534bb/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:25.139858 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388ff4d-77b4-451e-a238-3bdba4c63f2f None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:25.140313 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388ff4d-77b4-451e-a238-3bdba4c63f2f None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:25.140403 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388ff4d-77b4-451e-a238-3bdba4c63f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:25.166714 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-6388ff4d-77b4-451e-a238-3bdba4c63f2f None None] MFA Rules not processed for user `0112e7c191b14145847269e878b534bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:25.167920 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6388ff4d-77b4-451e-a238-3bdba4c63f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:25.183896 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1cf57-acff-4fd6-8335-b616cc076163 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:25.251753 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1cf57-acff-4fd6-8335-b616cc076163 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:25.255087 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1094/2215] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:25.255938 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03787d6-3e34-47b1-9363-41898938a268 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:25.256572 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03787d6-3e34-47b1-9363-41898938a268 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:25.256883 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03787d6-3e34-47b1-9363-41898938a268 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:25.257159 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03787d6-3e34-47b1-9363-41898938a268 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:25.265787 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388ff4d-77b4-451e-a238-3bdba4c63f2f None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:25.267225 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6388ff4d-77b4-451e-a238-3bdba4c63f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:25.279052 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388ff4d-77b4-451e-a238-3bdba4c63f2f None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:25.282792 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d395da-deff-4114-b074-ddeeebf5bd0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:25.283427 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d395da-deff-4114-b074-ddeeebf5bd0d service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:25.283711 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d395da-deff-4114-b074-ddeeebf5bd0d service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:25.283986 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d395da-deff-4114-b074-ddeeebf5bd0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:25.293316 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d395da-deff-4114-b074-ddeeebf5bd0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:25.294764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d395da-deff-4114-b074-ddeeebf5bd0d service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:25.305356 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1095/2216] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:20:25.314063 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03787d6-3e34-47b1-9363-41898938a268 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:25.315501 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03787d6-3e34-47b1-9363-41898938a268 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:25.325347 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1122/2217] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:20:26.118796 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d395da-deff-4114-b074-ddeeebf5bd0d service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:26.184641 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d395da-deff-4114-b074-ddeeebf5bd0d service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:26.189299 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84318ea-825e-46b7-9983-cf05ac012eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:26.190153 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84318ea-825e-46b7-9983-cf05ac012eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:26.190442 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84318ea-825e-46b7-9983-cf05ac012eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:26.190699 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84318ea-825e-46b7-9983-cf05ac012eec admin admin] PATH_INFO: `/v3/users/ec4ecf68c495457cb72357041f13d342` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:26.192230 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84318ea-825e-46b7-9983-cf05ac012eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec4ecf68c495457cb72357041f13d342)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:26.194236 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84318ea-825e-46b7-9983-cf05ac012eec admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:26.384219 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-a84318ea-825e-46b7-9983-cf05ac012eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec4ecf68c495457cb72357041f13d342'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:26.396718 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-a84318ea-825e-46b7-9983-cf05ac012eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec4ecf68c495457cb72357041f13d342'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:26.397726 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-a84318ea-825e-46b7-9983-cf05ac012eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec4ecf68c495457cb72357041f13d342'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:26.478779 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-a84318ea-825e-46b7-9983-cf05ac012eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec4ecf68c495457cb72357041f13d342'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:26.479313 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-a84318ea-825e-46b7-9983-cf05ac012eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec4ecf68c495457cb72357041f13d342'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:26.493968 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1096/2218] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:26 2022] DELETE /identity/v3/users/ec4ecf68c495457cb72357041f13d342 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:26.498581 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e847e-1f1f-4c29-bd05-3f194afd56f3 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:26.499065 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e847e-1f1f-4c29-bd05-3f194afd56f3 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:26.499161 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e847e-1f1f-4c29-bd05-3f194afd56f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:26.516259 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-bf4e847e-1f1f-4c29-bd05-3f194afd56f3 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:26.517482 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-bf4e847e-1f1f-4c29-bd05-3f194afd56f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:26.577463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1123/2219] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:26.587987 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84318ea-825e-46b7-9983-cf05ac012eec admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:26.589401 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-a84318ea-825e-46b7-9983-cf05ac012eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:26.644738 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84318ea-825e-46b7-9983-cf05ac012eec admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:26.648303 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d359f7-4d00-4401-a6f3-8457bd2b2ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:26.648974 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d359f7-4d00-4401-a6f3-8457bd2b2ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:26.649255 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d359f7-4d00-4401-a6f3-8457bd2b2ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:26.649530 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d359f7-4d00-4401-a6f3-8457bd2b2ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:26.658356 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d359f7-4d00-4401-a6f3-8457bd2b2ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:26.659939 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d359f7-4d00-4401-a6f3-8457bd2b2ee6 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:26.669170 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1097/2220] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:26.693885 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e847e-1f1f-4c29-bd05-3f194afd56f3 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:26.695282 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-bf4e847e-1f1f-4c29-bd05-3f194afd56f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:26.707542 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e847e-1f1f-4c29-bd05-3f194afd56f3 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:26.712107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136b8ce-382c-458b-9325-a59d90b3b67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:26.713005 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136b8ce-382c-458b-9325-a59d90b3b67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:26.713288 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136b8ce-382c-458b-9325-a59d90b3b67a admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:26.713567 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136b8ce-382c-458b-9325-a59d90b3b67a admin admin] PATH_INFO: `/v3/users/78a86b1e701343f19d519e6d1dfa63b0` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:26.714778 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136b8ce-382c-458b-9325-a59d90b3b67a admin admin] RBAC: Authorizing `identity:delete_user(user_id=78a86b1e701343f19d519e6d1dfa63b0)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:26.716728 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136b8ce-382c-458b-9325-a59d90b3b67a admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:26.906571 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-e136b8ce-382c-458b-9325-a59d90b3b67a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78a86b1e701343f19d519e6d1dfa63b0'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:26.922469 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-e136b8ce-382c-458b-9325-a59d90b3b67a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78a86b1e701343f19d519e6d1dfa63b0'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:26.923426 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-e136b8ce-382c-458b-9325-a59d90b3b67a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78a86b1e701343f19d519e6d1dfa63b0'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:26.924154 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-e136b8ce-382c-458b-9325-a59d90b3b67a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78a86b1e701343f19d519e6d1dfa63b0'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:26.932342 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-e136b8ce-382c-458b-9325-a59d90b3b67a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78a86b1e701343f19d519e6d1dfa63b0'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:27.010435 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1124/2221] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:26 2022] DELETE /identity/v3/users/78a86b1e701343f19d519e6d1dfa63b0 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:27.014993 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcf4c4-6c0a-4c76-bf20-9dffe25afbf9 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:27.015303 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcf4c4-6c0a-4c76-bf20-9dffe25afbf9 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:27.015578 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcf4c4-6c0a-4c76-bf20-9dffe25afbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:27.033109 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-e3dcf4c4-6c0a-4c76-bf20-9dffe25afbf9 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:27.037214 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-e3dcf4c4-6c0a-4c76-bf20-9dffe25afbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:27.087043 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136b8ce-382c-458b-9325-a59d90b3b67a admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:27.088514 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e136b8ce-382c-458b-9325-a59d90b3b67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:27.094644 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1098/2222] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:27.103327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcf4c4-6c0a-4c76-bf20-9dffe25afbf9 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:27.103615 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136b8ce-382c-458b-9325-a59d90b3b67a admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:27.108247 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-e3dcf4c4-6c0a-4c76-bf20-9dffe25afbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:27.108999 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1f236-02a9-4cb3-a535-4488671b8d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:27.110301 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1f236-02a9-4cb3-a535-4488671b8d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:27.110577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1f236-02a9-4cb3-a535-4488671b8d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:27.110850 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1f236-02a9-4cb3-a535-4488671b8d3e admin admin] PATH_INFO: `/v3/projects/1efdfab83dd1400a85b3b2576edac53f` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:27.112361 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1f236-02a9-4cb3-a535-4488671b8d3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1efdfab83dd1400a85b3b2576edac53f)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:27.114066 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1f236-02a9-4cb3-a535-4488671b8d3e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:27.192574 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcf4c4-6c0a-4c76-bf20-9dffe25afbf9 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:27.197662 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550f227-8924-4033-b93a-31ec362c8159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:27.198216 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550f227-8924-4033-b93a-31ec362c8159 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:27.198498 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550f227-8924-4033-b93a-31ec362c8159 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:27.198771 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550f227-8924-4033-b93a-31ec362c8159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:27.208977 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550f227-8924-4033-b93a-31ec362c8159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:27.210478 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550f227-8924-4033-b93a-31ec362c8159 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:27.220102 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1099/2223] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:20:27.241481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-8ec1f236-02a9-4cb3-a535-4488671b8d3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1efdfab83dd1400a85b3b2576edac53f', 'request_id': 'req-8ec1f236-02a9-4cb3-a535-4488671b8d3e'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:27.246907 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-8ec1f236-02a9-4cb3-a535-4488671b8d3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1efdfab83dd1400a85b3b2576edac53f', 'request_id': 'req-8ec1f236-02a9-4cb3-a535-4488671b8d3e'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:27.253072 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-8ec1f236-02a9-4cb3-a535-4488671b8d3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1efdfab83dd1400a85b3b2576edac53f', 'request_id': 'req-8ec1f236-02a9-4cb3-a535-4488671b8d3e'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:27.344089 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-8ec1f236-02a9-4cb3-a535-4488671b8d3e admin admin] The token cache is being invalidate because project 1efdfab83dd1400a85b3b2576edac53f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:27.346623 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-8ec1f236-02a9-4cb3-a535-4488671b8d3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:27.346623 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-8ec1f236-02a9-4cb3-a535-4488671b8d3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:27.346907 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1125/2224] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:27 2022] DELETE /identity/v3/projects/1efdfab83dd1400a85b3b2576edac53f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:27.352821 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550f227-8924-4033-b93a-31ec362c8159 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:27.362332 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550f227-8924-4033-b93a-31ec362c8159 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:27.418632 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a0508-04cf-4ff2-9250-33513b057f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:27.419480 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a0508-04cf-4ff2-9250-33513b057f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:27.419840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a0508-04cf-4ff2-9250-33513b057f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:27.420117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a0508-04cf-4ff2-9250-33513b057f05 admin admin] PATH_INFO: `/v3/users/ab48cdc496fe43df877fbbe3b07f8114` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:27.421325 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a0508-04cf-4ff2-9250-33513b057f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab48cdc496fe43df877fbbe3b07f8114)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:27.423280 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a0508-04cf-4ff2-9250-33513b057f05 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:27.596934 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-020a0508-04cf-4ff2-9250-33513b057f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab48cdc496fe43df877fbbe3b07f8114'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:27.609449 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-020a0508-04cf-4ff2-9250-33513b057f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab48cdc496fe43df877fbbe3b07f8114'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:27.610212 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-020a0508-04cf-4ff2-9250-33513b057f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab48cdc496fe43df877fbbe3b07f8114'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:27.688093 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1f236-02a9-4cb3-a535-4488671b8d3e admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:27.688093 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-8ec1f236-02a9-4cb3-a535-4488671b8d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:27.696788 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1f236-02a9-4cb3-a535-4488671b8d3e admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:27.702461 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b44eb-6e81-4445-b4b5-1864d0c7322e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:27.703425 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b44eb-6e81-4445-b4b5-1864d0c7322e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:27.703710 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b44eb-6e81-4445-b4b5-1864d0c7322e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:27.703981 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b44eb-6e81-4445-b4b5-1864d0c7322e admin admin] PATH_INFO: `/v3/projects/8e0f515487d645f6982b659ba19a3090` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:27.705206 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b44eb-6e81-4445-b4b5-1864d0c7322e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e0f515487d645f6982b659ba19a3090)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:27.707226 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b44eb-6e81-4445-b4b5-1864d0c7322e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:27.709391 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-020a0508-04cf-4ff2-9250-33513b057f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab48cdc496fe43df877fbbe3b07f8114'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:27.710098 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-020a0508-04cf-4ff2-9250-33513b057f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab48cdc496fe43df877fbbe3b07f8114'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:27.727436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1100/2225] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:27 2022] DELETE /identity/v3/users/ab48cdc496fe43df877fbbe3b07f8114 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:27.812159 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-c07b44eb-6e81-4445-b4b5-1864d0c7322e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e0f515487d645f6982b659ba19a3090', 'request_id': 'req-c07b44eb-6e81-4445-b4b5-1864d0c7322e'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:27.817876 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-c07b44eb-6e81-4445-b4b5-1864d0c7322e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e0f515487d645f6982b659ba19a3090', 'request_id': 'req-c07b44eb-6e81-4445-b4b5-1864d0c7322e'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:27.824154 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-c07b44eb-6e81-4445-b4b5-1864d0c7322e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e0f515487d645f6982b659ba19a3090', 'request_id': 'req-c07b44eb-6e81-4445-b4b5-1864d0c7322e'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:27.948059 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-c07b44eb-6e81-4445-b4b5-1864d0c7322e admin admin] The token cache is being invalidate because project 8e0f515487d645f6982b659ba19a3090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:27.948350 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-c07b44eb-6e81-4445-b4b5-1864d0c7322e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:27.949149 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-c07b44eb-6e81-4445-b4b5-1864d0c7322e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:27.950901 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1126/2226] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:27 2022] DELETE /identity/v3/projects/8e0f515487d645f6982b659ba19a3090 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:27.954745 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a0508-04cf-4ff2-9250-33513b057f05 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:27.956295 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-020a0508-04cf-4ff2-9250-33513b057f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:28.020346 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a0508-04cf-4ff2-9250-33513b057f05 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:28.076625 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31103d-22bb-4f55-b441-68e57c3dfefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:28.077438 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31103d-22bb-4f55-b441-68e57c3dfefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:28.077714 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31103d-22bb-4f55-b441-68e57c3dfefb admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:28.077982 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31103d-22bb-4f55-b441-68e57c3dfefb admin admin] PATH_INFO: `/v3/users/0112e7c191b14145847269e878b534bb` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:28.079158 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31103d-22bb-4f55-b441-68e57c3dfefb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0112e7c191b14145847269e878b534bb)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:28.081113 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31103d-22bb-4f55-b441-68e57c3dfefb admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:28.154785 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b44eb-6e81-4445-b4b5-1864d0c7322e admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:28.156221 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-c07b44eb-6e81-4445-b4b5-1864d0c7322e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:28.171076 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b44eb-6e81-4445-b4b5-1864d0c7322e admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:28.175552 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809a7de-6e26-429f-8b88-e52ff7154b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:28.176255 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809a7de-6e26-429f-8b88-e52ff7154b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:28.176568 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809a7de-6e26-429f-8b88-e52ff7154b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:28.176928 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809a7de-6e26-429f-8b88-e52ff7154b34 admin admin] PATH_INFO: `/v3/projects/4f587cd70f334f1bbf8e80ef66c3811d` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:28.178024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809a7de-6e26-429f-8b88-e52ff7154b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f587cd70f334f1bbf8e80ef66c3811d)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:28.180126 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809a7de-6e26-429f-8b88-e52ff7154b34 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:28.343820 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-3b31103d-22bb-4f55-b441-68e57c3dfefb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0112e7c191b14145847269e878b534bb'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:28.355548 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-3b31103d-22bb-4f55-b441-68e57c3dfefb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0112e7c191b14145847269e878b534bb'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:28.356306 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-3b31103d-22bb-4f55-b441-68e57c3dfefb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0112e7c191b14145847269e878b534bb'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:28.374238 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-6809a7de-6e26-429f-8b88-e52ff7154b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f587cd70f334f1bbf8e80ef66c3811d', 'request_id': 'req-6809a7de-6e26-429f-8b88-e52ff7154b34'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:28.379897 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-6809a7de-6e26-429f-8b88-e52ff7154b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f587cd70f334f1bbf8e80ef66c3811d', 'request_id': 'req-6809a7de-6e26-429f-8b88-e52ff7154b34'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:28.386189 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-6809a7de-6e26-429f-8b88-e52ff7154b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f587cd70f334f1bbf8e80ef66c3811d', 'request_id': 'req-6809a7de-6e26-429f-8b88-e52ff7154b34'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:28.446398 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-3b31103d-22bb-4f55-b441-68e57c3dfefb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0112e7c191b14145847269e878b534bb'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:28.447104 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-3b31103d-22bb-4f55-b441-68e57c3dfefb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0112e7c191b14145847269e878b534bb'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:28.460487 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1101/2227] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:27 2022] DELETE /identity/v3/users/0112e7c191b14145847269e878b534bb => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:28.526175 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-6809a7de-6e26-429f-8b88-e52ff7154b34 admin admin] The token cache is being invalidate because project 4f587cd70f334f1bbf8e80ef66c3811d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:28.529303 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-6809a7de-6e26-429f-8b88-e52ff7154b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:28.529303 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-6809a7de-6e26-429f-8b88-e52ff7154b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:28.529303 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1127/2228] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:28 2022] DELETE /identity/v3/projects/4f587cd70f334f1bbf8e80ef66c3811d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:28.533739 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6bfbd-51b2-4274-8e1f-d43a2a7dfab0 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:28.534039 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6bfbd-51b2-4274-8e1f-d43a2a7dfab0 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:28.534350 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6bfbd-51b2-4274-8e1f-d43a2a7dfab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:28.552471 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-51e6bfbd-51b2-4274-8e1f-d43a2a7dfab0 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:28.553774 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-51e6bfbd-51b2-4274-8e1f-d43a2a7dfab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:28.611900 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1102/2229] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:28.619572 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37f29c-6328-47c0-a82b-82c60a06ba32 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:28.619890 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37f29c-6328-47c0-a82b-82c60a06ba32 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:28.620165 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37f29c-6328-47c0-a82b-82c60a06ba32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:28.638577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-ea37f29c-6328-47c0-a82b-82c60a06ba32 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:28.639837 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-ea37f29c-6328-47c0-a82b-82c60a06ba32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:28.648829 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1128/2230] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:28.653242 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6bfbd-51b2-4274-8e1f-d43a2a7dfab0 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:28.663804 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6bfbd-51b2-4274-8e1f-d43a2a7dfab0 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:28.668459 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc7c54-25dc-47e5-bea3-5f28af3a4c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:28.669140 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc7c54-25dc-47e5-bea3-5f28af3a4c0c admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:28.669420 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc7c54-25dc-47e5-bea3-5f28af3a4c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:28.669711 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc7c54-25dc-47e5-bea3-5f28af3a4c0c admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:28.670437 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc7c54-25dc-47e5-bea3-5f28af3a4c0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:20:28.670740 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc7c54-25dc-47e5-bea3-5f28af3a4c0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:28.672337 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc7c54-25dc-47e5-bea3-5f28af3a4c0c admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:28.690011 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1103/2231] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:20:28.692800 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37f29c-6328-47c0-a82b-82c60a06ba32 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:28.702577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37f29c-6328-47c0-a82b-82c60a06ba32 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:28.708077 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802441c8-411c-4784-b544-de2ea23af463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:28.708776 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802441c8-411c-4784-b544-de2ea23af463 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:28.709062 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802441c8-411c-4784-b544-de2ea23af463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:28.709337 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802441c8-411c-4784-b544-de2ea23af463 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:28.710027 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802441c8-411c-4784-b544-de2ea23af463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:28.711929 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802441c8-411c-4784-b544-de2ea23af463 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:28.819497 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1129/2232] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:28 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:28.823449 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc7c54-25dc-47e5-bea3-5f28af3a4c0c admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:28.833362 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc7c54-25dc-47e5-bea3-5f28af3a4c0c admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:28.891042 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade88a5-ceeb-4f38-a43a-e4080f0f9cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:28.891694 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade88a5-ceeb-4f38-a43a-e4080f0f9cad admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:28.891976 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade88a5-ceeb-4f38-a43a-e4080f0f9cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:28.892245 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade88a5-ceeb-4f38-a43a-e4080f0f9cad admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:28.893169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade88a5-ceeb-4f38-a43a-e4080f0f9cad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:28.895881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade88a5-ceeb-4f38-a43a-e4080f0f9cad admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:28.907430 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802441c8-411c-4784-b544-de2ea23af463 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:28.910464 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-802441c8-411c-4784-b544-de2ea23af463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:28.927336 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802441c8-411c-4784-b544-de2ea23af463 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:28.932459 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5f77a-c79f-4145-ab37-0a27f1a528f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:28.935023 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5f77a-c79f-4145-ab37-0a27f1a528f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:28.935023 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5f77a-c79f-4145-ab37-0a27f1a528f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:28.935023 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5f77a-c79f-4145-ab37-0a27f1a528f9 admin admin] PATH_INFO: `/v3/projects/6d76d4e99071405186084b2c397037c6` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:28.937064 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5f77a-c79f-4145-ab37-0a27f1a528f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d76d4e99071405186084b2c397037c6)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:28.939018 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5f77a-c79f-4145-ab37-0a27f1a528f9 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:28.984879 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1104/2233] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:28 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:28.988499 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade88a5-ceeb-4f38-a43a-e4080f0f9cad admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:28.998806 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade88a5-ceeb-4f38-a43a-e4080f0f9cad admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:29.003456 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232b104-f7ea-4b22-a341-d133946184fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:29.004168 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232b104-f7ea-4b22-a341-d133946184fe admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:29.004704 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232b104-f7ea-4b22-a341-d133946184fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:29.004934 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232b104-f7ea-4b22-a341-d133946184fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:29.005655 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232b104-f7ea-4b22-a341-d133946184fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:29.007249 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232b104-f7ea-4b22-a341-d133946184fe admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:29.017777 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1105/2234] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:20:29.022179 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232b104-f7ea-4b22-a341-d133946184fe admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:29.031976 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232b104-f7ea-4b22-a341-d133946184fe admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:29.037690 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75fd79-1bf3-4f9b-9347-1d60fe9d3b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:29.038582 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75fd79-1bf3-4f9b-9347-1d60fe9d3b82 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:29.038890 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75fd79-1bf3-4f9b-9347-1d60fe9d3b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:29.039163 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75fd79-1bf3-4f9b-9347-1d60fe9d3b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:29.039876 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75fd79-1bf3-4f9b-9347-1d60fe9d3b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:29.041561 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75fd79-1bf3-4f9b-9347-1d60fe9d3b82 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:29.055760 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1106/2235] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:20:29.056405 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-93a5f77a-c79f-4145-ab37-0a27f1a528f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d76d4e99071405186084b2c397037c6', 'request_id': 'req-93a5f77a-c79f-4145-ab37-0a27f1a528f9'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:29.057223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75fd79-1bf3-4f9b-9347-1d60fe9d3b82 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:29.059307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-93a5f77a-c79f-4145-ab37-0a27f1a528f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d76d4e99071405186084b2c397037c6', 'request_id': 'req-93a5f77a-c79f-4145-ab37-0a27f1a528f9'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:29.066372 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-93a5f77a-c79f-4145-ab37-0a27f1a528f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d76d4e99071405186084b2c397037c6', 'request_id': 'req-93a5f77a-c79f-4145-ab37-0a27f1a528f9'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:29.066987 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75fd79-1bf3-4f9b-9347-1d60fe9d3b82 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:29.120977 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fe585-9144-4b13-8fb2-506a6b2692d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:29.121856 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fe585-9144-4b13-8fb2-506a6b2692d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:29.122136 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fe585-9144-4b13-8fb2-506a6b2692d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:29.122411 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fe585-9144-4b13-8fb2-506a6b2692d7 admin admin] PATH_INFO: `/v3/projects/c170ec4c73ae4b7ea2f1c85467968924/users/f733a0cf8c0043a0811e98db4badcc46/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:29.135775 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5fe585-9144-4b13-8fb2-506a6b2692d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c170ec4c73ae4b7ea2f1c85467968924, user_id=f733a0cf8c0043a0811e98db4badcc46, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:29.138482 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5fe585-9144-4b13-8fb2-506a6b2692d7 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:29.140605 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-93a5f77a-c79f-4145-ab37-0a27f1a528f9 admin admin] The token cache is being invalidate because project 6d76d4e99071405186084b2c397037c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:29.140870 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-93a5f77a-c79f-4145-ab37-0a27f1a528f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:29.141509 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-93a5f77a-c79f-4145-ab37-0a27f1a528f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:29.143077 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1130/2236] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:28 2022] DELETE /identity/v3/projects/6d76d4e99071405186084b2c397037c6 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:29.148795 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e9c8d-de8f-4bef-a68a-aa718c05b7a2 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:29.152603 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e9c8d-de8f-4bef-a68a-aa718c05b7a2 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:29.152603 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e9c8d-de8f-4bef-a68a-aa718c05b7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:29.167319 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-af9e9c8d-de8f-4bef-a68a-aa718c05b7a2 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:29.168513 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-af9e9c8d-de8f-4bef-a68a-aa718c05b7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:29.176914 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1131/2237] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:29.184232 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7821f29-ad9c-469e-a1c8-90218d1afb91 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:29.184521 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7821f29-ad9c-469e-a1c8-90218d1afb91 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:29.184846 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7821f29-ad9c-469e-a1c8-90218d1afb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:29.203377 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-a7821f29-ad9c-469e-a1c8-90218d1afb91 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:29.204568 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a7821f29-ad9c-469e-a1c8-90218d1afb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:29.213561 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1132/2238] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:29.217823 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7821f29-ad9c-469e-a1c8-90218d1afb91 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:29.227869 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7821f29-ad9c-469e-a1c8-90218d1afb91 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:29.232803 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bf893-59dd-4135-9a7c-819bbc773299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:29.233214 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bf893-59dd-4135-9a7c-819bbc773299 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:29.233491 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bf893-59dd-4135-9a7c-819bbc773299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:29.233762 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bf893-59dd-4135-9a7c-819bbc773299 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:29.234481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bf893-59dd-4135-9a7c-819bbc773299 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:20:29.234785 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bf893-59dd-4135-9a7c-819bbc773299 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:29.236366 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bf893-59dd-4135-9a7c-819bbc773299 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:29.247729 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1133/2239] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:20:29.252018 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bf893-59dd-4135-9a7c-819bbc773299 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:29.258133 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1107/2240] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:29 2022] PUT /identity/v3/projects/c170ec4c73ae4b7ea2f1c85467968924/users/f733a0cf8c0043a0811e98db4badcc46/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:29.261670 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bf893-59dd-4135-9a7c-819bbc773299 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:29.263063 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bf692-1a07-4083-bf24-e9a249832271 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:29.263417 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bf692-1a07-4083-bf24-e9a249832271 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:29.263728 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bf692-1a07-4083-bf24-e9a249832271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:29.280851 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-599bf692-1a07-4083-bf24-e9a249832271 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:29.282204 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-599bf692-1a07-4083-bf24-e9a249832271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:29.318877 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baf76a-16a8-4294-aaeb-1b431df72555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:29.319536 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baf76a-16a8-4294-aaeb-1b431df72555 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:29.319814 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baf76a-16a8-4294-aaeb-1b431df72555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:29.320089 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baf76a-16a8-4294-aaeb-1b431df72555 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:29.320823 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3baf76a-16a8-4294-aaeb-1b431df72555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:29.322717 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3baf76a-16a8-4294-aaeb-1b431df72555 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:29.348394 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1108/2241] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:29.353440 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bf692-1a07-4083-bf24-e9a249832271 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:29.354808 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-599bf692-1a07-4083-bf24-e9a249832271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:29.405705 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1134/2242] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:29 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:29.410360 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baf76a-16a8-4294-aaeb-1b431df72555 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:29.411161 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bf692-1a07-4083-bf24-e9a249832271 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:29.459669 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee3061-2f1a-455d-ba95-c8f4d08f6029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:29.460311 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee3061-2f1a-455d-ba95-c8f4d08f6029 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:29.460594 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee3061-2f1a-455d-ba95-c8f4d08f6029 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:29.460901 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee3061-2f1a-455d-ba95-c8f4d08f6029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:29.471273 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baf76a-16a8-4294-aaeb-1b431df72555 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:29.477101 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650f4f0-fff8-471e-998f-e9f0fd41c6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:29.477843 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650f4f0-fff8-471e-998f-e9f0fd41c6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:29.478122 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650f4f0-fff8-471e-998f-e9f0fd41c6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:29.478397 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650f4f0-fff8-471e-998f-e9f0fd41c6e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:29.479089 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650f4f0-fff8-471e-998f-e9f0fd41c6e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:29.481065 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650f4f0-fff8-471e-998f-e9f0fd41c6e3 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:29.520398 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee3061-2f1a-455d-ba95-c8f4d08f6029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:29.522033 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee3061-2f1a-455d-ba95-c8f4d08f6029 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:29.531926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1109/2243] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:20:29.591200 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1135/2244] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:29 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:29.592565 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee3061-2f1a-455d-ba95-c8f4d08f6029 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:29.602564 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee3061-2f1a-455d-ba95-c8f4d08f6029 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:29.607545 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fb7d8-48f0-4181-bfc1-2902988b3c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:29.608233 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fb7d8-48f0-4181-bfc1-2902988b3c6e admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:29.608515 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fb7d8-48f0-4181-bfc1-2902988b3c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:29.608833 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fb7d8-48f0-4181-bfc1-2902988b3c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:29.609581 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fb7d8-48f0-4181-bfc1-2902988b3c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:29.611194 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fb7d8-48f0-4181-bfc1-2902988b3c6e admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:29.621730 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1110/2245] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:29.626007 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650f4f0-fff8-471e-998f-e9f0fd41c6e3 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:29.636573 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650f4f0-fff8-471e-998f-e9f0fd41c6e3 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:29.641367 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea45af-c431-4068-9ec4-ee83bc139260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:29.642021 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea45af-c431-4068-9ec4-ee83bc139260 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:29.642390 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea45af-c431-4068-9ec4-ee83bc139260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:29.642559 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea45af-c431-4068-9ec4-ee83bc139260 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:29.643282 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea45af-c431-4068-9ec4-ee83bc139260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:29.645691 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea45af-c431-4068-9ec4-ee83bc139260 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:29.655701 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1136/2246] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:29.660343 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fb7d8-48f0-4181-bfc1-2902988b3c6e admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:29.670118 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fb7d8-48f0-4181-bfc1-2902988b3c6e admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:29.675731 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503f65f-2723-471b-8df3-01c82ac7d2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:29.676847 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503f65f-2723-471b-8df3-01c82ac7d2ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:29.677134 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503f65f-2723-471b-8df3-01c82ac7d2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:29.677412 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503f65f-2723-471b-8df3-01c82ac7d2ca admin admin] PATH_INFO: `/v3/projects/5079fd15a6d84ae386cd5b13b9c19624/users/cc159c6e750549fc992c9f4092d9d1d5/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:29.697607 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503f65f-2723-471b-8df3-01c82ac7d2ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5079fd15a6d84ae386cd5b13b9c19624, user_id=cc159c6e750549fc992c9f4092d9d1d5, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:29.700307 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503f65f-2723-471b-8df3-01c82ac7d2ca admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:29.794764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1111/2247] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:29 2022] PUT /identity/v3/projects/5079fd15a6d84ae386cd5b13b9c19624/users/cc159c6e750549fc992c9f4092d9d1d5/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:29.806680 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2bfae-f74c-4e12-91c6-c65ab5e7c5e9 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:29.807191 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2bfae-f74c-4e12-91c6-c65ab5e7c5e9 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:29.807295 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2bfae-f74c-4e12-91c6-c65ab5e7c5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:29.834587 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-3ec2bfae-f74c-4e12-91c6-c65ab5e7c5e9 None None] MFA Rules not processed for user `cc159c6e750549fc992c9f4092d9d1d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:29.835798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-3ec2bfae-f74c-4e12-91c6-c65ab5e7c5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:29.903129 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1137/2248] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:29.914913 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503f65f-2723-471b-8df3-01c82ac7d2ca admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:29.916590 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-3503f65f-2723-471b-8df3-01c82ac7d2ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:29.972021 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503f65f-2723-471b-8df3-01c82ac7d2ca admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:29.976075 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e120cc-4fd8-498e-b199-82c0991399ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:29.976767 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e120cc-4fd8-498e-b199-82c0991399ae service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:29.977050 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e120cc-4fd8-498e-b199-82c0991399ae service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:29.977328 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e120cc-4fd8-498e-b199-82c0991399ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:29.985406 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e120cc-4fd8-498e-b199-82c0991399ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:29.986836 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e120cc-4fd8-498e-b199-82c0991399ae service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:29.996122 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1112/2249] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:30.020217 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2bfae-f74c-4e12-91c6-c65ab5e7c5e9 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:30.086703 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2bfae-f74c-4e12-91c6-c65ab5e7c5e9 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:30.091432 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea65617-a27e-4081-9b19-69eac410523e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:30.092357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea65617-a27e-4081-9b19-69eac410523e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:30.092638 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea65617-a27e-4081-9b19-69eac410523e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:30.092937 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea65617-a27e-4081-9b19-69eac410523e admin admin] PATH_INFO: `/v3/users/cc159c6e750549fc992c9f4092d9d1d5` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:30.094236 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea65617-a27e-4081-9b19-69eac410523e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc159c6e750549fc992c9f4092d9d1d5)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:30.096275 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea65617-a27e-4081-9b19-69eac410523e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:30.299811 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-2ea65617-a27e-4081-9b19-69eac410523e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc159c6e750549fc992c9f4092d9d1d5'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:30.311291 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-2ea65617-a27e-4081-9b19-69eac410523e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc159c6e750549fc992c9f4092d9d1d5'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:30.312017 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-2ea65617-a27e-4081-9b19-69eac410523e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc159c6e750549fc992c9f4092d9d1d5'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:30.312737 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-2ea65617-a27e-4081-9b19-69eac410523e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc159c6e750549fc992c9f4092d9d1d5'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:30.320682 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-2ea65617-a27e-4081-9b19-69eac410523e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc159c6e750549fc992c9f4092d9d1d5'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:30.398913 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1138/2250] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:30 2022] DELETE /identity/v3/users/cc159c6e750549fc992c9f4092d9d1d5 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:30.403355 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4707ad-ccfb-4e0d-9e1f-55bb470b5a6f None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:30.403830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4707ad-ccfb-4e0d-9e1f-55bb470b5a6f None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:30.403923 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4707ad-ccfb-4e0d-9e1f-55bb470b5a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:30.421230 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-ef4707ad-ccfb-4e0d-9e1f-55bb470b5a6f None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:30.422490 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-ef4707ad-ccfb-4e0d-9e1f-55bb470b5a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:30.481666 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1113/2251] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:30.493745 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea65617-a27e-4081-9b19-69eac410523e admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:30.495225 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-2ea65617-a27e-4081-9b19-69eac410523e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:30.554446 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea65617-a27e-4081-9b19-69eac410523e admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:30.558996 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd18c0-cec6-4409-97c1-26301be3e60f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:30.561065 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd18c0-cec6-4409-97c1-26301be3e60f service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:30.561065 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd18c0-cec6-4409-97c1-26301be3e60f service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:30.561065 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd18c0-cec6-4409-97c1-26301be3e60f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:30.571087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd18c0-cec6-4409-97c1-26301be3e60f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:30.572539 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd18c0-cec6-4409-97c1-26301be3e60f service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:30.582558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1139/2252] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:20:30.840006 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31c538-a8c7-485d-8087-41c1fd87422c None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:30.840710 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31c538-a8c7-485d-8087-41c1fd87422c None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:30.841186 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31c538-a8c7-485d-8087-41c1fd87422c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:30.882540 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-7a31c538-a8c7-485d-8087-41c1fd87422c None None] MFA Rules not processed for user `f733a0cf8c0043a0811e98db4badcc46`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:30.883586 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7a31c538-a8c7-485d-8087-41c1fd87422c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:30.960962 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1114/2253] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:30.968142 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd18c0-cec6-4409-97c1-26301be3e60f service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:30.969799 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-88cd18c0-cec6-4409-97c1-26301be3e60f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:30.984594 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd18c0-cec6-4409-97c1-26301be3e60f service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:30.989996 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3ddb5-4fb1-4db2-9828-f33dbeed3831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:30.990658 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3ddb5-4fb1-4db2-9828-f33dbeed3831 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:30.990940 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3ddb5-4fb1-4db2-9828-f33dbeed3831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:30.991211 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3ddb5-4fb1-4db2-9828-f33dbeed3831 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:30.991905 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3ddb5-4fb1-4db2-9828-f33dbeed3831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:30.993833 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3ddb5-4fb1-4db2-9828-f33dbeed3831 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:31.116756 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31c538-a8c7-485d-8087-41c1fd87422c None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:31.118396 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7a31c538-a8c7-485d-8087-41c1fd87422c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:31.131960 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31c538-a8c7-485d-8087-41c1fd87422c None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:31.136550 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d976049-ab0c-4bb5-8de7-48abfbe32163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:31.137452 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d976049-ab0c-4bb5-8de7-48abfbe32163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:31.137862 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d976049-ab0c-4bb5-8de7-48abfbe32163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:31.138149 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d976049-ab0c-4bb5-8de7-48abfbe32163 admin admin] PATH_INFO: `/v3/projects/5079fd15a6d84ae386cd5b13b9c19624` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:31.139350 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d976049-ab0c-4bb5-8de7-48abfbe32163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5079fd15a6d84ae386cd5b13b9c19624)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:31.151378 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d976049-ab0c-4bb5-8de7-48abfbe32163 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:31.151492 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1140/2254] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:30 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:31.153084 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3ddb5-4fb1-4db2-9828-f33dbeed3831 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:31.221492 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3ddb5-4fb1-4db2-9828-f33dbeed3831 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:31.228766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd58b0-2a63-4326-91d7-e0d74be380ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:31.228766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd58b0-2a63-4326-91d7-e0d74be380ee admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:31.228766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd58b0-2a63-4326-91d7-e0d74be380ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:31.228766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd58b0-2a63-4326-91d7-e0d74be380ee admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:31.229160 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd58b0-2a63-4326-91d7-e0d74be380ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:31.230749 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd58b0-2a63-4326-91d7-e0d74be380ee admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:31.266932 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-3d976049-ab0c-4bb5-8de7-48abfbe32163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5079fd15a6d84ae386cd5b13b9c19624', 'request_id': 'req-3d976049-ab0c-4bb5-8de7-48abfbe32163'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:31.328249 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1141/2255] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:31 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:31.330891 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd58b0-2a63-4326-91d7-e0d74be380ee admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:31.340886 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd58b0-2a63-4326-91d7-e0d74be380ee admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:31.347698 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-3d976049-ab0c-4bb5-8de7-48abfbe32163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5079fd15a6d84ae386cd5b13b9c19624', 'request_id': 'req-3d976049-ab0c-4bb5-8de7-48abfbe32163'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:31.357588 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-3d976049-ab0c-4bb5-8de7-48abfbe32163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5079fd15a6d84ae386cd5b13b9c19624', 'request_id': 'req-3d976049-ab0c-4bb5-8de7-48abfbe32163'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:31.370056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-3d976049-ab0c-4bb5-8de7-48abfbe32163 admin admin] The token cache is being invalidate because project 5079fd15a6d84ae386cd5b13b9c19624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:31.370341 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-3d976049-ab0c-4bb5-8de7-48abfbe32163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:31.371013 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-3d976049-ab0c-4bb5-8de7-48abfbe32163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:31.372568 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1115/2256] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:31 2022] DELETE /identity/v3/projects/5079fd15a6d84ae386cd5b13b9c19624 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:31.380094 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02f2dd-cea8-4b83-9833-cbd755519a72 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:31.380470 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02f2dd-cea8-4b83-9833-cbd755519a72 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:31.380847 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02f2dd-cea8-4b83-9833-cbd755519a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:31.400619 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-2e02f2dd-cea8-4b83-9833-cbd755519a72 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:31.402918 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-2e02f2dd-cea8-4b83-9833-cbd755519a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:31.410318 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d3dc6-a542-407e-827f-911d13a99704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:31.412134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d3dc6-a542-407e-827f-911d13a99704 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:31.412491 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d3dc6-a542-407e-827f-911d13a99704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:31.412885 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d3dc6-a542-407e-827f-911d13a99704 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:31.413777 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d3dc6-a542-407e-827f-911d13a99704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:31.415479 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d3dc6-a542-407e-827f-911d13a99704 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:31.425844 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1142/2257] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:20:31.430227 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d3dc6-a542-407e-827f-911d13a99704 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:31.431921 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-634d3dc6-a542-407e-827f-911d13a99704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:31.444421 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d3dc6-a542-407e-827f-911d13a99704 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:31.451701 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fd256-efa7-4b53-90be-fd086a6ca8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:31.451701 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fd256-efa7-4b53-90be-fd086a6ca8cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:31.451701 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fd256-efa7-4b53-90be-fd086a6ca8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:31.451701 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fd256-efa7-4b53-90be-fd086a6ca8cb admin admin] PATH_INFO: `/v3/projects/66c592ab2d1c43e6a4be5440c308d541/users/c54d8515b5d44d2aafb059b0eba4dc8d/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:31.462253 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1116/2258] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:31.470078 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c176c-89e8-4b93-bbc0-f20cc30a78b4 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:31.470241 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897fd256-efa7-4b53-90be-fd086a6ca8cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c592ab2d1c43e6a4be5440c308d541, user_id=c54d8515b5d44d2aafb059b0eba4dc8d, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:31.470375 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c176c-89e8-4b93-bbc0-f20cc30a78b4 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:31.470654 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c176c-89e8-4b93-bbc0-f20cc30a78b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:31.473550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897fd256-efa7-4b53-90be-fd086a6ca8cb admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:31.489323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-0f9c176c-89e8-4b93-bbc0-f20cc30a78b4 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:31.490542 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-0f9c176c-89e8-4b93-bbc0-f20cc30a78b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:31.498464 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1117/2259] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:20:31.506178 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c176c-89e8-4b93-bbc0-f20cc30a78b4 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:31.511995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c176c-89e8-4b93-bbc0-f20cc30a78b4 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:31.517498 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a86559-2c2e-4b4e-879f-3ad65fec5ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:31.518179 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a86559-2c2e-4b4e-879f-3ad65fec5ffb admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:31.518461 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a86559-2c2e-4b4e-879f-3ad65fec5ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:31.518736 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a86559-2c2e-4b4e-879f-3ad65fec5ffb admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:31.519473 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a86559-2c2e-4b4e-879f-3ad65fec5ffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:20:31.521661 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a86559-2c2e-4b4e-879f-3ad65fec5ffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:31.523425 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a86559-2c2e-4b4e-879f-3ad65fec5ffb admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:31.538247 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1118/2260] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:20:31.547279 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a86559-2c2e-4b4e-879f-3ad65fec5ffb admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:31.557733 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a86559-2c2e-4b4e-879f-3ad65fec5ffb admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:31.562216 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e0b12-d1da-4449-b113-662170549179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:31.562845 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0b12-d1da-4449-b113-662170549179 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:31.563122 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0b12-d1da-4449-b113-662170549179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:31.563409 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0b12-d1da-4449-b113-662170549179 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:31.564110 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e0b12-d1da-4449-b113-662170549179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:31.566033 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e0b12-d1da-4449-b113-662170549179 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:31.606531 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1143/2261] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:31 2022] PUT /identity/v3/projects/66c592ab2d1c43e6a4be5440c308d541/users/c54d8515b5d44d2aafb059b0eba4dc8d/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:31.610483 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fd256-efa7-4b53-90be-fd086a6ca8cb admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:31.669434 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fd256-efa7-4b53-90be-fd086a6ca8cb admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:31.674009 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507cf57-87c0-424d-a484-67a1bcc9e6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:31.674664 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507cf57-87c0-424d-a484-67a1bcc9e6ec admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:31.674941 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507cf57-87c0-424d-a484-67a1bcc9e6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:31.675212 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507cf57-87c0-424d-a484-67a1bcc9e6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:31.675934 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507cf57-87c0-424d-a484-67a1bcc9e6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:31.678105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507cf57-87c0-424d-a484-67a1bcc9e6ec admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:31.687671 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1144/2262] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:20:31.691761 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507cf57-87c0-424d-a484-67a1bcc9e6ec admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:31.695569 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1119/2263] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:31 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:31.697061 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e0b12-d1da-4449-b113-662170549179 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:31.702130 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507cf57-87c0-424d-a484-67a1bcc9e6ec admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:31.759148 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c1f55-4979-4acc-9a42-8af1c5a9845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:31.760590 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e0b12-d1da-4449-b113-662170549179 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:31.760972 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c1f55-4979-4acc-9a42-8af1c5a9845b admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:31.761599 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c1f55-4979-4acc-9a42-8af1c5a9845b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:31.761889 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c1f55-4979-4acc-9a42-8af1c5a9845b admin admin] PATH_INFO: `/v3/projects/66c592ab2d1c43e6a4be5440c308d541/users/c54d8515b5d44d2aafb059b0eba4dc8d/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:31.763873 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c1f55-4979-4acc-9a42-8af1c5a9845b admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c592ab2d1c43e6a4be5440c308d541, user_id=c54d8515b5d44d2aafb059b0eba4dc8d, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:31.766606 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c1f55-4979-4acc-9a42-8af1c5a9845b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:31.766752 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de78b65-5669-4c5e-b8f4-494220066cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:31.767414 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de78b65-5669-4c5e-b8f4-494220066cce admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:31.767759 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de78b65-5669-4c5e-b8f4-494220066cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:31.768226 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de78b65-5669-4c5e-b8f4-494220066cce admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:31.769123 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de78b65-5669-4c5e-b8f4-494220066cce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:31.771124 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de78b65-5669-4c5e-b8f4-494220066cce admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:31.781866 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1145/2264] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:31 2022] PUT /identity/v3/projects/66c592ab2d1c43e6a4be5440c308d541/users/c54d8515b5d44d2aafb059b0eba4dc8d/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:31.873267 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1120/2265] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:31 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:31.888225 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c1f55-4979-4acc-9a42-8af1c5a9845b admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:31.955057 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c1f55-4979-4acc-9a42-8af1c5a9845b admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:31.960438 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b206d-9ef2-48f5-925c-ecab8b21a256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:31.961265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b206d-9ef2-48f5-925c-ecab8b21a256 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:31.961570 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b206d-9ef2-48f5-925c-ecab8b21a256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:31.961842 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b206d-9ef2-48f5-925c-ecab8b21a256 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:31.962567 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b206d-9ef2-48f5-925c-ecab8b21a256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:31.964191 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b206d-9ef2-48f5-925c-ecab8b21a256 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:31.978160 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1146/2266] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:31.982493 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de78b65-5669-4c5e-b8f4-494220066cce admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:31.996953 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de78b65-5669-4c5e-b8f4-494220066cce admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:32.003612 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58602767-f411-45ab-acd6-e453c6138869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:32.004367 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58602767-f411-45ab-acd6-e453c6138869 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:32.005232 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58602767-f411-45ab-acd6-e453c6138869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:32.005232 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58602767-f411-45ab-acd6-e453c6138869 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:32.005740 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58602767-f411-45ab-acd6-e453c6138869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:32.008013 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58602767-f411-45ab-acd6-e453c6138869 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:32.020399 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1121/2267] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:32.024530 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b206d-9ef2-48f5-925c-ecab8b21a256 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:32.034386 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b206d-9ef2-48f5-925c-ecab8b21a256 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:32.039609 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f93c77-8972-44c6-b4a0-787ccb4d124c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:32.040791 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f93c77-8972-44c6-b4a0-787ccb4d124c admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:32.040791 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f93c77-8972-44c6-b4a0-787ccb4d124c admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:32.041048 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f93c77-8972-44c6-b4a0-787ccb4d124c admin admin] PATH_INFO: `/v3/projects/52fda171a20f4fe3b366624e9c26e12a/users/f98c597d9e1a45e7bd8267b730a0b84b/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:32.056281 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f93c77-8972-44c6-b4a0-787ccb4d124c admin admin] RBAC: Authorizing `identity:create_grant(project_id=52fda171a20f4fe3b366624e9c26e12a, user_id=f98c597d9e1a45e7bd8267b730a0b84b, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:32.059009 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f93c77-8972-44c6-b4a0-787ccb4d124c admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:32.151229 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1147/2268] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:32 2022] PUT /identity/v3/projects/52fda171a20f4fe3b366624e9c26e12a/users/f98c597d9e1a45e7bd8267b730a0b84b/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:32.156690 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc6081-bd7e-439e-82be-ba96ddd454f4 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:32.156988 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc6081-bd7e-439e-82be-ba96ddd454f4 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:32.158323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc6081-bd7e-439e-82be-ba96ddd454f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:32.177193 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-4edc6081-bd7e-439e-82be-ba96ddd454f4 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:32.178420 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-4edc6081-bd7e-439e-82be-ba96ddd454f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:32.240104 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1122/2269] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:32.249677 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f93c77-8972-44c6-b4a0-787ccb4d124c admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:32.251409 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-91f93c77-8972-44c6-b4a0-787ccb4d124c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:32.308602 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f93c77-8972-44c6-b4a0-787ccb4d124c admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:32.312809 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d26198-cb52-46f7-9b23-3e593e71fd14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:32.313459 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d26198-cb52-46f7-9b23-3e593e71fd14 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:32.313742 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d26198-cb52-46f7-9b23-3e593e71fd14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:32.314015 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d26198-cb52-46f7-9b23-3e593e71fd14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:32.325199 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d26198-cb52-46f7-9b23-3e593e71fd14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:32.326677 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d26198-cb52-46f7-9b23-3e593e71fd14 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:32.337057 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1148/2270] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:33.447613 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3d7e2-efd0-48f7-b760-d707a9cb64a1 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:33.448089 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3d7e2-efd0-48f7-b760-d707a9cb64a1 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:33.448681 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3d7e2-efd0-48f7-b760-d707a9cb64a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:33.496909 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-c7f3d7e2-efd0-48f7-b760-d707a9cb64a1 None None] MFA Rules not processed for user `c54d8515b5d44d2aafb059b0eba4dc8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:33.496909 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c7f3d7e2-efd0-48f7-b760-d707a9cb64a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:33.600734 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1123/2271] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:33.612186 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d26198-cb52-46f7-9b23-3e593e71fd14 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:33.613820 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-84d26198-cb52-46f7-9b23-3e593e71fd14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:33.705316 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d26198-cb52-46f7-9b23-3e593e71fd14 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:33.710337 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad448c-c702-4901-8067-4f3ff7617492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:33.711198 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad448c-c702-4901-8067-4f3ff7617492 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:33.711635 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad448c-c702-4901-8067-4f3ff7617492 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:33.712063 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad448c-c702-4901-8067-4f3ff7617492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:33.714293 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-bdad448c-c702-4901-8067-4f3ff7617492 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:33.786769 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad448c-c702-4901-8067-4f3ff7617492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:33.788190 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad448c-c702-4901-8067-4f3ff7617492 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:33.799332 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1149/2272] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:35.957117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3d7e2-efd0-48f7-b760-d707a9cb64a1 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:35.972552 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3d7e2-efd0-48f7-b760-d707a9cb64a1 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:35.979671 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7609152-dc3b-4e1c-8b7d-74ba12f1848b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:35.980452 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7609152-dc3b-4e1c-8b7d-74ba12f1848b service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:35.980874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7609152-dc3b-4e1c-8b7d-74ba12f1848b service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:35.981256 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7609152-dc3b-4e1c-8b7d-74ba12f1848b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:36.000120 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7609152-dc3b-4e1c-8b7d-74ba12f1848b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:36.007422 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7609152-dc3b-4e1c-8b7d-74ba12f1848b service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:36.025357 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1124/2273] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:40.044873 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3b23c-9ac3-4288-b63e-db62fa0891bf None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:40.045426 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3b23c-9ac3-4288-b63e-db62fa0891bf None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:40.045426 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3b23c-9ac3-4288-b63e-db62fa0891bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:40.074965 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-08f3b23c-9ac3-4288-b63e-db62fa0891bf None None] MFA Rules not processed for user `f98c597d9e1a45e7bd8267b730a0b84b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:40.076197 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-08f3b23c-9ac3-4288-b63e-db62fa0891bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:40.154214 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1150/2274] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:40.159211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7609152-dc3b-4e1c-8b7d-74ba12f1848b service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:40.171523 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7609152-dc3b-4e1c-8b7d-74ba12f1848b service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:40.176584 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f92dc-b454-4d47-b0d6-cc1b47a94117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:40.178784 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f92dc-b454-4d47-b0d6-cc1b47a94117 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:40.179549 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f92dc-b454-4d47-b0d6-cc1b47a94117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:40.180060 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f92dc-b454-4d47-b0d6-cc1b47a94117 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:40.180992 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f92dc-b454-4d47-b0d6-cc1b47a94117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:40.183190 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f92dc-b454-4d47-b0d6-cc1b47a94117 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:40.316022 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1125/2275] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:40 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:40.321754 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3b23c-9ac3-4288-b63e-db62fa0891bf None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:40.341037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3b23c-9ac3-4288-b63e-db62fa0891bf None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:40.355511 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f92dc-b454-4d47-b0d6-cc1b47a94117 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:40.358051 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-486f92dc-b454-4d47-b0d6-cc1b47a94117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:40.426712 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de3dd5-f389-477f-af6c-8acdb9234471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:40.428088 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de3dd5-f389-477f-af6c-8acdb9234471 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:40.428595 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de3dd5-f389-477f-af6c-8acdb9234471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:40.429101 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de3dd5-f389-477f-af6c-8acdb9234471 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:40.429822 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de3dd5-f389-477f-af6c-8acdb9234471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:40.431757 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de3dd5-f389-477f-af6c-8acdb9234471 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:40.432830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f92dc-b454-4d47-b0d6-cc1b47a94117 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:40.437455 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b557560-d7b3-4dea-9f53-740593439be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:40.438327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b557560-d7b3-4dea-9f53-740593439be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:40.438610 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b557560-d7b3-4dea-9f53-740593439be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:40.438884 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b557560-d7b3-4dea-9f53-740593439be9 admin admin] PATH_INFO: `/v3/users/9c69db83e28c4d76a4db621da73f7a58` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:40.440085 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b557560-d7b3-4dea-9f53-740593439be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c69db83e28c4d76a4db621da73f7a58)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:40.442029 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b557560-d7b3-4dea-9f53-740593439be9 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:40.519605 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1151/2276] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:40 2022] POST /identity/v3/users => generated 295 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:20:40.520965 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de3dd5-f389-477f-af6c-8acdb9234471 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:40.530989 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de3dd5-f389-477f-af6c-8acdb9234471 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:40.536038 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e9ec2-42a7-4290-b906-a9a112d1fd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:40.537489 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e9ec2-42a7-4290-b906-a9a112d1fd6b admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:40.537774 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e9ec2-42a7-4290-b906-a9a112d1fd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:40.538045 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e9ec2-42a7-4290-b906-a9a112d1fd6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:40.538923 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e9ec2-42a7-4290-b906-a9a112d1fd6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:40.540682 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e9ec2-42a7-4290-b906-a9a112d1fd6b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:40.551424 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1152/2277] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:20:40.556341 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e9ec2-42a7-4290-b906-a9a112d1fd6b admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:40.566762 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e9ec2-42a7-4290-b906-a9a112d1fd6b admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:40.571899 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d987e4-bee7-4837-b29c-736ce38c0422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:40.573010 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d987e4-bee7-4837-b29c-736ce38c0422 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:40.577138 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d987e4-bee7-4837-b29c-736ce38c0422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:40.577138 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d987e4-bee7-4837-b29c-736ce38c0422 admin admin] PATH_INFO: `/v3/projects/3de6173449844b499d3ea695164d0db9/users/477824a6ae014cca9d5668a845e2a1de/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:40.592099 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d987e4-bee7-4837-b29c-736ce38c0422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de6173449844b499d3ea695164d0db9, user_id=477824a6ae014cca9d5668a845e2a1de, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:40.594865 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d987e4-bee7-4837-b29c-736ce38c0422 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:40.649039 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-6b557560-d7b3-4dea-9f53-740593439be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c69db83e28c4d76a4db621da73f7a58'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:40.662508 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-6b557560-d7b3-4dea-9f53-740593439be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c69db83e28c4d76a4db621da73f7a58'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:40.663416 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-6b557560-d7b3-4dea-9f53-740593439be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c69db83e28c4d76a4db621da73f7a58'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:40.694444 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1153/2278] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:40 2022] PUT /identity/v3/projects/3de6173449844b499d3ea695164d0db9/users/477824a6ae014cca9d5668a845e2a1de/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:40.698608 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d987e4-bee7-4837-b29c-736ce38c0422 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:40.701266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e6d987e4-bee7-4837-b29c-736ce38c0422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:40.778842 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-6b557560-d7b3-4dea-9f53-740593439be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c69db83e28c4d76a4db621da73f7a58'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:40.779767 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-6b557560-d7b3-4dea-9f53-740593439be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c69db83e28c4d76a4db621da73f7a58'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:40.780361 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d987e4-bee7-4837-b29c-736ce38c0422 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:40.785449 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5ec16-2f48-4367-8a31-e3c6013379cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:40.786272 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5ec16-2f48-4367-8a31-e3c6013379cb admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:40.786415 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5ec16-2f48-4367-8a31-e3c6013379cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:40.786780 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5ec16-2f48-4367-8a31-e3c6013379cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:40.787838 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5ec16-2f48-4367-8a31-e3c6013379cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:40.789697 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5ec16-2f48-4367-8a31-e3c6013379cb admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:40.794307 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1126/2279] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:40 2022] DELETE /identity/v3/users/9c69db83e28c4d76a4db621da73f7a58 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:20:40.799402 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4456fd-10f5-4627-898d-4107167132c3 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:40.799700 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4456fd-10f5-4627-898d-4107167132c3 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:40.799985 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4456fd-10f5-4627-898d-4107167132c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:40.804142 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1154/2280] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:40.805029 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5ec16-2f48-4367-8a31-e3c6013379cb admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:40.820192 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5ec16-2f48-4367-8a31-e3c6013379cb admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:40.820983 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-1b4456fd-10f5-4627-898d-4107167132c3 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:40.822881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1b4456fd-10f5-4627-898d-4107167132c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:40.892528 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1127/2281] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:40.897727 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209230c7-b77e-4f3e-87d5-d50c8ef7ed83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:40.898865 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209230c7-b77e-4f3e-87d5-d50c8ef7ed83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:40.899246 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209230c7-b77e-4f3e-87d5-d50c8ef7ed83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:40.899664 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209230c7-b77e-4f3e-87d5-d50c8ef7ed83 admin admin] PATH_INFO: `/v3/projects/3de6173449844b499d3ea695164d0db9/users/477824a6ae014cca9d5668a845e2a1de/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:40.901971 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209230c7-b77e-4f3e-87d5-d50c8ef7ed83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de6173449844b499d3ea695164d0db9, user_id=477824a6ae014cca9d5668a845e2a1de, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:40.904789 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209230c7-b77e-4f3e-87d5-d50c8ef7ed83 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:40.905118 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4456fd-10f5-4627-898d-4107167132c3 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:40.906597 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1b4456fd-10f5-4627-898d-4107167132c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:40.932353 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1155/2282] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:40 2022] PUT /identity/v3/projects/3de6173449844b499d3ea695164d0db9/users/477824a6ae014cca9d5668a845e2a1de/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:40.978798 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4456fd-10f5-4627-898d-4107167132c3 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:41.036014 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a288f-118b-4950-bcbe-9b764a851f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:41.037903 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a288f-118b-4950-bcbe-9b764a851f6b service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:41.037903 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a288f-118b-4950-bcbe-9b764a851f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:41.038114 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a288f-118b-4950-bcbe-9b764a851f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:41.107363 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a288f-118b-4950-bcbe-9b764a851f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:41.108912 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a288f-118b-4950-bcbe-9b764a851f6b service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:41.118450 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1128/2283] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:20:41.800298 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209230c7-b77e-4f3e-87d5-d50c8ef7ed83 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:41.805666 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-209230c7-b77e-4f3e-87d5-d50c8ef7ed83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:41.861826 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209230c7-b77e-4f3e-87d5-d50c8ef7ed83 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:41.871868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9793ab2-dcee-4644-af41-48e70ed0b16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:41.874608 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9793ab2-dcee-4644-af41-48e70ed0b16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:41.878630 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9793ab2-dcee-4644-af41-48e70ed0b16e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:41.878630 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9793ab2-dcee-4644-af41-48e70ed0b16e admin admin] PATH_INFO: `/v3/projects/6d1fb249b64646038e7f536790add994` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:41.878630 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9793ab2-dcee-4644-af41-48e70ed0b16e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d1fb249b64646038e7f536790add994)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:41.882620 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9793ab2-dcee-4644-af41-48e70ed0b16e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:42.162503 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-b9793ab2-dcee-4644-af41-48e70ed0b16e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d1fb249b64646038e7f536790add994', 'request_id': 'req-b9793ab2-dcee-4644-af41-48e70ed0b16e'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:42.168106 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-b9793ab2-dcee-4644-af41-48e70ed0b16e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d1fb249b64646038e7f536790add994', 'request_id': 'req-b9793ab2-dcee-4644-af41-48e70ed0b16e'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:42.176378 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-b9793ab2-dcee-4644-af41-48e70ed0b16e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d1fb249b64646038e7f536790add994', 'request_id': 'req-b9793ab2-dcee-4644-af41-48e70ed0b16e'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:42.312015 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-b9793ab2-dcee-4644-af41-48e70ed0b16e admin admin] The token cache is being invalidate because project 6d1fb249b64646038e7f536790add994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:42.312334 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-b9793ab2-dcee-4644-af41-48e70ed0b16e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:42.313664 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-b9793ab2-dcee-4644-af41-48e70ed0b16e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:42.317474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1156/2284] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:41 2022] DELETE /identity/v3/projects/6d1fb249b64646038e7f536790add994 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:42.323382 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017e1b7-c89f-4f6c-abbd-e015fe6540af None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:42.323967 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017e1b7-c89f-4f6c-abbd-e015fe6540af None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:42.323967 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017e1b7-c89f-4f6c-abbd-e015fe6540af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:42.359787 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-a017e1b7-c89f-4f6c-abbd-e015fe6540af None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:42.362374 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-a017e1b7-c89f-4f6c-abbd-e015fe6540af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:42.445061 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1129/2285] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:42.453013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267ccd7-db13-49df-affa-2182c389e244 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:42.453013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267ccd7-db13-49df-affa-2182c389e244 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:42.453013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267ccd7-db13-49df-affa-2182c389e244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:42.496284 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-b267ccd7-db13-49df-affa-2182c389e244 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:42.497831 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b267ccd7-db13-49df-affa-2182c389e244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:42.528518 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017e1b7-c89f-4f6c-abbd-e015fe6540af None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:42.549059 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1157/2286] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:42.556689 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017e1b7-c89f-4f6c-abbd-e015fe6540af None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:42.570120 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa585e90-3cce-4e89-9b78-554993f7ad5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:42.571302 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa585e90-3cce-4e89-9b78-554993f7ad5a admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:42.571813 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa585e90-3cce-4e89-9b78-554993f7ad5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:42.573829 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa585e90-3cce-4e89-9b78-554993f7ad5a admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:42.574802 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa585e90-3cce-4e89-9b78-554993f7ad5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:20:42.578238 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa585e90-3cce-4e89-9b78-554993f7ad5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:42.580087 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa585e90-3cce-4e89-9b78-554993f7ad5a admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:42.608824 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1130/2287] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:20:42.614961 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267ccd7-db13-49df-affa-2182c389e244 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:42.628314 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267ccd7-db13-49df-affa-2182c389e244 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:42.635577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15db6a2-1046-4812-9737-7e491eca5ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:42.636518 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15db6a2-1046-4812-9737-7e491eca5ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:42.637057 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15db6a2-1046-4812-9737-7e491eca5ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:42.637625 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15db6a2-1046-4812-9737-7e491eca5ed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:42.638619 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15db6a2-1046-4812-9737-7e491eca5ed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:42.645507 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15db6a2-1046-4812-9737-7e491eca5ed1 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:42.785349 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1158/2288] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:20:42 2022] POST /identity/v3/projects => generated 397 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:42.789078 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa585e90-3cce-4e89-9b78-554993f7ad5a admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:42.800707 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa585e90-3cce-4e89-9b78-554993f7ad5a admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:42.865992 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49057a-b886-4ef1-9959-68e5498faa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:42.866890 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49057a-b886-4ef1-9959-68e5498faa6b admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:42.867259 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49057a-b886-4ef1-9959-68e5498faa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:42.867591 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49057a-b886-4ef1-9959-68e5498faa6b admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:42.868357 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49057a-b886-4ef1-9959-68e5498faa6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:42.870407 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49057a-b886-4ef1-9959-68e5498faa6b admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:43.020021 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1131/2289] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:20:42 2022] POST /identity/v3/users => generated 299 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:20:43.024583 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15db6a2-1046-4812-9737-7e491eca5ed1 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:43.038730 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15db6a2-1046-4812-9737-7e491eca5ed1 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:43.047636 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32aade-f1cf-407c-9a18-79c184a0328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:43.048639 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32aade-f1cf-407c-9a18-79c184a0328c admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:43.049376 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32aade-f1cf-407c-9a18-79c184a0328c admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:43.049863 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32aade-f1cf-407c-9a18-79c184a0328c admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:43.050805 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32aade-f1cf-407c-9a18-79c184a0328c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:43.053380 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32aade-f1cf-407c-9a18-79c184a0328c admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:43.070323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1159/2290] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:43.071969 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49057a-b886-4ef1-9959-68e5498faa6b admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:43.092364 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49057a-b886-4ef1-9959-68e5498faa6b admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:43.110912 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068d0d2-a651-4b7f-b320-99bf9b9233d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:43.111707 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068d0d2-a651-4b7f-b320-99bf9b9233d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:43.112143 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068d0d2-a651-4b7f-b320-99bf9b9233d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:43.113058 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068d0d2-a651-4b7f-b320-99bf9b9233d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:43.114551 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068d0d2-a651-4b7f-b320-99bf9b9233d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:43.117517 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068d0d2-a651-4b7f-b320-99bf9b9233d1 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:43.142119 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1132/2291] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:20:43.146841 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32aade-f1cf-407c-9a18-79c184a0328c admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:43.158309 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32aade-f1cf-407c-9a18-79c184a0328c admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:43.169153 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c38663-1a7e-4785-a320-372c89067df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:43.170341 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c38663-1a7e-4785-a320-372c89067df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:43.170623 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c38663-1a7e-4785-a320-372c89067df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:43.170902 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c38663-1a7e-4785-a320-372c89067df5 admin admin] PATH_INFO: `/v3/projects/85d10692318a42b9b1e0e388e87dd5cb/users/8fe11d503f1949c5b3728fe38bc71a61/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:43.189497 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c38663-1a7e-4785-a320-372c89067df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d10692318a42b9b1e0e388e87dd5cb, user_id=8fe11d503f1949c5b3728fe38bc71a61, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:43.193680 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c38663-1a7e-4785-a320-372c89067df5 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:43.323863 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1160/2292] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:20:43 2022] PUT /identity/v3/projects/85d10692318a42b9b1e0e388e87dd5cb/users/8fe11d503f1949c5b3728fe38bc71a61/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:43.330644 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feba2f2-f34b-453f-99e3-bde9c1e6bc40 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:43.331102 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feba2f2-f34b-453f-99e3-bde9c1e6bc40 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:43.331195 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feba2f2-f34b-453f-99e3-bde9c1e6bc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:43.382507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-2feba2f2-f34b-453f-99e3-bde9c1e6bc40 None None] MFA Rules not processed for user `8fe11d503f1949c5b3728fe38bc71a61`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:43.383879 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-2feba2f2-f34b-453f-99e3-bde9c1e6bc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:43.468402 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1133/2293] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:43.482682 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c38663-1a7e-4785-a320-372c89067df5 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:43.484490 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-15c38663-1a7e-4785-a320-372c89067df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:43.580629 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c38663-1a7e-4785-a320-372c89067df5 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:43.585095 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83327781-0238-4967-af25-b292d31d69c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:43.586033 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83327781-0238-4967-af25-b292d31d69c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:43.586796 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83327781-0238-4967-af25-b292d31d69c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:43.587122 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83327781-0238-4967-af25-b292d31d69c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:43.598982 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83327781-0238-4967-af25-b292d31d69c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:43.601783 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83327781-0238-4967-af25-b292d31d69c9 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:43.611876 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1161/2294] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:48.851581 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc6fa5-78bd-4905-a345-73dbed33a4ad None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:48.852067 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc6fa5-78bd-4905-a345-73dbed33a4ad None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:48.852370 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc6fa5-78bd-4905-a345-73dbed33a4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:48.889172 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-25bc6fa5-78bd-4905-a345-73dbed33a4ad None None] MFA Rules not processed for user `477824a6ae014cca9d5668a845e2a1de`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:48.889172 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-25bc6fa5-78bd-4905-a345-73dbed33a4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:48.968922 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1134/2295] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:48.980715 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83327781-0238-4967-af25-b292d31d69c9 service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:48.982347 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-83327781-0238-4967-af25-b292d31d69c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:49.063181 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83327781-0238-4967-af25-b292d31d69c9 service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:49.068783 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94044c58-cbaa-4bb3-9438-1ac52c9b1d74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:49.070178 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94044c58-cbaa-4bb3-9438-1ac52c9b1d74 service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:49.070662 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94044c58-cbaa-4bb3-9438-1ac52c9b1d74 service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:49.071150 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94044c58-cbaa-4bb3-9438-1ac52c9b1d74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:49.074707 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-94044c58-cbaa-4bb3-9438-1ac52c9b1d74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:49.153900 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94044c58-cbaa-4bb3-9438-1ac52c9b1d74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:49.155559 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94044c58-cbaa-4bb3-9438-1ac52c9b1d74 service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:49.165939 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1162/2296] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:54.640969 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc6fa5-78bd-4905-a345-73dbed33a4ad None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:54.756765 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc6fa5-78bd-4905-a345-73dbed33a4ad None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:54.761508 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bff690-80d8-4551-8fcd-7d8006ac06ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:54.762382 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bff690-80d8-4551-8fcd-7d8006ac06ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:54.762663 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bff690-80d8-4551-8fcd-7d8006ac06ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:54.762935 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bff690-80d8-4551-8fcd-7d8006ac06ff admin admin] PATH_INFO: `/v3/users/8fe11d503f1949c5b3728fe38bc71a61` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:54.764157 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bff690-80d8-4551-8fcd-7d8006ac06ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe11d503f1949c5b3728fe38bc71a61)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:54.766122 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bff690-80d8-4551-8fcd-7d8006ac06ff admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:55.029210 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-00bff690-80d8-4551-8fcd-7d8006ac06ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe11d503f1949c5b3728fe38bc71a61'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:55.040860 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-00bff690-80d8-4551-8fcd-7d8006ac06ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe11d503f1949c5b3728fe38bc71a61'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:55.042358 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-00bff690-80d8-4551-8fcd-7d8006ac06ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe11d503f1949c5b3728fe38bc71a61'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:55.295738 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-00bff690-80d8-4551-8fcd-7d8006ac06ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe11d503f1949c5b3728fe38bc71a61'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:55.296384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-00bff690-80d8-4551-8fcd-7d8006ac06ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe11d503f1949c5b3728fe38bc71a61'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:55.313953 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1135/2297] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:20:54 2022] DELETE /identity/v3/users/8fe11d503f1949c5b3728fe38bc71a61 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:20:55.323119 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c441d31-4556-4c58-b850-0ae6d7a42601 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:55.323660 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c441d31-4556-4c58-b850-0ae6d7a42601 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:55.323741 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c441d31-4556-4c58-b850-0ae6d7a42601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:55.399267 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-8c441d31-4556-4c58-b850-0ae6d7a42601 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:20:55.401492 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-8c441d31-4556-4c58-b850-0ae6d7a42601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:55.469484 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1163/2298] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:20:55.479101 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bff690-80d8-4551-8fcd-7d8006ac06ff admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:55.481633 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-00bff690-80d8-4551-8fcd-7d8006ac06ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:55.578751 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bff690-80d8-4551-8fcd-7d8006ac06ff admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:55.582880 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc67da1-9248-440f-839b-a6018f1d60b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:55.583624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc67da1-9248-440f-839b-a6018f1d60b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:55.584002 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc67da1-9248-440f-839b-a6018f1d60b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:55.584379 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc67da1-9248-440f-839b-a6018f1d60b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:55.595816 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc67da1-9248-440f-839b-a6018f1d60b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:55.598649 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc67da1-9248-440f-839b-a6018f1d60b8 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:55.609454 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1136/2299] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:20:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:20:56.126301 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c441d31-4556-4c58-b850-0ae6d7a42601 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:20:56.127794 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-8c441d31-4556-4c58-b850-0ae6d7a42601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:20:56.140420 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c441d31-4556-4c58-b850-0ae6d7a42601 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:20:56.145020 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432d85d-2455-4c00-a31c-9926159cab6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:20:56.145876 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432d85d-2455-4c00-a31c-9926159cab6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:20:56.146161 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432d85d-2455-4c00-a31c-9926159cab6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:20:56.146438 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432d85d-2455-4c00-a31c-9926159cab6b admin admin] PATH_INFO: `/v3/projects/85d10692318a42b9b1e0e388e87dd5cb` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:20:56.147623 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3432d85d-2455-4c00-a31c-9926159cab6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d10692318a42b9b1e0e388e87dd5cb)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:20:56.149592 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3432d85d-2455-4c00-a31c-9926159cab6b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:20:56.266870 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3432d85d-2455-4c00-a31c-9926159cab6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d10692318a42b9b1e0e388e87dd5cb', 'request_id': 'req-3432d85d-2455-4c00-a31c-9926159cab6b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:56.272258 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3432d85d-2455-4c00-a31c-9926159cab6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d10692318a42b9b1e0e388e87dd5cb', 'request_id': 'req-3432d85d-2455-4c00-a31c-9926159cab6b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:56.278297 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3432d85d-2455-4c00-a31c-9926159cab6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d10692318a42b9b1e0e388e87dd5cb', 'request_id': 'req-3432d85d-2455-4c00-a31c-9926159cab6b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:56.352070 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3432d85d-2455-4c00-a31c-9926159cab6b admin admin] The token cache is being invalidate because project 85d10692318a42b9b1e0e388e87dd5cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:20:56.352634 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3432d85d-2455-4c00-a31c-9926159cab6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:56.353001 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3432d85d-2455-4c00-a31c-9926159cab6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:20:56.355392 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1164/2300] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:20:56 2022] DELETE /identity/v3/projects/85d10692318a42b9b1e0e388e87dd5cb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:21:02.502679 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc67da1-9248-440f-839b-a6018f1d60b8 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:02.505594 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-cbc67da1-9248-440f-839b-a6018f1d60b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:02.521502 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc67da1-9248-440f-839b-a6018f1d60b8 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:02.586998 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5fdb7-2ab6-434f-8604-7d1a6184fc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:02.587997 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5fdb7-2ab6-434f-8604-7d1a6184fc34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:02.588325 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5fdb7-2ab6-434f-8604-7d1a6184fc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:02.588603 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5fdb7-2ab6-434f-8604-7d1a6184fc34 admin admin] PATH_INFO: `/v3/users/f733a0cf8c0043a0811e98db4badcc46` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:02.590174 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5fdb7-2ab6-434f-8604-7d1a6184fc34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f733a0cf8c0043a0811e98db4badcc46)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:02.592248 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5fdb7-2ab6-434f-8604-7d1a6184fc34 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:02.848837 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f8b5fdb7-2ab6-434f-8604-7d1a6184fc34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f733a0cf8c0043a0811e98db4badcc46'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:02.863245 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f8b5fdb7-2ab6-434f-8604-7d1a6184fc34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f733a0cf8c0043a0811e98db4badcc46'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:02.864073 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f8b5fdb7-2ab6-434f-8604-7d1a6184fc34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f733a0cf8c0043a0811e98db4badcc46'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:02.968367 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f8b5fdb7-2ab6-434f-8604-7d1a6184fc34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f733a0cf8c0043a0811e98db4badcc46'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:02.969021 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f8b5fdb7-2ab6-434f-8604-7d1a6184fc34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f733a0cf8c0043a0811e98db4badcc46'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:02.985269 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1137/2301] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:21:02 2022] DELETE /identity/v3/users/f733a0cf8c0043a0811e98db4badcc46 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:21:03.258320 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432d85d-2455-4c00-a31c-9926159cab6b admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:03.262155 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-3432d85d-2455-4c00-a31c-9926159cab6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:03.274938 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432d85d-2455-4c00-a31c-9926159cab6b admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:03.348824 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fbdd2-1d13-4ec0-81c4-f396f87506c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:03.349783 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fbdd2-1d13-4ec0-81c4-f396f87506c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:03.350522 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fbdd2-1d13-4ec0-81c4-f396f87506c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:03.350522 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fbdd2-1d13-4ec0-81c4-f396f87506c7 admin admin] PATH_INFO: `/v3/projects/c170ec4c73ae4b7ea2f1c85467968924` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:03.351603 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fbdd2-1d13-4ec0-81c4-f396f87506c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c170ec4c73ae4b7ea2f1c85467968924)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:03.353580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fbdd2-1d13-4ec0-81c4-f396f87506c7 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:03.461963 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-502fbdd2-1d13-4ec0-81c4-f396f87506c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c170ec4c73ae4b7ea2f1c85467968924', 'request_id': 'req-502fbdd2-1d13-4ec0-81c4-f396f87506c7'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:03.468009 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-502fbdd2-1d13-4ec0-81c4-f396f87506c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c170ec4c73ae4b7ea2f1c85467968924', 'request_id': 'req-502fbdd2-1d13-4ec0-81c4-f396f87506c7'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:03.474041 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-502fbdd2-1d13-4ec0-81c4-f396f87506c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c170ec4c73ae4b7ea2f1c85467968924', 'request_id': 'req-502fbdd2-1d13-4ec0-81c4-f396f87506c7'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:03.524797 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-502fbdd2-1d13-4ec0-81c4-f396f87506c7 admin admin] The token cache is being invalidate because project c170ec4c73ae4b7ea2f1c85467968924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:21:03.525081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-502fbdd2-1d13-4ec0-81c4-f396f87506c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:03.525692 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-502fbdd2-1d13-4ec0-81c4-f396f87506c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:03.527746 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1165/2302] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:21:03 2022] DELETE /identity/v3/projects/c170ec4c73ae4b7ea2f1c85467968924 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:21:03.531751 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5fdb7-2ab6-434f-8604-7d1a6184fc34 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:03.533187 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f8b5fdb7-2ab6-434f-8604-7d1a6184fc34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:03.547153 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5fdb7-2ab6-434f-8604-7d1a6184fc34 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:03.611241 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b38a2-25c6-47d8-a1a5-823c3a1a4f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:03.612107 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b38a2-25c6-47d8-a1a5-823c3a1a4f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:03.612385 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b38a2-25c6-47d8-a1a5-823c3a1a4f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:03.612676 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b38a2-25c6-47d8-a1a5-823c3a1a4f7a admin admin] PATH_INFO: `/v3/users/c54d8515b5d44d2aafb059b0eba4dc8d` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:03.613890 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b38a2-25c6-47d8-a1a5-823c3a1a4f7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c54d8515b5d44d2aafb059b0eba4dc8d)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:03.615859 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b38a2-25c6-47d8-a1a5-823c3a1a4f7a admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:03.766990 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ed4b38a2-25c6-47d8-a1a5-823c3a1a4f7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c54d8515b5d44d2aafb059b0eba4dc8d'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:03.778966 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ed4b38a2-25c6-47d8-a1a5-823c3a1a4f7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c54d8515b5d44d2aafb059b0eba4dc8d'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:03.779630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ed4b38a2-25c6-47d8-a1a5-823c3a1a4f7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c54d8515b5d44d2aafb059b0eba4dc8d'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:03.840428 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ed4b38a2-25c6-47d8-a1a5-823c3a1a4f7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c54d8515b5d44d2aafb059b0eba4dc8d'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:03.841245 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ed4b38a2-25c6-47d8-a1a5-823c3a1a4f7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c54d8515b5d44d2aafb059b0eba4dc8d'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:03.854621 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1138/2303] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:21:03 2022] DELETE /identity/v3/users/c54d8515b5d44d2aafb059b0eba4dc8d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:21:04.132889 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fbdd2-1d13-4ec0-81c4-f396f87506c7 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:04.134403 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-502fbdd2-1d13-4ec0-81c4-f396f87506c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:04.160256 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fbdd2-1d13-4ec0-81c4-f396f87506c7 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:04.244538 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bfde1-38cc-4062-a4aa-38e67a29c5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:04.246037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bfde1-38cc-4062-a4aa-38e67a29c5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:04.246926 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bfde1-38cc-4062-a4aa-38e67a29c5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:04.247383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bfde1-38cc-4062-a4aa-38e67a29c5f4 admin admin] PATH_INFO: `/v3/projects/66c592ab2d1c43e6a4be5440c308d541` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:04.250441 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bfde1-38cc-4062-a4aa-38e67a29c5f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c592ab2d1c43e6a4be5440c308d541)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:04.252389 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bfde1-38cc-4062-a4aa-38e67a29c5f4 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:04.352763 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3e0bfde1-38cc-4062-a4aa-38e67a29c5f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c592ab2d1c43e6a4be5440c308d541', 'request_id': 'req-3e0bfde1-38cc-4062-a4aa-38e67a29c5f4'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:04.368802 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3e0bfde1-38cc-4062-a4aa-38e67a29c5f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c592ab2d1c43e6a4be5440c308d541', 'request_id': 'req-3e0bfde1-38cc-4062-a4aa-38e67a29c5f4'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:04.376157 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3e0bfde1-38cc-4062-a4aa-38e67a29c5f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c592ab2d1c43e6a4be5440c308d541', 'request_id': 'req-3e0bfde1-38cc-4062-a4aa-38e67a29c5f4'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:04.519160 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3e0bfde1-38cc-4062-a4aa-38e67a29c5f4 admin admin] The token cache is being invalidate because project 66c592ab2d1c43e6a4be5440c308d541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:21:04.519443 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3e0bfde1-38cc-4062-a4aa-38e67a29c5f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:04.520122 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3e0bfde1-38cc-4062-a4aa-38e67a29c5f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:04.523741 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1166/2304] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:21:04 2022] DELETE /identity/v3/projects/66c592ab2d1c43e6a4be5440c308d541 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:21:04.527594 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f42e2-4d5e-4a4b-b5a1-7ee36c510e87 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:04.527881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f42e2-4d5e-4a4b-b5a1-7ee36c510e87 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:04.528159 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f42e2-4d5e-4a4b-b5a1-7ee36c510e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:04.567619 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-502f42e2-4d5e-4a4b-b5a1-7ee36c510e87 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:04.568876 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-502f42e2-4d5e-4a4b-b5a1-7ee36c510e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:04.643063 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1139/2305] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:21:04.654296 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173bd2a-ab98-4056-b1cf-9620ee78f72b None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:04.654590 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173bd2a-ab98-4056-b1cf-9620ee78f72b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:04.654872 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173bd2a-ab98-4056-b1cf-9620ee78f72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:04.674021 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-1173bd2a-ab98-4056-b1cf-9620ee78f72b None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:04.675233 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-1173bd2a-ab98-4056-b1cf-9620ee78f72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:04.683477 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1167/2306] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:21:04.688132 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f42e2-4d5e-4a4b-b5a1-7ee36c510e87 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:04.698641 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f42e2-4d5e-4a4b-b5a1-7ee36c510e87 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:04.704035 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f418d1-cf6c-4c15-8d64-21bcce2ea573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:04.704753 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f418d1-cf6c-4c15-8d64-21bcce2ea573 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:04.705030 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f418d1-cf6c-4c15-8d64-21bcce2ea573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:04.705301 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f418d1-cf6c-4c15-8d64-21bcce2ea573 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:04.706021 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f418d1-cf6c-4c15-8d64-21bcce2ea573 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:21:04.706371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f418d1-cf6c-4c15-8d64-21bcce2ea573 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:04.708040 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f418d1-cf6c-4c15-8d64-21bcce2ea573 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:04.720073 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1140/2307] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:21:04.724573 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173bd2a-ab98-4056-b1cf-9620ee78f72b None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:04.734138 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173bd2a-ab98-4056-b1cf-9620ee78f72b None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:04.742110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d1588-7e54-4b50-b018-4423bb561a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:04.742110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d1588-7e54-4b50-b018-4423bb561a46 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:04.742110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d1588-7e54-4b50-b018-4423bb561a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:04.742110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d1588-7e54-4b50-b018-4423bb561a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:04.742500 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d1588-7e54-4b50-b018-4423bb561a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:04.742603 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d1588-7e54-4b50-b018-4423bb561a46 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:04.839575 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1168/2308] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:21:04 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:21:04.843807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f418d1-cf6c-4c15-8d64-21bcce2ea573 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:04.853546 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f418d1-cf6c-4c15-8d64-21bcce2ea573 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:04.910907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3f782-76fd-4ef3-836c-86d0fbfbf535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:04.911584 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3f782-76fd-4ef3-836c-86d0fbfbf535 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:04.911863 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3f782-76fd-4ef3-836c-86d0fbfbf535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:04.912137 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3f782-76fd-4ef3-836c-86d0fbfbf535 admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:04.912894 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3f782-76fd-4ef3-836c-86d0fbfbf535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:04.914923 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3f782-76fd-4ef3-836c-86d0fbfbf535 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:05.064220 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1141/2309] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:21:04 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:21:05.066345 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d1588-7e54-4b50-b018-4423bb561a46 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:05.078882 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d1588-7e54-4b50-b018-4423bb561a46 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:05.083465 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48e50d-abec-41bc-939d-10db3f509695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:05.084184 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48e50d-abec-41bc-939d-10db3f509695 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:05.084466 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48e50d-abec-41bc-939d-10db3f509695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:05.084771 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48e50d-abec-41bc-939d-10db3f509695 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:05.085506 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48e50d-abec-41bc-939d-10db3f509695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:05.087126 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48e50d-abec-41bc-939d-10db3f509695 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:05.097843 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1169/2310] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:21:05.101727 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3f782-76fd-4ef3-836c-86d0fbfbf535 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:05.112202 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3f782-76fd-4ef3-836c-86d0fbfbf535 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:05.116723 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f3e71-e598-464e-9d73-ebbe99825317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:05.117381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f3e71-e598-464e-9d73-ebbe99825317 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:05.117666 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f3e71-e598-464e-9d73-ebbe99825317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:05.118066 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f3e71-e598-464e-9d73-ebbe99825317 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:05.118759 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f3e71-e598-464e-9d73-ebbe99825317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:05.120362 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f3e71-e598-464e-9d73-ebbe99825317 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:05.131149 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1142/2311] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:21:05.135163 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48e50d-abec-41bc-939d-10db3f509695 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:05.146794 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48e50d-abec-41bc-939d-10db3f509695 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:05.152263 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680046d3-a20f-49af-8e03-4078b787cc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:05.153698 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680046d3-a20f-49af-8e03-4078b787cc8e admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:05.154121 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680046d3-a20f-49af-8e03-4078b787cc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:05.154446 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680046d3-a20f-49af-8e03-4078b787cc8e admin admin] PATH_INFO: `/v3/projects/0e909a6a2c5b4d35a7e4364221c669a4/users/d2140727281842c6b66fc805fedc491b/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:05.169309 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680046d3-a20f-49af-8e03-4078b787cc8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e909a6a2c5b4d35a7e4364221c669a4, user_id=d2140727281842c6b66fc805fedc491b, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:05.172114 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680046d3-a20f-49af-8e03-4078b787cc8e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:05.274534 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1170/2312] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:21:05 2022] PUT /identity/v3/projects/0e909a6a2c5b4d35a7e4364221c669a4/users/d2140727281842c6b66fc805fedc491b/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:21:05.284924 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64122e1-53c3-46ce-b1d8-c939fc7ed145 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:05.285218 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64122e1-53c3-46ce-b1d8-c939fc7ed145 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:05.285507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64122e1-53c3-46ce-b1d8-c939fc7ed145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:05.313982 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-b64122e1-53c3-46ce-b1d8-c939fc7ed145 None None] MFA Rules not processed for user `d2140727281842c6b66fc805fedc491b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:05.315190 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b64122e1-53c3-46ce-b1d8-c939fc7ed145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:05.388758 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1143/2313] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:21:05.400570 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680046d3-a20f-49af-8e03-4078b787cc8e admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:05.402754 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-680046d3-a20f-49af-8e03-4078b787cc8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:05.461055 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680046d3-a20f-49af-8e03-4078b787cc8e admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:05.465381 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4e7e5-1353-475c-9dc6-e3b386f519c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:05.466021 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4e7e5-1353-475c-9dc6-e3b386f519c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:05.466306 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4e7e5-1353-475c-9dc6-e3b386f519c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:05.466582 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4e7e5-1353-475c-9dc6-e3b386f519c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:05.474872 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4e7e5-1353-475c-9dc6-e3b386f519c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:05.476316 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4e7e5-1353-475c-9dc6-e3b386f519c7 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:05.485495 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1171/2314] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:21:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:21:11.937187 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd989f92-0737-46ab-bc82-d289d2a2cc01 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:11.937648 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd989f92-0737-46ab-bc82-d289d2a2cc01 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:11.937739 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd989f92-0737-46ab-bc82-d289d2a2cc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:11.956023 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-bd989f92-0737-46ab-bc82-d289d2a2cc01 None None] MFA Rules not processed for user `728607c7138540d69532b0b806b9ccaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:11.957306 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-bd989f92-0737-46ab-bc82-d289d2a2cc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:12.015897 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1144/2315] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:21:25.222700 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4e7e5-1353-475c-9dc6-e3b386f519c7 service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:25.224135 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-23c4e7e5-1353-475c-9dc6-e3b386f519c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:25.287903 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4e7e5-1353-475c-9dc6-e3b386f519c7 service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:25.292307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeabc9d-00a2-47ba-a5ce-c7ae510bba84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:25.293187 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeabc9d-00a2-47ba-a5ce-c7ae510bba84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:25.293465 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeabc9d-00a2-47ba-a5ce-c7ae510bba84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:25.293737 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeabc9d-00a2-47ba-a5ce-c7ae510bba84 admin admin] PATH_INFO: `/v3/users/de591c1b2feb46779c4eb3a867c262b8` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:25.294891 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeabc9d-00a2-47ba-a5ce-c7ae510bba84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de591c1b2feb46779c4eb3a867c262b8)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:25.296974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeabc9d-00a2-47ba-a5ce-c7ae510bba84 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:25.466555 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-7eeabc9d-00a2-47ba-a5ce-c7ae510bba84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de591c1b2feb46779c4eb3a867c262b8'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:25.478987 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-7eeabc9d-00a2-47ba-a5ce-c7ae510bba84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de591c1b2feb46779c4eb3a867c262b8'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:25.479683 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-7eeabc9d-00a2-47ba-a5ce-c7ae510bba84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de591c1b2feb46779c4eb3a867c262b8'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:25.480278 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-7eeabc9d-00a2-47ba-a5ce-c7ae510bba84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de591c1b2feb46779c4eb3a867c262b8'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:25.487942 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-7eeabc9d-00a2-47ba-a5ce-c7ae510bba84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de591c1b2feb46779c4eb3a867c262b8'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:25.550928 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1172/2316] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:21:25 2022] DELETE /identity/v3/users/de591c1b2feb46779c4eb3a867c262b8 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:21:25.555522 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf7668-ac9a-471c-ab2b-67a9599335e6 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:25.556004 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf7668-ac9a-471c-ab2b-67a9599335e6 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:25.556140 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf7668-ac9a-471c-ab2b-67a9599335e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:25.574244 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-3caf7668-ac9a-471c-ab2b-67a9599335e6 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:25.575428 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-3caf7668-ac9a-471c-ab2b-67a9599335e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:25.632070 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1145/2317] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:21:25.641265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeabc9d-00a2-47ba-a5ce-c7ae510bba84 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:25.642745 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-7eeabc9d-00a2-47ba-a5ce-c7ae510bba84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:25.699318 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeabc9d-00a2-47ba-a5ce-c7ae510bba84 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:25.703154 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a76fdc-d3b8-4f81-b4cf-cfa11397ec41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:25.703800 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a76fdc-d3b8-4f81-b4cf-cfa11397ec41 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:25.704137 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a76fdc-d3b8-4f81-b4cf-cfa11397ec41 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:25.704563 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a76fdc-d3b8-4f81-b4cf-cfa11397ec41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:25.717351 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a76fdc-d3b8-4f81-b4cf-cfa11397ec41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:25.718769 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a76fdc-d3b8-4f81-b4cf-cfa11397ec41 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:25.729236 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1173/2318] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:21:26.185342 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf7668-ac9a-471c-ab2b-67a9599335e6 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:26.189071 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-3caf7668-ac9a-471c-ab2b-67a9599335e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:26.204585 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf7668-ac9a-471c-ab2b-67a9599335e6 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:26.209845 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d60bb4-bb6c-4b36-a93f-c2f0252ca598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:26.210699 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d60bb4-bb6c-4b36-a93f-c2f0252ca598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:26.211148 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d60bb4-bb6c-4b36-a93f-c2f0252ca598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:26.211433 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d60bb4-bb6c-4b36-a93f-c2f0252ca598 admin admin] PATH_INFO: `/v3/projects/e8ae287c699d464a80c5026e2ebfd7f2` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:26.212634 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d60bb4-bb6c-4b36-a93f-c2f0252ca598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8ae287c699d464a80c5026e2ebfd7f2)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:26.214589 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d60bb4-bb6c-4b36-a93f-c2f0252ca598 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:26.310570 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-88d60bb4-bb6c-4b36-a93f-c2f0252ca598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ae287c699d464a80c5026e2ebfd7f2', 'request_id': 'req-88d60bb4-bb6c-4b36-a93f-c2f0252ca598'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:26.379644 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-88d60bb4-bb6c-4b36-a93f-c2f0252ca598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ae287c699d464a80c5026e2ebfd7f2', 'request_id': 'req-88d60bb4-bb6c-4b36-a93f-c2f0252ca598'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:26.385416 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-88d60bb4-bb6c-4b36-a93f-c2f0252ca598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ae287c699d464a80c5026e2ebfd7f2', 'request_id': 'req-88d60bb4-bb6c-4b36-a93f-c2f0252ca598'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:26.396886 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-88d60bb4-bb6c-4b36-a93f-c2f0252ca598 admin admin] The token cache is being invalidate because project e8ae287c699d464a80c5026e2ebfd7f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:21:26.397176 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-88d60bb4-bb6c-4b36-a93f-c2f0252ca598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:26.397819 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-88d60bb4-bb6c-4b36-a93f-c2f0252ca598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:26.399350 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1146/2319] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:21:26 2022] DELETE /identity/v3/projects/e8ae287c699d464a80c5026e2ebfd7f2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:21:26.404087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a76fdc-d3b8-4f81-b4cf-cfa11397ec41 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:26.414552 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a76fdc-d3b8-4f81-b4cf-cfa11397ec41 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:26.470358 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe787a-9ecf-4f64-b4f9-5b29a0a1045f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:26.471126 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe787a-9ecf-4f64-b4f9-5b29a0a1045f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:26.471403 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe787a-9ecf-4f64-b4f9-5b29a0a1045f admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:26.471675 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe787a-9ecf-4f64-b4f9-5b29a0a1045f admin admin] PATH_INFO: `/v3/users/4a820fdf6e2b4c989ffb2dd1aac7b686` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:26.472863 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe787a-9ecf-4f64-b4f9-5b29a0a1045f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a820fdf6e2b4c989ffb2dd1aac7b686)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:26.474778 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe787a-9ecf-4f64-b4f9-5b29a0a1045f admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:26.654956 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-eebe787a-9ecf-4f64-b4f9-5b29a0a1045f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a820fdf6e2b4c989ffb2dd1aac7b686'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:26.667048 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-eebe787a-9ecf-4f64-b4f9-5b29a0a1045f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a820fdf6e2b4c989ffb2dd1aac7b686'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:26.667718 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-eebe787a-9ecf-4f64-b4f9-5b29a0a1045f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a820fdf6e2b4c989ffb2dd1aac7b686'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:26.668316 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-eebe787a-9ecf-4f64-b4f9-5b29a0a1045f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a820fdf6e2b4c989ffb2dd1aac7b686'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:26.676023 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-eebe787a-9ecf-4f64-b4f9-5b29a0a1045f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a820fdf6e2b4c989ffb2dd1aac7b686'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:26.733876 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1174/2320] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:21:26 2022] DELETE /identity/v3/users/4a820fdf6e2b4c989ffb2dd1aac7b686 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:21:27.138053 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d60bb4-bb6c-4b36-a93f-c2f0252ca598 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:27.139983 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-88d60bb4-bb6c-4b36-a93f-c2f0252ca598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:27.153676 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d60bb4-bb6c-4b36-a93f-c2f0252ca598 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:27.225618 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757ab28-d3b1-4b78-8109-a8708aa44117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:27.225618 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757ab28-d3b1-4b78-8109-a8708aa44117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:27.225618 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757ab28-d3b1-4b78-8109-a8708aa44117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:27.225618 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757ab28-d3b1-4b78-8109-a8708aa44117 admin admin] PATH_INFO: `/v3/projects/5374c2da70494b5fa3d31271826f1c97` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:27.225917 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757ab28-d3b1-4b78-8109-a8708aa44117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5374c2da70494b5fa3d31271826f1c97)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:27.230574 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757ab28-d3b1-4b78-8109-a8708aa44117 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:27.349295 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e757ab28-d3b1-4b78-8109-a8708aa44117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5374c2da70494b5fa3d31271826f1c97', 'request_id': 'req-e757ab28-d3b1-4b78-8109-a8708aa44117'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:27.436933 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e757ab28-d3b1-4b78-8109-a8708aa44117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5374c2da70494b5fa3d31271826f1c97', 'request_id': 'req-e757ab28-d3b1-4b78-8109-a8708aa44117'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:27.443490 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e757ab28-d3b1-4b78-8109-a8708aa44117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5374c2da70494b5fa3d31271826f1c97', 'request_id': 'req-e757ab28-d3b1-4b78-8109-a8708aa44117'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:27.454904 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e757ab28-d3b1-4b78-8109-a8708aa44117 admin admin] The token cache is being invalidate because project 5374c2da70494b5fa3d31271826f1c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:21:27.455183 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e757ab28-d3b1-4b78-8109-a8708aa44117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:27.455828 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e757ab28-d3b1-4b78-8109-a8708aa44117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:27.457396 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1147/2321] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:21:27 2022] DELETE /identity/v3/projects/5374c2da70494b5fa3d31271826f1c97 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:21:27.462249 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3676a-c3cb-45a9-938e-30c710a11452 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:27.462744 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3676a-c3cb-45a9-938e-30c710a11452 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:27.462852 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3676a-c3cb-45a9-938e-30c710a11452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:27.491131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-f4a3676a-c3cb-45a9-938e-30c710a11452 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:27.492243 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f4a3676a-c3cb-45a9-938e-30c710a11452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:27.550076 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1175/2322] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:21:27.558099 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617a5cd-d44c-4b2e-96b8-b2f00f9a1324 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:27.558389 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617a5cd-d44c-4b2e-96b8-b2f00f9a1324 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:27.558670 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617a5cd-d44c-4b2e-96b8-b2f00f9a1324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:27.576844 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-7617a5cd-d44c-4b2e-96b8-b2f00f9a1324 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:27.578093 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7617a5cd-d44c-4b2e-96b8-b2f00f9a1324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:27.586186 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1148/2323] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:21:27.590263 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3676a-c3cb-45a9-938e-30c710a11452 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:27.600380 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3676a-c3cb-45a9-938e-30c710a11452 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:27.604923 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0daa4c-019b-4e2e-86a7-a47624265a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:27.605569 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0daa4c-019b-4e2e-86a7-a47624265a1f admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:27.605855 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0daa4c-019b-4e2e-86a7-a47624265a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:27.606128 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0daa4c-019b-4e2e-86a7-a47624265a1f admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:27.606842 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0daa4c-019b-4e2e-86a7-a47624265a1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:21:27.607147 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0daa4c-019b-4e2e-86a7-a47624265a1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:27.609055 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0daa4c-019b-4e2e-86a7-a47624265a1f admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:27.621126 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1176/2324] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:21:27.625415 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617a5cd-d44c-4b2e-96b8-b2f00f9a1324 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:27.634514 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617a5cd-d44c-4b2e-96b8-b2f00f9a1324 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:27.639203 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b6ca6-5568-40a3-9979-08ab3c31f9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:27.639856 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b6ca6-5568-40a3-9979-08ab3c31f9bb admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:27.640141 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b6ca6-5568-40a3-9979-08ab3c31f9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:27.640952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b6ca6-5568-40a3-9979-08ab3c31f9bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:27.641649 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b6ca6-5568-40a3-9979-08ab3c31f9bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:27.643561 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b6ca6-5568-40a3-9979-08ab3c31f9bb admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:27.720700 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1149/2325] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:21:27 2022] POST /identity/v3/projects => generated 407 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:21:27.723791 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0daa4c-019b-4e2e-86a7-a47624265a1f admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:27.734110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0daa4c-019b-4e2e-86a7-a47624265a1f admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:27.790009 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087ae45-74d7-4252-a32a-7ca6f142de71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:27.790683 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087ae45-74d7-4252-a32a-7ca6f142de71 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:27.790970 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087ae45-74d7-4252-a32a-7ca6f142de71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:27.791255 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087ae45-74d7-4252-a32a-7ca6f142de71 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:27.791934 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087ae45-74d7-4252-a32a-7ca6f142de71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:27.793883 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087ae45-74d7-4252-a32a-7ca6f142de71 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:27.907683 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1177/2326] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:21:27 2022] POST /identity/v3/users => generated 304 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:21:27.909015 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b6ca6-5568-40a3-9979-08ab3c31f9bb admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:27.919574 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b6ca6-5568-40a3-9979-08ab3c31f9bb admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:27.931897 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bf88e-2503-4cea-a5f9-903f5a7fcb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:27.931897 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bf88e-2503-4cea-a5f9-903f5a7fcb62 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:27.931897 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bf88e-2503-4cea-a5f9-903f5a7fcb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:27.931897 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bf88e-2503-4cea-a5f9-903f5a7fcb62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:27.932267 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bf88e-2503-4cea-a5f9-903f5a7fcb62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:27.932267 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bf88e-2503-4cea-a5f9-903f5a7fcb62 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:27.939695 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1150/2327] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:21:27.943635 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087ae45-74d7-4252-a32a-7ca6f142de71 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:27.953691 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087ae45-74d7-4252-a32a-7ca6f142de71 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:27.958463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d2c4b-178c-44df-9300-5a8953b45502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:27.959121 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d2c4b-178c-44df-9300-5a8953b45502 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:27.959400 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d2c4b-178c-44df-9300-5a8953b45502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:27.959670 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d2c4b-178c-44df-9300-5a8953b45502 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:27.960394 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d2c4b-178c-44df-9300-5a8953b45502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:27.962033 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d2c4b-178c-44df-9300-5a8953b45502 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:27.972163 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1178/2328] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:21:27.976286 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bf88e-2503-4cea-a5f9-903f5a7fcb62 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:27.986862 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bf88e-2503-4cea-a5f9-903f5a7fcb62 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:27.991388 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb60848-3f94-4d38-8af5-7e5bb3836d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:27.992257 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb60848-3f94-4d38-8af5-7e5bb3836d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:27.992541 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb60848-3f94-4d38-8af5-7e5bb3836d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:27.992859 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb60848-3f94-4d38-8af5-7e5bb3836d26 admin admin] PATH_INFO: `/v3/projects/c77821bb3b1e4df3a0912ce46370477d/users/94f71df9742943a2b06f384803b1cf20/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:28.007550 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb60848-3f94-4d38-8af5-7e5bb3836d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77821bb3b1e4df3a0912ce46370477d, user_id=94f71df9742943a2b06f384803b1cf20, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:28.010303 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb60848-3f94-4d38-8af5-7e5bb3836d26 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:28.094333 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1151/2329] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:21:27 2022] PUT /identity/v3/projects/c77821bb3b1e4df3a0912ce46370477d/users/94f71df9742943a2b06f384803b1cf20/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:21:28.105134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088e850-dab8-4b37-9eec-62171a766bbe None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:28.105438 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088e850-dab8-4b37-9eec-62171a766bbe None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:28.105717 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088e850-dab8-4b37-9eec-62171a766bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:28.134525 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-3088e850-dab8-4b37-9eec-62171a766bbe None None] MFA Rules not processed for user `94f71df9742943a2b06f384803b1cf20`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:28.135764 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-3088e850-dab8-4b37-9eec-62171a766bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:28.204364 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1179/2330] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:28 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:21:28.208966 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb60848-3f94-4d38-8af5-7e5bb3836d26 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:28.276260 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb60848-3f94-4d38-8af5-7e5bb3836d26 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:28.282350 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da35d8c-c4bb-4bb9-b512-5f4ab4376630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:28.283007 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da35d8c-c4bb-4bb9-b512-5f4ab4376630 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:28.283539 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da35d8c-c4bb-4bb9-b512-5f4ab4376630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:28.283973 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da35d8c-c4bb-4bb9-b512-5f4ab4376630 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:28.284856 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da35d8c-c4bb-4bb9-b512-5f4ab4376630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:28.286792 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da35d8c-c4bb-4bb9-b512-5f4ab4376630 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:28.413455 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1152/2331] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:21:28 2022] POST /identity/v3/projects => generated 409 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:21:28.418479 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088e850-dab8-4b37-9eec-62171a766bbe None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:28.431874 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088e850-dab8-4b37-9eec-62171a766bbe None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:28.505893 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6af5e8-0159-4a0e-9a22-274f023039e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:28.506575 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6af5e8-0159-4a0e-9a22-274f023039e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:28.506859 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6af5e8-0159-4a0e-9a22-274f023039e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:28.507128 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6af5e8-0159-4a0e-9a22-274f023039e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:28.507828 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6af5e8-0159-4a0e-9a22-274f023039e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:28.509805 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6af5e8-0159-4a0e-9a22-274f023039e8 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:28.635894 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1180/2332] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:21:28 2022] POST /identity/v3/users => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:21:28.639829 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da35d8c-c4bb-4bb9-b512-5f4ab4376630 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:28.650467 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da35d8c-c4bb-4bb9-b512-5f4ab4376630 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:28.655008 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76e03c-951c-4771-a25a-440fed297d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:28.655649 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76e03c-951c-4771-a25a-440fed297d25 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:28.655930 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76e03c-951c-4771-a25a-440fed297d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:28.656953 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76e03c-951c-4771-a25a-440fed297d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:28.657943 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76e03c-951c-4771-a25a-440fed297d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:28.659564 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76e03c-951c-4771-a25a-440fed297d25 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:28.669755 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1153/2333] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:21:28.673853 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6af5e8-0159-4a0e-9a22-274f023039e8 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:28.683569 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6af5e8-0159-4a0e-9a22-274f023039e8 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:28.688081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da924d-49b8-4c42-a852-aa9d8150e188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:28.688977 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da924d-49b8-4c42-a852-aa9d8150e188 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:28.689255 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da924d-49b8-4c42-a852-aa9d8150e188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:28.689526 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da924d-49b8-4c42-a852-aa9d8150e188 admin admin] PATH_INFO: `/v3/projects/abe6d22c50cf4235ae8e95526ab597c7/users/bbc81f49ee25481d9c52514803b6c976/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:28.704547 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da924d-49b8-4c42-a852-aa9d8150e188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe6d22c50cf4235ae8e95526ab597c7, user_id=bbc81f49ee25481d9c52514803b6c976, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:28.707268 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da924d-49b8-4c42-a852-aa9d8150e188 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:28.769173 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1181/2334] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:21:28 2022] PUT /identity/v3/projects/abe6d22c50cf4235ae8e95526ab597c7/users/bbc81f49ee25481d9c52514803b6c976/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:21:28.773111 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76e03c-951c-4771-a25a-440fed297d25 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:28.783371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76e03c-951c-4771-a25a-440fed297d25 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:28.836700 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54d793-956d-4d84-8d7a-b2144a800583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:28.837287 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54d793-956d-4d84-8d7a-b2144a800583 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:28.837567 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54d793-956d-4d84-8d7a-b2144a800583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:28.837838 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54d793-956d-4d84-8d7a-b2144a800583 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:28.838564 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54d793-956d-4d84-8d7a-b2144a800583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:28.840151 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54d793-956d-4d84-8d7a-b2144a800583 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:28.853065 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1154/2335] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:21:28.857417 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da924d-49b8-4c42-a852-aa9d8150e188 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:28.864683 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da924d-49b8-4c42-a852-aa9d8150e188 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:28.869507 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024b40e-ca34-422e-9ea6-f2f922d30521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:28.870384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024b40e-ca34-422e-9ea6-f2f922d30521 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:28.870669 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024b40e-ca34-422e-9ea6-f2f922d30521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:28.870947 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024b40e-ca34-422e-9ea6-f2f922d30521 admin admin] PATH_INFO: `/v3/projects/abe6d22c50cf4235ae8e95526ab597c7/users/bbc81f49ee25481d9c52514803b6c976/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:28.873104 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024b40e-ca34-422e-9ea6-f2f922d30521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe6d22c50cf4235ae8e95526ab597c7, user_id=bbc81f49ee25481d9c52514803b6c976, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:28.877555 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024b40e-ca34-422e-9ea6-f2f922d30521 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:28.889753 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1182/2336] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:21:28 2022] PUT /identity/v3/projects/abe6d22c50cf4235ae8e95526ab597c7/users/bbc81f49ee25481d9c52514803b6c976/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:21:28.901701 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ff718-ef70-4c25-94c0-82b7e8165fb5 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:28.901992 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ff718-ef70-4c25-94c0-82b7e8165fb5 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:28.902272 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ff718-ef70-4c25-94c0-82b7e8165fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:28.929366 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-3b6ff718-ef70-4c25-94c0-82b7e8165fb5 None None] MFA Rules not processed for user `bbc81f49ee25481d9c52514803b6c976`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:28.930633 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-3b6ff718-ef70-4c25-94c0-82b7e8165fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:29.014127 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1155/2337] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:28 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:21:29.031750 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024b40e-ca34-422e-9ea6-f2f922d30521 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:29.033927 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b024b40e-ca34-422e-9ea6-f2f922d30521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:29.094166 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024b40e-ca34-422e-9ea6-f2f922d30521 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:29.097659 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f962f-8fde-4f01-8947-7ca94cf767f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:29.098365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f962f-8fde-4f01-8947-7ca94cf767f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:29.098653 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f962f-8fde-4f01-8947-7ca94cf767f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:29.098925 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f962f-8fde-4f01-8947-7ca94cf767f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:29.108051 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f962f-8fde-4f01-8947-7ca94cf767f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:29.109934 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f962f-8fde-4f01-8947-7ca94cf767f3 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:29.120827 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1183/2338] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:21:29 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:21:29.316405 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee7adb-4f2a-4a69-9994-905cd30561c9 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:29.317309 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee7adb-4f2a-4a69-9994-905cd30561c9 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:29.317728 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee7adb-4f2a-4a69-9994-905cd30561c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:29.349687 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-03ee7adb-4f2a-4a69-9994-905cd30561c9 None None] MFA Rules not processed for user `556058de7b9f48b8a10188ec64496e72`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:29.351842 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-03ee7adb-4f2a-4a69-9994-905cd30561c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:29.422952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1156/2339] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 13:21:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:21:29.466410 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f962f-8fde-4f01-8947-7ca94cf767f3 service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:29.468801 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee7adb-4f2a-4a69-9994-905cd30561c9 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:29.470630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-03ee7adb-4f2a-4a69-9994-905cd30561c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:29.476135 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f962f-8fde-4f01-8947-7ca94cf767f3 service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:29.481356 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c32558-c42f-4b19-b310-99f90b2452d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:29.482128 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c32558-c42f-4b19-b310-99f90b2452d5 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:29.482475 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c32558-c42f-4b19-b310-99f90b2452d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:29.482866 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c32558-c42f-4b19-b310-99f90b2452d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:29.545331 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c32558-c42f-4b19-b310-99f90b2452d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:29.547579 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c32558-c42f-4b19-b310-99f90b2452d5 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:29.552545 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee7adb-4f2a-4a69-9994-905cd30561c9 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:29.558513 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f670d7c-7068-4b03-a3b9-1ed87694d432 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f375d86747d248fa95f487b073d92d83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:29.559741 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1184/2340] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:21:29 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:21:29.561944 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f670d7c-7068-4b03-a3b9-1ed87694d432 service swift] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:29.562234 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f670d7c-7068-4b03-a3b9-1ed87694d432 service swift] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:29.563076 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f670d7c-7068-4b03-a3b9-1ed87694d432 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:29.572381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f670d7c-7068-4b03-a3b9-1ed87694d432 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:29.574030 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f670d7c-7068-4b03-a3b9-1ed87694d432 service swift] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:29.582664 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1157/2341] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 13:21:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 08 13:21:31.486049 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d5ee8-d74e-4f5f-9feb-5fa0d60b5065 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:31.486603 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d5ee8-d74e-4f5f-9feb-5fa0d60b5065 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:31.486846 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d5ee8-d74e-4f5f-9feb-5fa0d60b5065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:31.512971 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-e21d5ee8-d74e-4f5f-9feb-5fa0d60b5065 None None] MFA Rules not processed for user `f98c597d9e1a45e7bd8267b730a0b84b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:31.514260 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e21d5ee8-d74e-4f5f-9feb-5fa0d60b5065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:31.613086 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1185/2342] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:21:35.962026 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f670d7c-7068-4b03-a3b9-1ed87694d432 service swift] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:35.964093 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6f670d7c-7068-4b03-a3b9-1ed87694d432 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:36.039109 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f670d7c-7068-4b03-a3b9-1ed87694d432 service swift] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:36.047576 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00917a85-794b-46cd-83dd-9ac2f643c86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:36.047576 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00917a85-794b-46cd-83dd-9ac2f643c86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:36.047576 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00917a85-794b-46cd-83dd-9ac2f643c86b admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:36.047576 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00917a85-794b-46cd-83dd-9ac2f643c86b admin admin] PATH_INFO: `/v3/users/d2140727281842c6b66fc805fedc491b` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:36.048157 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00917a85-794b-46cd-83dd-9ac2f643c86b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2140727281842c6b66fc805fedc491b)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:36.050081 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00917a85-794b-46cd-83dd-9ac2f643c86b admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:36.323295 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-00917a85-794b-46cd-83dd-9ac2f643c86b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2140727281842c6b66fc805fedc491b'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:36.349567 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-00917a85-794b-46cd-83dd-9ac2f643c86b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2140727281842c6b66fc805fedc491b'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:36.349567 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-00917a85-794b-46cd-83dd-9ac2f643c86b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2140727281842c6b66fc805fedc491b'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:36.425523 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-00917a85-794b-46cd-83dd-9ac2f643c86b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2140727281842c6b66fc805fedc491b'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:36.426879 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-00917a85-794b-46cd-83dd-9ac2f643c86b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2140727281842c6b66fc805fedc491b'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:36.455879 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1158/2343] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:21:35 2022] DELETE /identity/v3/users/d2140727281842c6b66fc805fedc491b => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:21:36.460698 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a96d5-2a49-4f3f-b76d-f551dbfcd9c6 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:36.461216 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a96d5-2a49-4f3f-b76d-f551dbfcd9c6 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:36.461216 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a96d5-2a49-4f3f-b76d-f551dbfcd9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:36.504453 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-c77a96d5-2a49-4f3f-b76d-f551dbfcd9c6 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:36.505764 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-c77a96d5-2a49-4f3f-b76d-f551dbfcd9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:36.671184 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1186/2344] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:21:36.696783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00917a85-794b-46cd-83dd-9ac2f643c86b admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:36.698408 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-00917a85-794b-46cd-83dd-9ac2f643c86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:36.824524 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00917a85-794b-46cd-83dd-9ac2f643c86b admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:36.834629 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d70c4-83de-4f71-bcd4-421833a8357f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:36.835658 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d70c4-83de-4f71-bcd4-421833a8357f service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:36.836085 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d70c4-83de-4f71-bcd4-421833a8357f service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:36.836471 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d70c4-83de-4f71-bcd4-421833a8357f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:36.864856 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d70c4-83de-4f71-bcd4-421833a8357f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:36.864856 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d70c4-83de-4f71-bcd4-421833a8357f service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:36.870947 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1159/2345] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:21:38.085944 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a96d5-2a49-4f3f-b76d-f551dbfcd9c6 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:38.087251 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-c77a96d5-2a49-4f3f-b76d-f551dbfcd9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:38.099893 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a96d5-2a49-4f3f-b76d-f551dbfcd9c6 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:38.106187 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99581953-67d5-40fa-803a-e7df35b97fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:38.107299 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99581953-67d5-40fa-803a-e7df35b97fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:38.107746 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99581953-67d5-40fa-803a-e7df35b97fce admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:38.108191 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99581953-67d5-40fa-803a-e7df35b97fce admin admin] PATH_INFO: `/v3/projects/0e909a6a2c5b4d35a7e4364221c669a4` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:38.110881 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99581953-67d5-40fa-803a-e7df35b97fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e909a6a2c5b4d35a7e4364221c669a4)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:38.113951 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99581953-67d5-40fa-803a-e7df35b97fce admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:38.234766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-99581953-67d5-40fa-803a-e7df35b97fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e909a6a2c5b4d35a7e4364221c669a4', 'request_id': 'req-99581953-67d5-40fa-803a-e7df35b97fce'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:38.243665 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-99581953-67d5-40fa-803a-e7df35b97fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e909a6a2c5b4d35a7e4364221c669a4', 'request_id': 'req-99581953-67d5-40fa-803a-e7df35b97fce'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:38.259613 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-99581953-67d5-40fa-803a-e7df35b97fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e909a6a2c5b4d35a7e4364221c669a4', 'request_id': 'req-99581953-67d5-40fa-803a-e7df35b97fce'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:38.410081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-99581953-67d5-40fa-803a-e7df35b97fce admin admin] The token cache is being invalidate because project 0e909a6a2c5b4d35a7e4364221c669a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:21:38.412189 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-99581953-67d5-40fa-803a-e7df35b97fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:38.412189 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-99581953-67d5-40fa-803a-e7df35b97fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:38.413912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1187/2346] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:21:38 2022] DELETE /identity/v3/projects/0e909a6a2c5b4d35a7e4364221c669a4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:21:38.419682 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40037b16-4dfe-4ca5-81b8-f5c43b782469 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:38.419682 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40037b16-4dfe-4ca5-81b8-f5c43b782469 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:38.420711 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40037b16-4dfe-4ca5-81b8-f5c43b782469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:38.444008 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-40037b16-4dfe-4ca5-81b8-f5c43b782469 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:38.448832 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-40037b16-4dfe-4ca5-81b8-f5c43b782469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:38.601312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97861ff0-339e-4145-b253-4a55fe269aac None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:38.601602 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97861ff0-339e-4145-b253-4a55fe269aac None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:38.603000 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97861ff0-339e-4145-b253-4a55fe269aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:38.613503 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1160/2347] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:21:38.638392 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-97861ff0-339e-4145-b253-4a55fe269aac None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:38.639384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-97861ff0-339e-4145-b253-4a55fe269aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:38.653339 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1188/2348] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:21:38.660012 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40037b16-4dfe-4ca5-81b8-f5c43b782469 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:38.672649 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40037b16-4dfe-4ca5-81b8-f5c43b782469 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:38.680903 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fd7a7-063c-4286-a446-2eea0574e9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:38.682070 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fd7a7-063c-4286-a446-2eea0574e9bb admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:38.682361 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fd7a7-063c-4286-a446-2eea0574e9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:38.682708 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fd7a7-063c-4286-a446-2eea0574e9bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:38.683441 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9fd7a7-063c-4286-a446-2eea0574e9bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:21:38.683754 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9fd7a7-063c-4286-a446-2eea0574e9bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:38.685468 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9fd7a7-063c-4286-a446-2eea0574e9bb admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:38.704023 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1161/2349] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:21:38.705311 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97861ff0-339e-4145-b253-4a55fe269aac None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:38.716154 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97861ff0-339e-4145-b253-4a55fe269aac None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:38.721912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f8696-03c2-4504-b7ee-6b265a2acd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:38.722681 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f8696-03c2-4504-b7ee-6b265a2acd50 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:38.722967 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f8696-03c2-4504-b7ee-6b265a2acd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:38.723434 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f8696-03c2-4504-b7ee-6b265a2acd50 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:38.724329 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f8696-03c2-4504-b7ee-6b265a2acd50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:38.726420 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f8696-03c2-4504-b7ee-6b265a2acd50 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:38.857527 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fd7a7-063c-4286-a446-2eea0574e9bb admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:38.868770 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1189/2350] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:21:38 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:21:38.874122 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fd7a7-063c-4286-a446-2eea0574e9bb admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:39.022932 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9437eef-a1e5-4e5f-86c1-6ea2c4fae50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:39.023624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9437eef-a1e5-4e5f-86c1-6ea2c4fae50e admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:39.023912 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9437eef-a1e5-4e5f-86c1-6ea2c4fae50e admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:39.024195 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9437eef-a1e5-4e5f-86c1-6ea2c4fae50e admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:39.025153 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9437eef-a1e5-4e5f-86c1-6ea2c4fae50e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:39.027227 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9437eef-a1e5-4e5f-86c1-6ea2c4fae50e admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:39.160871 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1162/2351] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:21:38 2022] POST /identity/v3/users => generated 288 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:21:39.162860 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f8696-03c2-4504-b7ee-6b265a2acd50 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:39.178572 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f8696-03c2-4504-b7ee-6b265a2acd50 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:39.184741 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79c656-9eb7-492f-b694-f491d7e1f32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:39.186307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79c656-9eb7-492f-b694-f491d7e1f32c admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:39.186902 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79c656-9eb7-492f-b694-f491d7e1f32c admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:39.187362 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79c656-9eb7-492f-b694-f491d7e1f32c admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:39.189558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79c656-9eb7-492f-b694-f491d7e1f32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:39.191365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79c656-9eb7-492f-b694-f491d7e1f32c admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:39.213071 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9437eef-a1e5-4e5f-86c1-6ea2c4fae50e admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:39.213428 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1190/2352] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:21:39.228073 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9437eef-a1e5-4e5f-86c1-6ea2c4fae50e admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:39.244768 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18257b-3df3-4e85-b61d-b4e2148c58e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:39.247141 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18257b-3df3-4e85-b61d-b4e2148c58e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:39.247607 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18257b-3df3-4e85-b61d-b4e2148c58e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:39.249279 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18257b-3df3-4e85-b61d-b4e2148c58e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:39.249279 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18257b-3df3-4e85-b61d-b4e2148c58e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:39.250704 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18257b-3df3-4e85-b61d-b4e2148c58e1 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:39.270619 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1163/2353] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:21:39.271823 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79c656-9eb7-492f-b694-f491d7e1f32c admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:39.291414 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79c656-9eb7-492f-b694-f491d7e1f32c admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:39.300600 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc4a00-0068-494d-9d87-1aaa6a2d8ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:39.302003 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc4a00-0068-494d-9d87-1aaa6a2d8ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:39.302548 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc4a00-0068-494d-9d87-1aaa6a2d8ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:39.303043 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc4a00-0068-494d-9d87-1aaa6a2d8ac7 admin admin] PATH_INFO: `/v3/projects/6d3ba160ad2b455fb1c10adf23c23040/users/b524bd502e2e4e38937db3c691e21a2c/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:39.321528 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc4a00-0068-494d-9d87-1aaa6a2d8ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3ba160ad2b455fb1c10adf23c23040, user_id=b524bd502e2e4e38937db3c691e21a2c, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:39.324628 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc4a00-0068-494d-9d87-1aaa6a2d8ac7 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:39.398881 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1191/2354] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:21:39 2022] PUT /identity/v3/projects/6d3ba160ad2b455fb1c10adf23c23040/users/b524bd502e2e4e38937db3c691e21a2c/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:21:39.409326 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cbad6-7e6e-4e2f-91ae-bc218b16500a None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:39.409645 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cbad6-7e6e-4e2f-91ae-bc218b16500a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:39.409896 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cbad6-7e6e-4e2f-91ae-bc218b16500a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:39.482959 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-894cbad6-7e6e-4e2f-91ae-bc218b16500a None None] MFA Rules not processed for user `b524bd502e2e4e38937db3c691e21a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:39.482959 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-894cbad6-7e6e-4e2f-91ae-bc218b16500a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:39.640056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1164/2355] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:21:39.657399 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc4a00-0068-494d-9d87-1aaa6a2d8ac7 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:39.660201 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e2fc4a00-0068-494d-9d87-1aaa6a2d8ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:39.815222 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc4a00-0068-494d-9d87-1aaa6a2d8ac7 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:39.819510 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa927acd-7f0d-4f2c-a99e-dded79e48c6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:39.820356 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa927acd-7f0d-4f2c-a99e-dded79e48c6f service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:39.820828 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa927acd-7f0d-4f2c-a99e-dded79e48c6f service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:39.821104 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa927acd-7f0d-4f2c-a99e-dded79e48c6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:39.846987 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa927acd-7f0d-4f2c-a99e-dded79e48c6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:39.859039 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa927acd-7f0d-4f2c-a99e-dded79e48c6f service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:39.888973 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1192/2356] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:21:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:21:40.939689 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cbad6-7e6e-4e2f-91ae-bc218b16500a None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:40.942010 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-894cbad6-7e6e-4e2f-91ae-bc218b16500a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:41.057571 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cbad6-7e6e-4e2f-91ae-bc218b16500a None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:41.066322 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcdf90-812b-4e2e-a44c-36e05d3b8584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:41.068390 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcdf90-812b-4e2e-a44c-36e05d3b8584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:41.069250 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcdf90-812b-4e2e-a44c-36e05d3b8584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:41.069726 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcdf90-812b-4e2e-a44c-36e05d3b8584 admin admin] PATH_INFO: `/v3/users/94f71df9742943a2b06f384803b1cf20` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:41.071796 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcdf90-812b-4e2e-a44c-36e05d3b8584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f71df9742943a2b06f384803b1cf20)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:41.075725 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcdf90-812b-4e2e-a44c-36e05d3b8584 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:41.279282 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4dbcdf90-812b-4e2e-a44c-36e05d3b8584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f71df9742943a2b06f384803b1cf20'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:41.294751 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4dbcdf90-812b-4e2e-a44c-36e05d3b8584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f71df9742943a2b06f384803b1cf20'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:41.295493 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4dbcdf90-812b-4e2e-a44c-36e05d3b8584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f71df9742943a2b06f384803b1cf20'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:41.409868 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4dbcdf90-812b-4e2e-a44c-36e05d3b8584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f71df9742943a2b06f384803b1cf20'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:41.410911 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-4dbcdf90-812b-4e2e-a44c-36e05d3b8584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f71df9742943a2b06f384803b1cf20'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:41.430550 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1165/2357] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:21:40 2022] DELETE /identity/v3/users/94f71df9742943a2b06f384803b1cf20 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:21:41.435242 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80b08f-bf40-4346-a107-175253211e89 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:41.435792 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80b08f-bf40-4346-a107-175253211e89 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:41.436204 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80b08f-bf40-4346-a107-175253211e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:41.475946 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-9a80b08f-bf40-4346-a107-175253211e89 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:41.477213 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9a80b08f-bf40-4346-a107-175253211e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:41.618871 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1193/2358] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:21:41.619151 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcdf90-812b-4e2e-a44c-36e05d3b8584 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:41.619151 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-4dbcdf90-812b-4e2e-a44c-36e05d3b8584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:41.787227 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcdf90-812b-4e2e-a44c-36e05d3b8584 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:41.792049 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67965dba-6d7a-4823-a573-2a2bd03adf52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:41.792853 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67965dba-6d7a-4823-a573-2a2bd03adf52 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:41.793403 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67965dba-6d7a-4823-a573-2a2bd03adf52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:41.793743 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67965dba-6d7a-4823-a573-2a2bd03adf52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:41.810302 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67965dba-6d7a-4823-a573-2a2bd03adf52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:41.812009 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67965dba-6d7a-4823-a573-2a2bd03adf52 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:41.835056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1166/2359] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:21:41.838347 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c6542-2b6c-4fc6-b954-10e2c576f703 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:41.838635 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c6542-2b6c-4fc6-b954-10e2c576f703 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:41.838909 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c6542-2b6c-4fc6-b954-10e2c576f703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:41.870796 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-497c6542-2b6c-4fc6-b954-10e2c576f703 None None] MFA Rules not processed for user `b524bd502e2e4e38937db3c691e21a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:41.872374 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-497c6542-2b6c-4fc6-b954-10e2c576f703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:41.967433 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1194/2360] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:21:42.932128 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67965dba-6d7a-4823-a573-2a2bd03adf52 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:42.937992 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-67965dba-6d7a-4823-a573-2a2bd03adf52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:42.966887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67965dba-6d7a-4823-a573-2a2bd03adf52 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:42.973080 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a38a7-4bb3-4e4f-8cf8-7bf5509b37b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:42.974158 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a38a7-4bb3-4e4f-8cf8-7bf5509b37b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:42.974685 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a38a7-4bb3-4e4f-8cf8-7bf5509b37b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:42.975277 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a38a7-4bb3-4e4f-8cf8-7bf5509b37b4 admin admin] PATH_INFO: `/v3/projects/c77821bb3b1e4df3a0912ce46370477d` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:42.978253 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a38a7-4bb3-4e4f-8cf8-7bf5509b37b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c77821bb3b1e4df3a0912ce46370477d)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:42.980196 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a38a7-4bb3-4e4f-8cf8-7bf5509b37b4 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:43.193090 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-3c3a38a7-4bb3-4e4f-8cf8-7bf5509b37b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c77821bb3b1e4df3a0912ce46370477d', 'request_id': 'req-3c3a38a7-4bb3-4e4f-8cf8-7bf5509b37b4'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:43.547293 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-3c3a38a7-4bb3-4e4f-8cf8-7bf5509b37b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c77821bb3b1e4df3a0912ce46370477d', 'request_id': 'req-3c3a38a7-4bb3-4e4f-8cf8-7bf5509b37b4'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:43.554030 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-3c3a38a7-4bb3-4e4f-8cf8-7bf5509b37b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c77821bb3b1e4df3a0912ce46370477d', 'request_id': 'req-3c3a38a7-4bb3-4e4f-8cf8-7bf5509b37b4'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:43.567611 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-3c3a38a7-4bb3-4e4f-8cf8-7bf5509b37b4 admin admin] The token cache is being invalidate because project c77821bb3b1e4df3a0912ce46370477d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:21:43.567902 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-3c3a38a7-4bb3-4e4f-8cf8-7bf5509b37b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:43.568559 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-3c3a38a7-4bb3-4e4f-8cf8-7bf5509b37b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:43.574075 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1167/2361] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:21:42 2022] DELETE /identity/v3/projects/c77821bb3b1e4df3a0912ce46370477d => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:21:43.574412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c6542-2b6c-4fc6-b954-10e2c576f703 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:43.589159 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c6542-2b6c-4fc6-b954-10e2c576f703 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:43.645879 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e7d82-28d1-4004-94eb-85a5bc1ae118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:43.646755 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e7d82-28d1-4004-94eb-85a5bc1ae118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:43.647037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e7d82-28d1-4004-94eb-85a5bc1ae118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:43.647314 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e7d82-28d1-4004-94eb-85a5bc1ae118 admin admin] PATH_INFO: `/v3/users/bbc81f49ee25481d9c52514803b6c976` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:43.648646 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e7d82-28d1-4004-94eb-85a5bc1ae118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc81f49ee25481d9c52514803b6c976)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:43.650642 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e7d82-28d1-4004-94eb-85a5bc1ae118 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:43.899936 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a40e7d82-28d1-4004-94eb-85a5bc1ae118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc81f49ee25481d9c52514803b6c976'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:43.915612 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a40e7d82-28d1-4004-94eb-85a5bc1ae118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc81f49ee25481d9c52514803b6c976'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:43.916347 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a40e7d82-28d1-4004-94eb-85a5bc1ae118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc81f49ee25481d9c52514803b6c976'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:43.916968 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a40e7d82-28d1-4004-94eb-85a5bc1ae118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc81f49ee25481d9c52514803b6c976'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:43.924889 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a40e7d82-28d1-4004-94eb-85a5bc1ae118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc81f49ee25481d9c52514803b6c976'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:44.060432 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1195/2362] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:21:43 2022] DELETE /identity/v3/users/bbc81f49ee25481d9c52514803b6c976 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:21:44.693470 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a38a7-4bb3-4e4f-8cf8-7bf5509b37b4 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:44.698900 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-3c3a38a7-4bb3-4e4f-8cf8-7bf5509b37b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:44.713228 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a38a7-4bb3-4e4f-8cf8-7bf5509b37b4 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:44.787413 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e78f5-efae-481e-8857-2a40e423efca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:44.788436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e78f5-efae-481e-8857-2a40e423efca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:44.788766 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e78f5-efae-481e-8857-2a40e423efca admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:44.789088 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e78f5-efae-481e-8857-2a40e423efca admin admin] PATH_INFO: `/v3/projects/abe6d22c50cf4235ae8e95526ab597c7` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:44.790313 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e78f5-efae-481e-8857-2a40e423efca admin admin] RBAC: Authorizing `identity:delete_project(project_id=abe6d22c50cf4235ae8e95526ab597c7)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:44.794970 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e78f5-efae-481e-8857-2a40e423efca admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:44.977240 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e92e78f5-efae-481e-8857-2a40e423efca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abe6d22c50cf4235ae8e95526ab597c7', 'request_id': 'req-e92e78f5-efae-481e-8857-2a40e423efca'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:45.129444 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e92e78f5-efae-481e-8857-2a40e423efca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abe6d22c50cf4235ae8e95526ab597c7', 'request_id': 'req-e92e78f5-efae-481e-8857-2a40e423efca'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:45.141158 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e92e78f5-efae-481e-8857-2a40e423efca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abe6d22c50cf4235ae8e95526ab597c7', 'request_id': 'req-e92e78f5-efae-481e-8857-2a40e423efca'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:45.152777 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e92e78f5-efae-481e-8857-2a40e423efca admin admin] The token cache is being invalidate because project abe6d22c50cf4235ae8e95526ab597c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:21:45.153338 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e92e78f5-efae-481e-8857-2a40e423efca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:45.154326 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e92e78f5-efae-481e-8857-2a40e423efca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:21:45.156561 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1168/2363] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:21:44 2022] DELETE /identity/v3/projects/abe6d22c50cf4235ae8e95526ab597c7 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:21:45.161304 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346d604-1e10-4f3c-8efc-0ce4ee58b87b None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:45.161777 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346d604-1e10-4f3c-8efc-0ce4ee58b87b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:45.162081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346d604-1e10-4f3c-8efc-0ce4ee58b87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:45.187349 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-9346d604-1e10-4f3c-8efc-0ce4ee58b87b None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:45.188610 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9346d604-1e10-4f3c-8efc-0ce4ee58b87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:45.282693 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1196/2364] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:21:45.294319 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04776e-af03-4ea8-b297-d7c203d1f93b None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:45.294608 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04776e-af03-4ea8-b297-d7c203d1f93b None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:45.295013 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04776e-af03-4ea8-b297-d7c203d1f93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:45.315500 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-3f04776e-af03-4ea8-b297-d7c203d1f93b None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:45.317470 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-3f04776e-af03-4ea8-b297-d7c203d1f93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:45.331940 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1169/2365] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:21:45.336212 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346d604-1e10-4f3c-8efc-0ce4ee58b87b None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:45.359974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346d604-1e10-4f3c-8efc-0ce4ee58b87b None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:45.366722 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494402d3-cd42-4129-836f-ff8776963513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:45.367654 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494402d3-cd42-4129-836f-ff8776963513 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:45.368093 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494402d3-cd42-4129-836f-ff8776963513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:45.368519 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494402d3-cd42-4129-836f-ff8776963513 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:45.369446 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494402d3-cd42-4129-836f-ff8776963513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:21:45.369907 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494402d3-cd42-4129-836f-ff8776963513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:45.373109 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494402d3-cd42-4129-836f-ff8776963513 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:45.394061 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1197/2366] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:21:45.398572 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04776e-af03-4ea8-b297-d7c203d1f93b None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:45.409661 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04776e-af03-4ea8-b297-d7c203d1f93b None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:45.415830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6af318-75d8-4d85-a277-3e961b8af5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:45.416493 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6af318-75d8-4d85-a277-3e961b8af5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:45.421424 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6af318-75d8-4d85-a277-3e961b8af5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:45.421424 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6af318-75d8-4d85-a277-3e961b8af5c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:45.421424 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6af318-75d8-4d85-a277-3e961b8af5c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:45.421424 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6af318-75d8-4d85-a277-3e961b8af5c2 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:45.543137 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1170/2367] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:21:45 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:21:45.547488 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494402d3-cd42-4129-836f-ff8776963513 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:45.557385 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494402d3-cd42-4129-836f-ff8776963513 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:45.611594 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c4e52-372c-4cde-b4e0-cdfd61fe32bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:45.612636 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c4e52-372c-4cde-b4e0-cdfd61fe32bf admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:45.612946 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c4e52-372c-4cde-b4e0-cdfd61fe32bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:45.613223 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c4e52-372c-4cde-b4e0-cdfd61fe32bf admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:45.613912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c4e52-372c-4cde-b4e0-cdfd61fe32bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:45.615835 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c4e52-372c-4cde-b4e0-cdfd61fe32bf admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:45.698698 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1198/2368] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:21:45 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:21:45.699950 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6af318-75d8-4d85-a277-3e961b8af5c2 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:45.715907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6af318-75d8-4d85-a277-3e961b8af5c2 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:45.721143 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d666067-1e7f-4b14-bbc4-6ee539aef7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:45.721952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d666067-1e7f-4b14-bbc4-6ee539aef7bf admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:45.722450 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d666067-1e7f-4b14-bbc4-6ee539aef7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:45.722797 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d666067-1e7f-4b14-bbc4-6ee539aef7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:45.723601 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d666067-1e7f-4b14-bbc4-6ee539aef7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:45.725336 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d666067-1e7f-4b14-bbc4-6ee539aef7bf admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:45.739981 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1171/2369] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:21:45.741418 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c4e52-372c-4cde-b4e0-cdfd61fe32bf admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:45.752433 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c4e52-372c-4cde-b4e0-cdfd61fe32bf admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:45.757432 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba3ba8-38ad-408f-9a2c-d8cbba2f0fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:45.758277 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba3ba8-38ad-408f-9a2c-d8cbba2f0fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:45.758568 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba3ba8-38ad-408f-9a2c-d8cbba2f0fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:45.758870 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba3ba8-38ad-408f-9a2c-d8cbba2f0fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:45.759604 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba3ba8-38ad-408f-9a2c-d8cbba2f0fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:45.762132 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba3ba8-38ad-408f-9a2c-d8cbba2f0fb2 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:45.772793 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1199/2370] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:21:45.776852 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d666067-1e7f-4b14-bbc4-6ee539aef7bf admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:45.789065 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d666067-1e7f-4b14-bbc4-6ee539aef7bf admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:45.793907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce4e88-da0d-4662-a497-0088bda9a37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:45.794791 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce4e88-da0d-4662-a497-0088bda9a37e admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:45.795072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce4e88-da0d-4662-a497-0088bda9a37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:45.795346 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce4e88-da0d-4662-a497-0088bda9a37e admin admin] PATH_INFO: `/v3/projects/3921ba6950a340bf9fbd02fa6e913a0d/users/40b696c14dbc4065963262f05de1401f/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:45.810048 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce4e88-da0d-4662-a497-0088bda9a37e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3921ba6950a340bf9fbd02fa6e913a0d, user_id=40b696c14dbc4065963262f05de1401f, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:45.813834 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce4e88-da0d-4662-a497-0088bda9a37e admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:45.900905 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1172/2371] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:21:45 2022] PUT /identity/v3/projects/3921ba6950a340bf9fbd02fa6e913a0d/users/40b696c14dbc4065963262f05de1401f/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:21:45.912738 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19377bbf-029d-40c9-9e5c-f83b22872e0b None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:45.913033 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19377bbf-029d-40c9-9e5c-f83b22872e0b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:45.913312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19377bbf-029d-40c9-9e5c-f83b22872e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:45.939102 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-19377bbf-029d-40c9-9e5c-f83b22872e0b None None] MFA Rules not processed for user `40b696c14dbc4065963262f05de1401f`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:45.940324 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-19377bbf-029d-40c9-9e5c-f83b22872e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:46.004247 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1200/2372] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:21:46.013447 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce4e88-da0d-4662-a497-0088bda9a37e admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:46.078400 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce4e88-da0d-4662-a497-0088bda9a37e admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:46.083610 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a391903-c6b0-44f2-9bab-e8e4804e7716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:46.084286 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a391903-c6b0-44f2-9bab-e8e4804e7716 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:46.084567 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a391903-c6b0-44f2-9bab-e8e4804e7716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:46.084866 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a391903-c6b0-44f2-9bab-e8e4804e7716 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:46.085588 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a391903-c6b0-44f2-9bab-e8e4804e7716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:46.087624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a391903-c6b0-44f2-9bab-e8e4804e7716 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:46.150626 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1173/2373] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:21:46 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:21:46.155075 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19377bbf-029d-40c9-9e5c-f83b22872e0b None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:46.167701 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19377bbf-029d-40c9-9e5c-f83b22872e0b None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:46.237541 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171cd00-675e-4104-99fd-b369c8f10eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:46.238515 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171cd00-675e-4104-99fd-b369c8f10eee admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:46.239695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171cd00-675e-4104-99fd-b369c8f10eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:46.240256 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171cd00-675e-4104-99fd-b369c8f10eee admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:46.241200 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171cd00-675e-4104-99fd-b369c8f10eee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:46.243369 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171cd00-675e-4104-99fd-b369c8f10eee admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:46.353573 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1201/2374] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:21:46 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:21:46.357779 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a391903-c6b0-44f2-9bab-e8e4804e7716 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:46.369122 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a391903-c6b0-44f2-9bab-e8e4804e7716 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:46.374440 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ac335-a95d-4cc0-aedc-2acb46473e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:46.374639 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ac335-a95d-4cc0-aedc-2acb46473e4f admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:46.374918 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ac335-a95d-4cc0-aedc-2acb46473e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:46.375709 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ac335-a95d-4cc0-aedc-2acb46473e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:46.375927 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ac335-a95d-4cc0-aedc-2acb46473e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:46.378397 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ac335-a95d-4cc0-aedc-2acb46473e4f admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:46.407238 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1174/2375] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:21:46.408058 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171cd00-675e-4104-99fd-b369c8f10eee admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:46.419691 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171cd00-675e-4104-99fd-b369c8f10eee admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:46.426463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acdd0e-ccbd-46ce-b9a8-ea76d2617350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:46.427260 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acdd0e-ccbd-46ce-b9a8-ea76d2617350 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:46.427706 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acdd0e-ccbd-46ce-b9a8-ea76d2617350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:46.427990 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acdd0e-ccbd-46ce-b9a8-ea76d2617350 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:46.429205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acdd0e-ccbd-46ce-b9a8-ea76d2617350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:46.430815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acdd0e-ccbd-46ce-b9a8-ea76d2617350 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:46.442564 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1202/2376] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:21:46.447299 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ac335-a95d-4cc0-aedc-2acb46473e4f admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:46.463095 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ac335-a95d-4cc0-aedc-2acb46473e4f admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:46.468144 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6e393-da8c-4a34-82ae-77bc8ac2ea5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:46.469117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6e393-da8c-4a34-82ae-77bc8ac2ea5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:46.469406 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6e393-da8c-4a34-82ae-77bc8ac2ea5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:46.469687 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6e393-da8c-4a34-82ae-77bc8ac2ea5d admin admin] PATH_INFO: `/v3/projects/11e22be7f45b427fa389d5cc140cf41e/users/22e11fe3215e4fee80378e9219a7e15f/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:46.486636 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6e393-da8c-4a34-82ae-77bc8ac2ea5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=11e22be7f45b427fa389d5cc140cf41e, user_id=22e11fe3215e4fee80378e9219a7e15f, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:46.489133 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6e393-da8c-4a34-82ae-77bc8ac2ea5d admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:46.543721 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1175/2377] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:21:46 2022] PUT /identity/v3/projects/11e22be7f45b427fa389d5cc140cf41e/users/22e11fe3215e4fee80378e9219a7e15f/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:21:46.554842 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26234-a20d-4559-9fe7-28d48e04844b None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:46.555150 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26234-a20d-4559-9fe7-28d48e04844b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:46.555423 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26234-a20d-4559-9fe7-28d48e04844b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:46.590628 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-b3e26234-a20d-4559-9fe7-28d48e04844b None None] MFA Rules not processed for user `22e11fe3215e4fee80378e9219a7e15f`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:46.592118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b3e26234-a20d-4559-9fe7-28d48e04844b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:46.658251 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1203/2378] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:21:46.662841 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6e393-da8c-4a34-82ae-77bc8ac2ea5d admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:46.726977 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6e393-da8c-4a34-82ae-77bc8ac2ea5d admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:46.731628 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0260480-c14f-4795-ba73-6b8128d1ca7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:46.732282 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0260480-c14f-4795-ba73-6b8128d1ca7c admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:46.732562 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0260480-c14f-4795-ba73-6b8128d1ca7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:46.732867 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0260480-c14f-4795-ba73-6b8128d1ca7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:46.733568 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0260480-c14f-4795-ba73-6b8128d1ca7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:46.735647 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0260480-c14f-4795-ba73-6b8128d1ca7c admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:46.822923 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1176/2379] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:21:46 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:21:46.826776 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e26234-a20d-4559-9fe7-28d48e04844b None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:46.838183 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e26234-a20d-4559-9fe7-28d48e04844b None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:46.899746 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353a1cf-75b0-47a2-9f66-68e1b50043fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:46.900633 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353a1cf-75b0-47a2-9f66-68e1b50043fe admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:46.901070 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353a1cf-75b0-47a2-9f66-68e1b50043fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:46.901350 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353a1cf-75b0-47a2-9f66-68e1b50043fe admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:46.902164 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353a1cf-75b0-47a2-9f66-68e1b50043fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:46.904232 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353a1cf-75b0-47a2-9f66-68e1b50043fe admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:47.024197 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1204/2380] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:21:46 2022] POST /identity/v3/users => generated 298 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:21:47.025425 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0260480-c14f-4795-ba73-6b8128d1ca7c admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:47.036532 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0260480-c14f-4795-ba73-6b8128d1ca7c admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:47.041468 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4169d5-ddd0-4c9b-b6d4-b362cca4b5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:47.044668 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4169d5-ddd0-4c9b-b6d4-b362cca4b5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:47.044668 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4169d5-ddd0-4c9b-b6d4-b362cca4b5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:47.044668 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4169d5-ddd0-4c9b-b6d4-b362cca4b5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:47.044668 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4169d5-ddd0-4c9b-b6d4-b362cca4b5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:47.045273 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4169d5-ddd0-4c9b-b6d4-b362cca4b5d5 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:47.056858 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1177/2381] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:21:47.061195 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353a1cf-75b0-47a2-9f66-68e1b50043fe admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:47.071665 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353a1cf-75b0-47a2-9f66-68e1b50043fe admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:47.076668 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af9b31-fd94-4969-90c5-aaf473cff52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:47.077564 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af9b31-fd94-4969-90c5-aaf473cff52d admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:47.077840 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af9b31-fd94-4969-90c5-aaf473cff52d admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:47.078131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af9b31-fd94-4969-90c5-aaf473cff52d admin admin] PATH_INFO: `/v3/projects/828403bb1a3a4a65b1bbdd62f9fe668f/users/de0c157620054e81a6d9dc6ff25f6576/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:47.092857 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af9b31-fd94-4969-90c5-aaf473cff52d admin admin] RBAC: Authorizing `identity:create_grant(project_id=828403bb1a3a4a65b1bbdd62f9fe668f, user_id=de0c157620054e81a6d9dc6ff25f6576, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:47.096030 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af9b31-fd94-4969-90c5-aaf473cff52d admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:47.206266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1205/2382] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:21:47 2022] PUT /identity/v3/projects/828403bb1a3a4a65b1bbdd62f9fe668f/users/de0c157620054e81a6d9dc6ff25f6576/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:21:47.212454 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4169d5-ddd0-4c9b-b6d4-b362cca4b5d5 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:47.223932 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4169d5-ddd0-4c9b-b6d4-b362cca4b5d5 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:47.287216 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216e7f6-c5e8-4522-a2a0-c96ead5dd05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:47.287892 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216e7f6-c5e8-4522-a2a0-c96ead5dd05f admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:47.288175 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216e7f6-c5e8-4522-a2a0-c96ead5dd05f admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:47.288452 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216e7f6-c5e8-4522-a2a0-c96ead5dd05f admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:47.289893 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216e7f6-c5e8-4522-a2a0-c96ead5dd05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:47.291519 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216e7f6-c5e8-4522-a2a0-c96ead5dd05f admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:47.302987 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1178/2383] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:21:47.307376 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af9b31-fd94-4969-90c5-aaf473cff52d admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:47.319304 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af9b31-fd94-4969-90c5-aaf473cff52d admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:47.326504 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c1b31-3be8-4ff9-a2dc-f0dc9eb0e74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:47.327408 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c1b31-3be8-4ff9-a2dc-f0dc9eb0e74e admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:47.330036 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c1b31-3be8-4ff9-a2dc-f0dc9eb0e74e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:47.330036 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c1b31-3be8-4ff9-a2dc-f0dc9eb0e74e admin admin] PATH_INFO: `/v3/projects/828403bb1a3a4a65b1bbdd62f9fe668f/users/de0c157620054e81a6d9dc6ff25f6576/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:47.330036 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c1b31-3be8-4ff9-a2dc-f0dc9eb0e74e admin admin] RBAC: Authorizing `identity:create_grant(project_id=828403bb1a3a4a65b1bbdd62f9fe668f, user_id=de0c157620054e81a6d9dc6ff25f6576, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:47.332707 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c1b31-3be8-4ff9-a2dc-f0dc9eb0e74e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:47.359531 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1206/2384] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:21:47 2022] PUT /identity/v3/projects/828403bb1a3a4a65b1bbdd62f9fe668f/users/de0c157620054e81a6d9dc6ff25f6576/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:21:47.359625 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c72b3-fe90-4bc3-8700-9ecf91656fd1 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:47.359625 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c72b3-fe90-4bc3-8700-9ecf91656fd1 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:47.359625 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c72b3-fe90-4bc3-8700-9ecf91656fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:47.402450 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-2e6c72b3-fe90-4bc3-8700-9ecf91656fd1 None None] MFA Rules not processed for user `de0c157620054e81a6d9dc6ff25f6576`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:47.403782 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-2e6c72b3-fe90-4bc3-8700-9ecf91656fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:47.503573 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1179/2385] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:21:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:21:47.517576 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c1b31-3be8-4ff9-a2dc-f0dc9eb0e74e admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:47.519390 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-813c1b31-3be8-4ff9-a2dc-f0dc9eb0e74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:47.594999 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c1b31-3be8-4ff9-a2dc-f0dc9eb0e74e admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:47.603127 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999d6af-dc7b-4ed0-8856-f8b33f17af1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:47.603960 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999d6af-dc7b-4ed0-8856-f8b33f17af1a service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:47.604343 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999d6af-dc7b-4ed0-8856-f8b33f17af1a service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:47.604938 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999d6af-dc7b-4ed0-8856-f8b33f17af1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:47.677593 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999d6af-dc7b-4ed0-8856-f8b33f17af1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:47.679049 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999d6af-dc7b-4ed0-8856-f8b33f17af1a service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:47.696213 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1207/2386] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:21:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:21:49.927981 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8d355-8afa-4da1-86e7-e159c16b8940 None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:49.928578 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8d355-8afa-4da1-86e7-e159c16b8940 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:49.928578 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8d355-8afa-4da1-86e7-e159c16b8940 None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:49.930386 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1180/2387] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 13:21:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:21:49.936393 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8250ce5-e9be-4646-976b-4dab4dac517e None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:49.936913 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8250ce5-e9be-4646-976b-4dab4dac517e None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:49.937012 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8250ce5-e9be-4646-976b-4dab4dac517e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:49.985588 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-b8250ce5-e9be-4646-976b-4dab4dac517e None None] MFA Rules not processed for user `72d4ac44d04943a5b24c7a1d6a31b7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:49.989282 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b8250ce5-e9be-4646-976b-4dab4dac517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:50.066329 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1208/2388] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 13:21:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:21:50.077734 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8d355-8afa-4da1-86e7-e159c16b8940 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:50.079400 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-35d8d355-8afa-4da1-86e7-e159c16b8940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:50.157124 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8d355-8afa-4da1-86e7-e159c16b8940 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:50.161204 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5050bf-4684-476a-a87d-fca1f49b0d90 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81124c3324d7427a9f29270b88e88f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:50.166811 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5050bf-4684-476a-a87d-fca1f49b0d90 service glance] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:50.166811 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5050bf-4684-476a-a87d-fca1f49b0d90 service glance] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:50.166811 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5050bf-4684-476a-a87d-fca1f49b0d90 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:50.172783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5050bf-4684-476a-a87d-fca1f49b0d90 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:50.175100 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5050bf-4684-476a-a87d-fca1f49b0d90 service glance] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:50.186016 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1181/2389] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:21:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:21:50.389780 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0716bb9-07b4-489d-92a9-4b63fa359027 None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:50.390003 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0716bb9-07b4-489d-92a9-4b63fa359027 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:50.390280 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0716bb9-07b4-489d-92a9-4b63fa359027 None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:50.392134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1209/2390] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 13:21:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:21:50.396890 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755c9b-7422-463c-81b1-fc3ee00556cf None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:50.397180 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755c9b-7422-463c-81b1-fc3ee00556cf None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:50.397460 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755c9b-7422-463c-81b1-fc3ee00556cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:50.415077 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-66755c9b-7422-463c-81b1-fc3ee00556cf None None] MFA Rules not processed for user `22bf06400d8f47f4bb3badd7f65bc205`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:50.417861 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-66755c9b-7422-463c-81b1-fc3ee00556cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:50.467527 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1182/2391] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 13:21:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:21:50.484273 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0716bb9-07b4-489d-92a9-4b63fa359027 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:50.484273 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f0716bb9-07b4-489d-92a9-4b63fa359027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:50.495533 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0716bb9-07b4-489d-92a9-4b63fa359027 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:50.499130 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b318b5-fa31-4df5-abf0-e83e5730d2bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:50.499759 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b318b5-fa31-4df5-abf0-e83e5730d2bd service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:50.500037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b318b5-fa31-4df5-abf0-e83e5730d2bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:50.500306 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b318b5-fa31-4df5-abf0-e83e5730d2bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:50.508624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b318b5-fa31-4df5-abf0-e83e5730d2bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:50.510116 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b318b5-fa31-4df5-abf0-e83e5730d2bd service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:50.517938 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1210/2392] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:21:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:21:50.665541 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6bf26-9373-4d2a-b7d7-94dc1c0e50ec None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:50.665898 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6bf26-9373-4d2a-b7d7-94dc1c0e50ec None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:50.666243 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6bf26-9373-4d2a-b7d7-94dc1c0e50ec None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:50.668474 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1183/2393] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 13:21:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:21:50.674742 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae81f06-36c7-4230-a87b-4ec14af4bbe7 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:50.675141 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae81f06-36c7-4230-a87b-4ec14af4bbe7 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:50.675449 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae81f06-36c7-4230-a87b-4ec14af4bbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:50.693374 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-1ae81f06-36c7-4230-a87b-4ec14af4bbe7 None None] MFA Rules not processed for user `72d4ac44d04943a5b24c7a1d6a31b7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:21:50.694558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-1ae81f06-36c7-4230-a87b-4ec14af4bbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:21:50.703761 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1211/2394] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 13:21:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:21:50.714221 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6bf26-9373-4d2a-b7d7-94dc1c0e50ec None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:21:50.725146 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6bf26-9373-4d2a-b7d7-94dc1c0e50ec None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:21:50.728581 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a3893-3c2e-48a9-a69c-8b616a83a82c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:21:50.729251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a3893-3c2e-48a9-a69c-8b616a83a82c service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:21:50.729528 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a3893-3c2e-48a9-a69c-8b616a83a82c service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:21:50.729801 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a3893-3c2e-48a9-a69c-8b616a83a82c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:21:50.741980 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a3893-3c2e-48a9-a69c-8b616a83a82c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:21:50.743404 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a3893-3c2e-48a9-a69c-8b616a83a82c service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:21:50.753827 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1184/2395] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:21:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:22:01.129769 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae81f06-36c7-4230-a87b-4ec14af4bbe7 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:22:01.131314 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-1ae81f06-36c7-4230-a87b-4ec14af4bbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:22:01.233078 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae81f06-36c7-4230-a87b-4ec14af4bbe7 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:22:01.238412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcbbd0-7e8a-43ed-83bc-eb2d6465ce2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b917ce4f7f34b289218f7d36a43983e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:22:01.239056 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcbbd0-7e8a-43ed-83bc-eb2d6465ce2d service placement] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:22:01.239341 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcbbd0-7e8a-43ed-83bc-eb2d6465ce2d service placement] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:22:01.239620 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcbbd0-7e8a-43ed-83bc-eb2d6465ce2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:22:01.241407 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-bafcbbd0-7e8a-43ed-83bc-eb2d6465ce2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:22:01.252686 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcbbd0-7e8a-43ed-83bc-eb2d6465ce2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:22:01.254754 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcbbd0-7e8a-43ed-83bc-eb2d6465ce2d service placement] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:22:01.264322 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1212/2396] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:22:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:22:02.411007 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abdb44-b74a-4089-ab18-50e2bf6a4816 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:22:02.411485 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abdb44-b74a-4089-ab18-50e2bf6a4816 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:22:02.411595 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abdb44-b74a-4089-ab18-50e2bf6a4816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:22:02.458356 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-16abdb44-b74a-4089-ab18-50e2bf6a4816 None None] MFA Rules not processed for user `556058de7b9f48b8a10188ec64496e72`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:22:02.459531 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-16abdb44-b74a-4089-ab18-50e2bf6a4816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:22:02.521710 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1185/2397] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 13:22:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:22:02.532525 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcbbd0-7e8a-43ed-83bc-eb2d6465ce2d service placement] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:22:02.533953 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-bafcbbd0-7e8a-43ed-83bc-eb2d6465ce2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:22:02.623162 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcbbd0-7e8a-43ed-83bc-eb2d6465ce2d service placement] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:22:02.628141 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a05e3-807e-41ab-b3d8-a24f0d09942d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f375d86747d248fa95f487b073d92d83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:22:02.629383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a05e3-807e-41ab-b3d8-a24f0d09942d service swift] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:22:02.629658 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a05e3-807e-41ab-b3d8-a24f0d09942d service swift] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:22:02.629931 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a05e3-807e-41ab-b3d8-a24f0d09942d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:22:02.646020 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a05e3-807e-41ab-b3d8-a24f0d09942d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:22:02.646020 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a05e3-807e-41ab-b3d8-a24f0d09942d service swift] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:22:02.648440 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1213/2398] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 13:22:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:22:03.647948 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6babe-2914-4492-baff-5da0c3f7a1b1 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:22:03.648388 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6babe-2914-4492-baff-5da0c3f7a1b1 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:22:03.648566 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6babe-2914-4492-baff-5da0c3f7a1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:22:03.666202 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-b7f6babe-2914-4492-baff-5da0c3f7a1b1 None None] MFA Rules not processed for user `556058de7b9f48b8a10188ec64496e72`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:22:03.667384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b7f6babe-2914-4492-baff-5da0c3f7a1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:22:03.674346 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1186/2399] 10.222.0.52 () {58 vars in 967 bytes} [Tue Mar 8 13:22:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:22:03.687187 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a05e3-807e-41ab-b3d8-a24f0d09942d service swift] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:22:03.697381 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a05e3-807e-41ab-b3d8-a24f0d09942d service swift] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:22:03.702290 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd895c8-1643-4936-b7ed-38b08674005d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f375d86747d248fa95f487b073d92d83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:22:03.702917 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd895c8-1643-4936-b7ed-38b08674005d service swift] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:22:03.707032 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd895c8-1643-4936-b7ed-38b08674005d service swift] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:22:03.707032 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd895c8-1643-4936-b7ed-38b08674005d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:22:03.711732 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd895c8-1643-4936-b7ed-38b08674005d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:22:03.713339 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd895c8-1643-4936-b7ed-38b08674005d service swift] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:22:03.721386 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1214/2400] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 13:22:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:22:04.351865 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73657a-41e6-4f16-920c-b850289d22a8 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:22:04.352143 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73657a-41e6-4f16-920c-b850289d22a8 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:22:04.352418 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73657a-41e6-4f16-920c-b850289d22a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:22:04.376068 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-dc73657a-41e6-4f16-920c-b850289d22a8 None None] MFA Rules not processed for user `556058de7b9f48b8a10188ec64496e72`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:22:04.376674 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-dc73657a-41e6-4f16-920c-b850289d22a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:22:04.386565 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1187/2401] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 13:22:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:22:04.401345 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd895c8-1643-4936-b7ed-38b08674005d service swift] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:22:04.416012 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd895c8-1643-4936-b7ed-38b08674005d service swift] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:22:04.421280 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefa348-0204-4df4-a600-fef8a8fa297b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f375d86747d248fa95f487b073d92d83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:22:04.421917 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefa348-0204-4df4-a600-fef8a8fa297b service swift] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:22:04.422194 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefa348-0204-4df4-a600-fef8a8fa297b service swift] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:22:04.422474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefa348-0204-4df4-a600-fef8a8fa297b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:22:04.432971 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefa348-0204-4df4-a600-fef8a8fa297b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:22:04.434560 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefa348-0204-4df4-a600-fef8a8fa297b service swift] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:22:04.444536 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1215/2402] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 13:22:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:22:05.078178 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34699f39-0dd7-4595-a303-4a944a4743bc None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:22:05.078627 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34699f39-0dd7-4595-a303-4a944a4743bc None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:22:05.078735 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34699f39-0dd7-4595-a303-4a944a4743bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:22:05.096281 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-34699f39-0dd7-4595-a303-4a944a4743bc None None] MFA Rules not processed for user `556058de7b9f48b8a10188ec64496e72`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:22:05.098046 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-34699f39-0dd7-4595-a303-4a944a4743bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:22:05.105162 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1188/2403] 10.222.0.52 () {58 vars in 967 bytes} [Tue Mar 8 13:22:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:22:05.118488 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefa348-0204-4df4-a600-fef8a8fa297b service swift] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:22:05.128872 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefa348-0204-4df4-a600-fef8a8fa297b service swift] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:22:05.133924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71757ab2-3d96-4f03-867d-f96e6da7e800 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f375d86747d248fa95f487b073d92d83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:22:05.134586 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71757ab2-3d96-4f03-867d-f96e6da7e800 service swift] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:22:05.134988 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71757ab2-3d96-4f03-867d-f96e6da7e800 service swift] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:22:05.135269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71757ab2-3d96-4f03-867d-f96e6da7e800 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:22:05.143731 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71757ab2-3d96-4f03-867d-f96e6da7e800 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:22:05.146048 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71757ab2-3d96-4f03-867d-f96e6da7e800 service swift] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:22:05.154509 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1216/2404] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 13:22:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:22:38.987342 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34699f39-0dd7-4595-a303-4a944a4743bc None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:22:38.988815 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-34699f39-0dd7-4595-a303-4a944a4743bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:22:39.000304 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34699f39-0dd7-4595-a303-4a944a4743bc None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:22:39.004002 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10a9e3-b70e-49d4-9cda-1c6bbd2faa18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:22:39.004635 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10a9e3-b70e-49d4-9cda-1c6bbd2faa18 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:22:39.004954 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10a9e3-b70e-49d4-9cda-1c6bbd2faa18 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:22:39.005227 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10a9e3-b70e-49d4-9cda-1c6bbd2faa18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:22:39.007034 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-4b10a9e3-b70e-49d4-9cda-1c6bbd2faa18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:22:39.068085 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10a9e3-b70e-49d4-9cda-1c6bbd2faa18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:22:39.069757 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10a9e3-b70e-49d4-9cda-1c6bbd2faa18 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:22:39.079669 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1189/2405] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:22:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:23:50.450752 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71757ab2-3d96-4f03-867d-f96e6da7e800 service swift] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:23:50.460213 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71757ab2-3d96-4f03-867d-f96e6da7e800 service swift] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:23:50.464561 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d16b9-1bec-494b-96ed-cdd0c886eea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:23:50.465277 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d16b9-1bec-494b-96ed-cdd0c886eea5 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:23:50.465557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d16b9-1bec-494b-96ed-cdd0c886eea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:23:50.465869 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d16b9-1bec-494b-96ed-cdd0c886eea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:23:50.467640 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-160d16b9-1bec-494b-96ed-cdd0c886eea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:23:50.481573 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d16b9-1bec-494b-96ed-cdd0c886eea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:23:50.483244 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d16b9-1bec-494b-96ed-cdd0c886eea5 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:23:50.495305 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1217/2406] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:23:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:23:51.674730 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10a9e3-b70e-49d4-9cda-1c6bbd2faa18 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:23:51.683798 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10a9e3-b70e-49d4-9cda-1c6bbd2faa18 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:23:51.687343 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc68fcb-d6ff-4bb0-991b-d07d7ac4197f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:23:51.687975 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc68fcb-d6ff-4bb0-991b-d07d7ac4197f service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:23:51.688259 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc68fcb-d6ff-4bb0-991b-d07d7ac4197f service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:23:51.688538 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc68fcb-d6ff-4bb0-991b-d07d7ac4197f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:23:51.690291 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6cc68fcb-d6ff-4bb0-991b-d07d7ac4197f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:23:51.704247 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc68fcb-d6ff-4bb0-991b-d07d7ac4197f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:23:51.706697 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc68fcb-d6ff-4bb0-991b-d07d7ac4197f service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:23:51.717555 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1190/2407] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:23:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:23:59.948582 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d16b9-1bec-494b-96ed-cdd0c886eea5 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:23:59.950025 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-160d16b9-1bec-494b-96ed-cdd0c886eea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:23:59.964164 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d16b9-1bec-494b-96ed-cdd0c886eea5 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:23:59.969622 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e1c29-50a4-4c72-a9a6-cb3ac69b2859 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:23:59.970260 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e1c29-50a4-4c72-a9a6-cb3ac69b2859 service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:23:59.970542 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e1c29-50a4-4c72-a9a6-cb3ac69b2859 service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:23:59.970822 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e1c29-50a4-4c72-a9a6-cb3ac69b2859 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:23:59.972577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e26e1c29-50a4-4c72-a9a6-cb3ac69b2859 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:24:00.030746 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e1c29-50a4-4c72-a9a6-cb3ac69b2859 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:24:00.032359 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e1c29-50a4-4c72-a9a6-cb3ac69b2859 service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:24:00.041630 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1218/2408] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:23:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:24:01.999168 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc68fcb-d6ff-4bb0-991b-d07d7ac4197f service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:24:02.000552 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6cc68fcb-d6ff-4bb0-991b-d07d7ac4197f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:24:02.014469 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc68fcb-d6ff-4bb0-991b-d07d7ac4197f service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:24:02.019791 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf2c6c-a8db-442d-90f0-d634eb4f7e06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:24:02.020417 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf2c6c-a8db-442d-90f0-d634eb4f7e06 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:24:02.020721 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf2c6c-a8db-442d-90f0-d634eb4f7e06 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:24:02.020997 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf2c6c-a8db-442d-90f0-d634eb4f7e06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:24:02.022676 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-8ddf2c6c-a8db-442d-90f0-d634eb4f7e06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:24:02.077787 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf2c6c-a8db-442d-90f0-d634eb4f7e06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:24:02.079549 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf2c6c-a8db-442d-90f0-d634eb4f7e06 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:24:02.088965 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1191/2409] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:24:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:24:04.588875 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e1c29-50a4-4c72-a9a6-cb3ac69b2859 service nova] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:24:04.601338 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e1c29-50a4-4c72-a9a6-cb3ac69b2859 service nova] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:24:04.611966 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4b140-e2b8-4751-b6c0-4e340f3053ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:24:04.612712 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4b140-e2b8-4751-b6c0-4e340f3053ae service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:24:04.612981 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4b140-e2b8-4751-b6c0-4e340f3053ae service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:24:04.613262 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4b140-e2b8-4751-b6c0-4e340f3053ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:24:04.615153 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-02a4b140-e2b8-4751-b6c0-4e340f3053ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:24:04.692077 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4b140-e2b8-4751-b6c0-4e340f3053ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:24:04.693742 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4b140-e2b8-4751-b6c0-4e340f3053ae service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:24:04.704380 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1219/2410] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:24:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:24:39.272723 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf2c6c-a8db-442d-90f0-d634eb4f7e06 service nova] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:24:39.285247 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf2c6c-a8db-442d-90f0-d634eb4f7e06 service nova] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:24:39.291921 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130426a4-021b-4dcb-b7a6-db56b78e4bc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:24:39.293050 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130426a4-021b-4dcb-b7a6-db56b78e4bc7 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:24:39.293719 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130426a4-021b-4dcb-b7a6-db56b78e4bc7 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:24:39.294158 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130426a4-021b-4dcb-b7a6-db56b78e4bc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:24:39.296304 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-130426a4-021b-4dcb-b7a6-db56b78e4bc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:24:39.311210 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130426a4-021b-4dcb-b7a6-db56b78e4bc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:24:39.318997 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130426a4-021b-4dcb-b7a6-db56b78e4bc7 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:24:39.334518 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1192/2411] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:24:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:24:53.203759 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4b140-e2b8-4751-b6c0-4e340f3053ae service nova] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:24:53.213257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4b140-e2b8-4751-b6c0-4e340f3053ae service nova] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:24:53.216818 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0fd53-67b4-4567-af94-3e9c98cc9ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:24:53.217450 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0fd53-67b4-4567-af94-3e9c98cc9ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:24:53.217727 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0fd53-67b4-4567-af94-3e9c98cc9ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:24:53.218025 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0fd53-67b4-4567-af94-3e9c98cc9ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:24:53.219766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f9e0fd53-67b4-4567-af94-3e9c98cc9ed7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:24:53.228911 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0fd53-67b4-4567-af94-3e9c98cc9ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:24:53.230310 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0fd53-67b4-4567-af94-3e9c98cc9ed7 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:24:53.238522 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1220/2412] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:24:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:25:49.501368 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130426a4-021b-4dcb-b7a6-db56b78e4bc7 service nova] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:25:49.512458 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130426a4-021b-4dcb-b7a6-db56b78e4bc7 service nova] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:25:49.517868 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed32ef-3246-42f3-8ca2-662fa1413e8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:25:49.518513 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed32ef-3246-42f3-8ca2-662fa1413e8b service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:25:49.518785 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed32ef-3246-42f3-8ca2-662fa1413e8b service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:25:49.519064 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed32ef-3246-42f3-8ca2-662fa1413e8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:25:49.520853 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-9eed32ef-3246-42f3-8ca2-662fa1413e8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:25:49.578837 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed32ef-3246-42f3-8ca2-662fa1413e8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:25:49.580437 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed32ef-3246-42f3-8ca2-662fa1413e8b service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:25:49.589609 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1193/2413] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:25:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:26:32.033154 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0fd53-67b4-4567-af94-3e9c98cc9ed7 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:26:32.043128 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0fd53-67b4-4567-af94-3e9c98cc9ed7 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:26:32.046741 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756eb7d-0f94-43c2-90f5-9cded56ff7a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:26:32.047412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756eb7d-0f94-43c2-90f5-9cded56ff7a7 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:26:32.047694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756eb7d-0f94-43c2-90f5-9cded56ff7a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:26:32.047989 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756eb7d-0f94-43c2-90f5-9cded56ff7a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:26:32.049796 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-d756eb7d-0f94-43c2-90f5-9cded56ff7a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:26:32.108071 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756eb7d-0f94-43c2-90f5-9cded56ff7a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:26:32.109535 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756eb7d-0f94-43c2-90f5-9cded56ff7a7 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:26:32.118238 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1221/2414] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:26:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:27:51.488384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed32ef-3246-42f3-8ca2-662fa1413e8b service nova] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:27:51.489883 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-9eed32ef-3246-42f3-8ca2-662fa1413e8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:27:51.505550 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed32ef-3246-42f3-8ca2-662fa1413e8b service nova] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:27:51.511284 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9dcaa-de55-4bc0-ba98-ade0f74aa790 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b917ce4f7f34b289218f7d36a43983e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:27:51.511924 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9dcaa-de55-4bc0-ba98-ade0f74aa790 service placement] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:27:51.512209 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9dcaa-de55-4bc0-ba98-ade0f74aa790 service placement] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:27:51.512489 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9dcaa-de55-4bc0-ba98-ade0f74aa790 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:27:51.521008 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9dcaa-de55-4bc0-ba98-ade0f74aa790 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:27:51.522589 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9dcaa-de55-4bc0-ba98-ade0f74aa790 service placement] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:27:51.532429 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1194/2415] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:27:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:28:32.291115 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756eb7d-0f94-43c2-90f5-9cded56ff7a7 service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:28:32.299438 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756eb7d-0f94-43c2-90f5-9cded56ff7a7 service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:28:32.303020 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56aa53a-b1e8-4e4b-9a39-39009ae70708 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:28:32.303659 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56aa53a-b1e8-4e4b-9a39-39009ae70708 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:28:32.303942 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56aa53a-b1e8-4e4b-9a39-39009ae70708 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:28:32.304220 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56aa53a-b1e8-4e4b-9a39-39009ae70708 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:28:32.306584 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a56aa53a-b1e8-4e4b-9a39-39009ae70708 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:28:32.363362 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56aa53a-b1e8-4e4b-9a39-39009ae70708 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:28:32.364962 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56aa53a-b1e8-4e4b-9a39-39009ae70708 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:28:32.374664 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1222/2416] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:28:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:28:32.434930 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9dcaa-de55-4bc0-ba98-ade0f74aa790 service placement] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:28:32.443921 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9dcaa-de55-4bc0-ba98-ade0f74aa790 service placement] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:28:32.447396 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2f92b-9875-44cf-bf9b-aaa1beb9017d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:28:32.448017 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2f92b-9875-44cf-bf9b-aaa1beb9017d service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:28:32.448299 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2f92b-9875-44cf-bf9b-aaa1beb9017d service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:28:32.448569 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2f92b-9875-44cf-bf9b-aaa1beb9017d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:28:32.456491 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2f92b-9875-44cf-bf9b-aaa1beb9017d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:28:32.457957 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2f92b-9875-44cf-bf9b-aaa1beb9017d service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:28:32.467142 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1195/2417] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:28:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:28:32.558128 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56aa53a-b1e8-4e4b-9a39-39009ae70708 service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:28:32.559549 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a56aa53a-b1e8-4e4b-9a39-39009ae70708 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:28:32.641921 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56aa53a-b1e8-4e4b-9a39-39009ae70708 service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:28:32.646406 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a276e69-917d-496c-b58b-68996dc8bf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:28:32.646854 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a276e69-917d-496c-b58b-68996dc8bf5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:28:32.647136 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a276e69-917d-496c-b58b-68996dc8bf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:28:32.647411 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a276e69-917d-496c-b58b-68996dc8bf5a admin admin] PATH_INFO: `/v3/users/b524bd502e2e4e38937db3c691e21a2c` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:28:32.649183 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a276e69-917d-496c-b58b-68996dc8bf5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b524bd502e2e4e38937db3c691e21a2c)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:28:32.651137 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a276e69-917d-496c-b58b-68996dc8bf5a admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:28:32.879556 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-5a276e69-917d-496c-b58b-68996dc8bf5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b524bd502e2e4e38937db3c691e21a2c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:28:32.891054 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-5a276e69-917d-496c-b58b-68996dc8bf5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b524bd502e2e4e38937db3c691e21a2c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:28:32.891725 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-5a276e69-917d-496c-b58b-68996dc8bf5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b524bd502e2e4e38937db3c691e21a2c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:28:32.892416 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-5a276e69-917d-496c-b58b-68996dc8bf5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b524bd502e2e4e38937db3c691e21a2c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:28:32.900490 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-5a276e69-917d-496c-b58b-68996dc8bf5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b524bd502e2e4e38937db3c691e21a2c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:28:32.972784 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1223/2418] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:28:32 2022] DELETE /identity/v3/users/b524bd502e2e4e38937db3c691e21a2c => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:28:32.978069 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467eae1-402e-46db-a13c-2cafe99c538f None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:28:32.978556 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467eae1-402e-46db-a13c-2cafe99c538f None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:28:32.978830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467eae1-402e-46db-a13c-2cafe99c538f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:28:32.996013 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-c467eae1-402e-46db-a13c-2cafe99c538f None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:28:32.997249 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c467eae1-402e-46db-a13c-2cafe99c538f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:28:33.056781 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1196/2419] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:28:33.066911 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a276e69-917d-496c-b58b-68996dc8bf5a admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:28:33.068304 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-5a276e69-917d-496c-b58b-68996dc8bf5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:28:33.124358 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a276e69-917d-496c-b58b-68996dc8bf5a admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:28:33.128403 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c447d-be72-49a8-86f0-ade62ff68dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:28:33.129082 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c447d-be72-49a8-86f0-ade62ff68dfa service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:28:33.129365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c447d-be72-49a8-86f0-ade62ff68dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:28:33.129714 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c447d-be72-49a8-86f0-ade62ff68dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:28:33.139013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c447d-be72-49a8-86f0-ade62ff68dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:28:33.140476 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c447d-be72-49a8-86f0-ade62ff68dfa service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:28:33.150282 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1224/2420] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:28:33.375767 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467eae1-402e-46db-a13c-2cafe99c538f None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:28:33.377380 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c467eae1-402e-46db-a13c-2cafe99c538f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:28:33.389966 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467eae1-402e-46db-a13c-2cafe99c538f None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:28:33.394671 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651b5ab-fd4b-4be9-b9e8-e090a74866fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:28:33.395529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651b5ab-fd4b-4be9-b9e8-e090a74866fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:28:33.395815 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651b5ab-fd4b-4be9-b9e8-e090a74866fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:28:33.396096 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651b5ab-fd4b-4be9-b9e8-e090a74866fb admin admin] PATH_INFO: `/v3/projects/6d3ba160ad2b455fb1c10adf23c23040` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:28:33.397305 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651b5ab-fd4b-4be9-b9e8-e090a74866fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d3ba160ad2b455fb1c10adf23c23040)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:28:33.400265 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651b5ab-fd4b-4be9-b9e8-e090a74866fb admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:28:33.504122 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b651b5ab-fd4b-4be9-b9e8-e090a74866fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d3ba160ad2b455fb1c10adf23c23040', 'request_id': 'req-b651b5ab-fd4b-4be9-b9e8-e090a74866fb'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:28:33.557133 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b651b5ab-fd4b-4be9-b9e8-e090a74866fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d3ba160ad2b455fb1c10adf23c23040', 'request_id': 'req-b651b5ab-fd4b-4be9-b9e8-e090a74866fb'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:28:33.563909 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b651b5ab-fd4b-4be9-b9e8-e090a74866fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d3ba160ad2b455fb1c10adf23c23040', 'request_id': 'req-b651b5ab-fd4b-4be9-b9e8-e090a74866fb'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:28:33.575035 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b651b5ab-fd4b-4be9-b9e8-e090a74866fb admin admin] The token cache is being invalidate because project 6d3ba160ad2b455fb1c10adf23c23040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:28:33.575323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b651b5ab-fd4b-4be9-b9e8-e090a74866fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:28:33.575998 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b651b5ab-fd4b-4be9-b9e8-e090a74866fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:28:33.577566 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1197/2421] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:28:33 2022] DELETE /identity/v3/projects/6d3ba160ad2b455fb1c10adf23c23040 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:28:51.196135 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c447d-be72-49a8-86f0-ade62ff68dfa service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:28:51.205092 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c447d-be72-49a8-86f0-ade62ff68dfa service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:28:51.252581 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8f313-6cd5-4fe0-b1a4-a11d048a5378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:28:51.253237 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8f313-6cd5-4fe0-b1a4-a11d048a5378 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:28:51.253520 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8f313-6cd5-4fe0-b1a4-a11d048a5378 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:28:51.253788 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8f313-6cd5-4fe0-b1a4-a11d048a5378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:28:51.255594 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-47d8f313-6cd5-4fe0-b1a4-a11d048a5378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:28:51.324412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8f313-6cd5-4fe0-b1a4-a11d048a5378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:28:51.327091 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8f313-6cd5-4fe0-b1a4-a11d048a5378 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:28:51.340097 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1225/2422] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:28:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:29:04.519719 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651b5ab-fd4b-4be9-b9e8-e090a74866fb admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:29:04.521186 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b651b5ab-fd4b-4be9-b9e8-e090a74866fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:29:04.537596 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651b5ab-fd4b-4be9-b9e8-e090a74866fb admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:29:04.543517 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f2d74-1dbc-43f8-9f80-8c30fde8d541 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:29:04.544147 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2d74-1dbc-43f8-9f80-8c30fde8d541 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:29:04.544429 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2d74-1dbc-43f8-9f80-8c30fde8d541 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:29:04.544733 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2d74-1dbc-43f8-9f80-8c30fde8d541 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:29:04.546419 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7e6f2d74-1dbc-43f8-9f80-8c30fde8d541 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:29:04.622191 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f2d74-1dbc-43f8-9f80-8c30fde8d541 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:29:04.623714 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f2d74-1dbc-43f8-9f80-8c30fde8d541 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:29:04.642159 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1198/2423] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:29:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:29:59.211386 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8f313-6cd5-4fe0-b1a4-a11d048a5378 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:29:59.212873 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-47d8f313-6cd5-4fe0-b1a4-a11d048a5378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:29:59.223278 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8f313-6cd5-4fe0-b1a4-a11d048a5378 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:29:59.227611 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec816fa6-f62d-46de-a85d-cbe50e6c046a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:29:59.228241 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec816fa6-f62d-46de-a85d-cbe50e6c046a service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:29:59.228523 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec816fa6-f62d-46de-a85d-cbe50e6c046a service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:29:59.228839 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec816fa6-f62d-46de-a85d-cbe50e6c046a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:29:59.230544 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-ec816fa6-f62d-46de-a85d-cbe50e6c046a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:29:59.239558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec816fa6-f62d-46de-a85d-cbe50e6c046a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:29:59.241313 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec816fa6-f62d-46de-a85d-cbe50e6c046a service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:29:59.249472 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1226/2424] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:29:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:30:32.772909 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f2d74-1dbc-43f8-9f80-8c30fde8d541 service nova] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:30:32.772909 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7e6f2d74-1dbc-43f8-9f80-8c30fde8d541 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:30:32.823302 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f2d74-1dbc-43f8-9f80-8c30fde8d541 service nova] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:30:32.826949 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ed7de-6304-4fe8-b5c0-424f6e4de6d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:30:32.827592 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ed7de-6304-4fe8-b5c0-424f6e4de6d0 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:30:32.827877 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ed7de-6304-4fe8-b5c0-424f6e4de6d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:30:32.828157 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ed7de-6304-4fe8-b5c0-424f6e4de6d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:30:32.829915 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7e5ed7de-6304-4fe8-b5c0-424f6e4de6d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:30:32.844009 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ed7de-6304-4fe8-b5c0-424f6e4de6d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:30:32.845472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ed7de-6304-4fe8-b5c0-424f6e4de6d0 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:30:32.857428 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1199/2425] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:30:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:30:33.038320 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec816fa6-f62d-46de-a85d-cbe50e6c046a service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:30:33.047719 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec816fa6-f62d-46de-a85d-cbe50e6c046a service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:30:33.051338 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb59e8-042a-4608-b718-e7446f3e1147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:30:33.052542 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb59e8-042a-4608-b718-e7446f3e1147 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:30:33.052866 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb59e8-042a-4608-b718-e7446f3e1147 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:30:33.053115 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb59e8-042a-4608-b718-e7446f3e1147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:30:33.054903 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-41bb59e8-042a-4608-b718-e7446f3e1147 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:30:33.142572 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb59e8-042a-4608-b718-e7446f3e1147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:30:33.144014 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb59e8-042a-4608-b718-e7446f3e1147 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:30:33.165520 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1227/2426] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:30:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:30:33.216471 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ed7de-6304-4fe8-b5c0-424f6e4de6d0 service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:30:33.226075 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ed7de-6304-4fe8-b5c0-424f6e4de6d0 service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:30:33.229780 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ada455-f170-43dc-b1d8-bae48d154e79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:30:33.230681 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ada455-f170-43dc-b1d8-bae48d154e79 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:30:33.230969 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ada455-f170-43dc-b1d8-bae48d154e79 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:30:33.231251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ada455-f170-43dc-b1d8-bae48d154e79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:30:33.234014 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b6ada455-f170-43dc-b1d8-bae48d154e79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:30:33.315160 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ada455-f170-43dc-b1d8-bae48d154e79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:30:33.316535 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ada455-f170-43dc-b1d8-bae48d154e79 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:30:33.334732 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1200/2427] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:30:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:30:50.008173 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb59e8-042a-4608-b718-e7446f3e1147 service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:30:50.020323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb59e8-042a-4608-b718-e7446f3e1147 service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:30:50.025789 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93297e00-419c-4474-aca6-ccd06a10b4dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:30:50.026424 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93297e00-419c-4474-aca6-ccd06a10b4dc service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:30:50.026706 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93297e00-419c-4474-aca6-ccd06a10b4dc service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:30:50.026982 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93297e00-419c-4474-aca6-ccd06a10b4dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:30:50.028894 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-93297e00-419c-4474-aca6-ccd06a10b4dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:30:50.107205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93297e00-419c-4474-aca6-ccd06a10b4dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:30:50.108864 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93297e00-419c-4474-aca6-ccd06a10b4dc service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:30:50.127489 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1228/2428] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:30:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:31:32.762151 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ada455-f170-43dc-b1d8-bae48d154e79 service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:31:32.824837 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ada455-f170-43dc-b1d8-bae48d154e79 service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:31:32.831139 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1067dca-3b80-41c7-bf58-7d286cb6cf14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:31:32.831806 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1067dca-3b80-41c7-bf58-7d286cb6cf14 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:31:32.832089 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1067dca-3b80-41c7-bf58-7d286cb6cf14 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:31:32.832359 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1067dca-3b80-41c7-bf58-7d286cb6cf14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:31:32.834172 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-a1067dca-3b80-41c7-bf58-7d286cb6cf14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:31:32.920391 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1067dca-3b80-41c7-bf58-7d286cb6cf14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:31:32.922041 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1067dca-3b80-41c7-bf58-7d286cb6cf14 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:31:32.939951 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1201/2429] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:31:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:32:56.456203 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93297e00-419c-4474-aca6-ccd06a10b4dc service nova] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:32:56.457645 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-93297e00-419c-4474-aca6-ccd06a10b4dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:32:56.590054 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93297e00-419c-4474-aca6-ccd06a10b4dc service nova] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:32:56.595075 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764746e8-f678-44f7-8192-393883468c82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b917ce4f7f34b289218f7d36a43983e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:32:56.595716 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764746e8-f678-44f7-8192-393883468c82 service placement] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:32:56.595997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764746e8-f678-44f7-8192-393883468c82 service placement] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:32:56.596272 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764746e8-f678-44f7-8192-393883468c82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:32:56.598177 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-764746e8-f678-44f7-8192-393883468c82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:32:56.609582 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764746e8-f678-44f7-8192-393883468c82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:32:56.611179 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764746e8-f678-44f7-8192-393883468c82 service placement] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:32:56.621601 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1229/2430] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:32:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:34:34.027298 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1067dca-3b80-41c7-bf58-7d286cb6cf14 service nova] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:34:34.047879 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1067dca-3b80-41c7-bf58-7d286cb6cf14 service nova] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:34:34.051512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18032c7f-f38d-4b44-b406-13ce76af9a2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:34:34.052774 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18032c7f-f38d-4b44-b406-13ce76af9a2d service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:34:34.053057 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18032c7f-f38d-4b44-b406-13ce76af9a2d service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:34:34.053336 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18032c7f-f38d-4b44-b406-13ce76af9a2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:34:34.055155 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-18032c7f-f38d-4b44-b406-13ce76af9a2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:34:34.123520 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764746e8-f678-44f7-8192-393883468c82 service placement] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:34:34.124942 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-764746e8-f678-44f7-8192-393883468c82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:34:34.140178 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18032c7f-f38d-4b44-b406-13ce76af9a2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:34:34.142592 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18032c7f-f38d-4b44-b406-13ce76af9a2d service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:34:34.159700 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1202/2431] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:34:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:34:34.161185 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764746e8-f678-44f7-8192-393883468c82 service placement] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:34:34.167282 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6fd7b-c90d-49c0-867a-eb375e037111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:34:34.167925 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6fd7b-c90d-49c0-867a-eb375e037111 service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:34:34.168205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6fd7b-c90d-49c0-867a-eb375e037111 service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:34:34.168481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6fd7b-c90d-49c0-867a-eb375e037111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:34:34.179283 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6fd7b-c90d-49c0-867a-eb375e037111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:34:34.181091 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6fd7b-c90d-49c0-867a-eb375e037111 service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:34:34.191055 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1230/2432] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:34:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:34:34.290807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18032c7f-f38d-4b44-b406-13ce76af9a2d service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:34:34.299526 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18032c7f-f38d-4b44-b406-13ce76af9a2d service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:34:34.303475 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efa7ba-0a76-412e-89aa-4214faf121cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:34:34.304109 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efa7ba-0a76-412e-89aa-4214faf121cd service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:34:34.304394 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efa7ba-0a76-412e-89aa-4214faf121cd service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:34:34.304690 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efa7ba-0a76-412e-89aa-4214faf121cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:34:34.314972 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efa7ba-0a76-412e-89aa-4214faf121cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:34:34.321891 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efa7ba-0a76-412e-89aa-4214faf121cd service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:34:34.328014 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1203/2433] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:34:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:35:00.174020 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6fd7b-c90d-49c0-867a-eb375e037111 service nova] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:35:00.192097 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6fd7b-c90d-49c0-867a-eb375e037111 service nova] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:35:00.195750 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64951f-5185-4722-9d87-9219b2f63697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:35:00.196410 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64951f-5185-4722-9d87-9219b2f63697 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:35:00.196714 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64951f-5185-4722-9d87-9219b2f63697 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:35:00.196991 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64951f-5185-4722-9d87-9219b2f63697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:35:00.204309 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64951f-5185-4722-9d87-9219b2f63697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:35:00.205826 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64951f-5185-4722-9d87-9219b2f63697 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:35:00.214775 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1231/2434] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:35:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:35:33.389769 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efa7ba-0a76-412e-89aa-4214faf121cd service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:35:33.391137 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-84efa7ba-0a76-412e-89aa-4214faf121cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:35:33.413753 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efa7ba-0a76-412e-89aa-4214faf121cd service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:35:33.417364 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a08f5e-6061-49d8-ba66-1e9d48568ced service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:35:33.417991 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a08f5e-6061-49d8-ba66-1e9d48568ced service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:35:33.418271 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a08f5e-6061-49d8-ba66-1e9d48568ced service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:35:33.418544 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a08f5e-6061-49d8-ba66-1e9d48568ced service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:35:33.426812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a08f5e-6061-49d8-ba66-1e9d48568ced service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:35:33.428255 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a08f5e-6061-49d8-ba66-1e9d48568ced service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:35:33.436884 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1204/2435] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:35:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:35:33.725294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64951f-5185-4722-9d87-9219b2f63697 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:35:33.738722 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64951f-5185-4722-9d87-9219b2f63697 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:35:33.744079 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000e723-f230-4098-811f-397386e474bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:35:33.744737 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000e723-f230-4098-811f-397386e474bc service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:35:33.745023 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000e723-f230-4098-811f-397386e474bc service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:35:33.745299 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000e723-f230-4098-811f-397386e474bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:35:33.753639 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000e723-f230-4098-811f-397386e474bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:35:33.755233 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000e723-f230-4098-811f-397386e474bc service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:35:33.763918 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1232/2436] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:35:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:35:33.811408 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a08f5e-6061-49d8-ba66-1e9d48568ced service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:35:33.821083 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a08f5e-6061-49d8-ba66-1e9d48568ced service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:35:33.824753 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37934e09-59d3-4111-b565-1078050973bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:35:33.825384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37934e09-59d3-4111-b565-1078050973bb service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:35:33.825693 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37934e09-59d3-4111-b565-1078050973bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:35:33.825966 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37934e09-59d3-4111-b565-1078050973bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:35:33.836032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37934e09-59d3-4111-b565-1078050973bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:35:33.837505 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37934e09-59d3-4111-b565-1078050973bb service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:35:33.848257 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1205/2437] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:35:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:35:49.720259 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000e723-f230-4098-811f-397386e474bc service nova] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:35:49.729433 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000e723-f230-4098-811f-397386e474bc service nova] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:35:49.733018 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea444bde-0211-480b-a9eb-00bb95d5f5ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:35:49.733650 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea444bde-0211-480b-a9eb-00bb95d5f5ac service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:35:49.733929 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea444bde-0211-480b-a9eb-00bb95d5f5ac service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:35:49.734203 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea444bde-0211-480b-a9eb-00bb95d5f5ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:35:49.742573 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea444bde-0211-480b-a9eb-00bb95d5f5ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:35:49.743995 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea444bde-0211-480b-a9eb-00bb95d5f5ac service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:35:49.753280 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1233/2438] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:35:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:36:32.481006 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37934e09-59d3-4111-b565-1078050973bb service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:36:32.490324 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37934e09-59d3-4111-b565-1078050973bb service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:36:32.493840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc6cd2-85ef-4f76-881d-ec477dde8366 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:36:32.494469 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc6cd2-85ef-4f76-881d-ec477dde8366 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:32.494773 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc6cd2-85ef-4f76-881d-ec477dde8366 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:32.495056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc6cd2-85ef-4f76-881d-ec477dde8366 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:32.503884 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc6cd2-85ef-4f76-881d-ec477dde8366 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:36:32.505349 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc6cd2-85ef-4f76-881d-ec477dde8366 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:36:32.514122 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1206/2439] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:36:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:36:33.574991 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea444bde-0211-480b-a9eb-00bb95d5f5ac service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:36:33.576578 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-ea444bde-0211-480b-a9eb-00bb95d5f5ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:36:33.673194 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea444bde-0211-480b-a9eb-00bb95d5f5ac service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:36:33.677724 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5531ac-e4f0-4858-aa59-62f07a7afc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:36:33.678593 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5531ac-e4f0-4858-aa59-62f07a7afc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:33.678874 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5531ac-e4f0-4858-aa59-62f07a7afc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:33.679148 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5531ac-e4f0-4858-aa59-62f07a7afc94 admin admin] PATH_INFO: `/v3/users/40b696c14dbc4065963262f05de1401f` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:33.680342 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5531ac-e4f0-4858-aa59-62f07a7afc94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b696c14dbc4065963262f05de1401f)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:36:33.682308 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5531ac-e4f0-4858-aa59-62f07a7afc94 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:36:33.889515 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1f5531ac-e4f0-4858-aa59-62f07a7afc94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b696c14dbc4065963262f05de1401f'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:33.900786 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1f5531ac-e4f0-4858-aa59-62f07a7afc94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b696c14dbc4065963262f05de1401f'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:33.901513 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1f5531ac-e4f0-4858-aa59-62f07a7afc94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b696c14dbc4065963262f05de1401f'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:33.902118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1f5531ac-e4f0-4858-aa59-62f07a7afc94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b696c14dbc4065963262f05de1401f'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:33.908933 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1f5531ac-e4f0-4858-aa59-62f07a7afc94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b696c14dbc4065963262f05de1401f'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:33.974996 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1234/2440] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:36:33 2022] DELETE /identity/v3/users/40b696c14dbc4065963262f05de1401f => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:36:33.981626 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab286c27-2710-48c0-8a3b-c36bdc504c1f None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:33.981626 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab286c27-2710-48c0-8a3b-c36bdc504c1f None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:33.981626 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab286c27-2710-48c0-8a3b-c36bdc504c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:34.008303 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-ab286c27-2710-48c0-8a3b-c36bdc504c1f None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:36:34.010313 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-ab286c27-2710-48c0-8a3b-c36bdc504c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:36:34.067129 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1207/2441] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:36:34.076729 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5531ac-e4f0-4858-aa59-62f07a7afc94 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:36:34.078252 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-1f5531ac-e4f0-4858-aa59-62f07a7afc94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:36:34.146493 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5531ac-e4f0-4858-aa59-62f07a7afc94 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:36:34.150084 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdbb2c-dbff-48d7-bed9-6bb31bfdea62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:36:34.150745 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdbb2c-dbff-48d7-bed9-6bb31bfdea62 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:34.151025 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdbb2c-dbff-48d7-bed9-6bb31bfdea62 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:34.151296 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdbb2c-dbff-48d7-bed9-6bb31bfdea62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:34.160538 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcdbb2c-dbff-48d7-bed9-6bb31bfdea62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:36:34.161983 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcdbb2c-dbff-48d7-bed9-6bb31bfdea62 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:36:34.171585 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1235/2442] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:36:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:36:34.622204 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab286c27-2710-48c0-8a3b-c36bdc504c1f None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:36:34.626325 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-ab286c27-2710-48c0-8a3b-c36bdc504c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:36:34.647096 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab286c27-2710-48c0-8a3b-c36bdc504c1f None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:36:34.653271 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e603be0-34e6-4ec7-b875-30af7bbdd143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:36:34.654498 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e603be0-34e6-4ec7-b875-30af7bbdd143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:34.654930 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e603be0-34e6-4ec7-b875-30af7bbdd143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:34.655962 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e603be0-34e6-4ec7-b875-30af7bbdd143 admin admin] PATH_INFO: `/v3/projects/3921ba6950a340bf9fbd02fa6e913a0d` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:34.657345 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e603be0-34e6-4ec7-b875-30af7bbdd143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3921ba6950a340bf9fbd02fa6e913a0d)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:36:34.659343 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e603be0-34e6-4ec7-b875-30af7bbdd143 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:36:34.769290 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1e603be0-34e6-4ec7-b875-30af7bbdd143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3921ba6950a340bf9fbd02fa6e913a0d', 'request_id': 'req-1e603be0-34e6-4ec7-b875-30af7bbdd143'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:34.893593 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1e603be0-34e6-4ec7-b875-30af7bbdd143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3921ba6950a340bf9fbd02fa6e913a0d', 'request_id': 'req-1e603be0-34e6-4ec7-b875-30af7bbdd143'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:34.899626 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1e603be0-34e6-4ec7-b875-30af7bbdd143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3921ba6950a340bf9fbd02fa6e913a0d', 'request_id': 'req-1e603be0-34e6-4ec7-b875-30af7bbdd143'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:34.911287 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1e603be0-34e6-4ec7-b875-30af7bbdd143 admin admin] The token cache is being invalidate because project 3921ba6950a340bf9fbd02fa6e913a0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:36:34.911515 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1e603be0-34e6-4ec7-b875-30af7bbdd143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:34.912169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1e603be0-34e6-4ec7-b875-30af7bbdd143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:34.913796 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1208/2443] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:36:34 2022] DELETE /identity/v3/projects/3921ba6950a340bf9fbd02fa6e913a0d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:36:34.924378 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdbb2c-dbff-48d7-bed9-6bb31bfdea62 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:36:34.928939 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdbb2c-dbff-48d7-bed9-6bb31bfdea62 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:36:34.984971 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdb604-939d-43e8-9bd6-7a41d542cc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:36:34.986103 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdb604-939d-43e8-9bd6-7a41d542cc19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:34.986388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdb604-939d-43e8-9bd6-7a41d542cc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:34.986663 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdb604-939d-43e8-9bd6-7a41d542cc19 admin admin] PATH_INFO: `/v3/users/22e11fe3215e4fee80378e9219a7e15f` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:35.000306 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdb604-939d-43e8-9bd6-7a41d542cc19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e11fe3215e4fee80378e9219a7e15f)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:36:35.002291 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdb604-939d-43e8-9bd6-7a41d542cc19 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:36:35.222250 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-61fdb604-939d-43e8-9bd6-7a41d542cc19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e11fe3215e4fee80378e9219a7e15f'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:35.234125 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-61fdb604-939d-43e8-9bd6-7a41d542cc19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e11fe3215e4fee80378e9219a7e15f'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:35.234798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-61fdb604-939d-43e8-9bd6-7a41d542cc19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e11fe3215e4fee80378e9219a7e15f'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:35.235658 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-61fdb604-939d-43e8-9bd6-7a41d542cc19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e11fe3215e4fee80378e9219a7e15f'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:35.242399 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-61fdb604-939d-43e8-9bd6-7a41d542cc19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e11fe3215e4fee80378e9219a7e15f'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:35.355679 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1236/2444] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:36:34 2022] DELETE /identity/v3/users/22e11fe3215e4fee80378e9219a7e15f => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:36:35.729493 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e603be0-34e6-4ec7-b875-30af7bbdd143 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:36:35.731011 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1e603be0-34e6-4ec7-b875-30af7bbdd143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:36:35.747393 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e603be0-34e6-4ec7-b875-30af7bbdd143 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:36:35.811651 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab48d1-8439-4571-beb9-cd413904fb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:36:35.812509 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab48d1-8439-4571-beb9-cd413904fb49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:35.812833 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab48d1-8439-4571-beb9-cd413904fb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:35.813111 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab48d1-8439-4571-beb9-cd413904fb49 admin admin] PATH_INFO: `/v3/projects/11e22be7f45b427fa389d5cc140cf41e` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:35.823186 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab48d1-8439-4571-beb9-cd413904fb49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11e22be7f45b427fa389d5cc140cf41e)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:36:35.825144 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab48d1-8439-4571-beb9-cd413904fb49 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:36:35.926216 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1cab48d1-8439-4571-beb9-cd413904fb49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11e22be7f45b427fa389d5cc140cf41e', 'request_id': 'req-1cab48d1-8439-4571-beb9-cd413904fb49'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:35.986759 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1cab48d1-8439-4571-beb9-cd413904fb49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11e22be7f45b427fa389d5cc140cf41e', 'request_id': 'req-1cab48d1-8439-4571-beb9-cd413904fb49'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:35.992566 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1cab48d1-8439-4571-beb9-cd413904fb49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11e22be7f45b427fa389d5cc140cf41e', 'request_id': 'req-1cab48d1-8439-4571-beb9-cd413904fb49'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:36.004497 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1cab48d1-8439-4571-beb9-cd413904fb49 admin admin] The token cache is being invalidate because project 11e22be7f45b427fa389d5cc140cf41e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:36:36.004817 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1cab48d1-8439-4571-beb9-cd413904fb49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:36.005461 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1cab48d1-8439-4571-beb9-cd413904fb49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:36.007001 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1209/2445] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:36:35 2022] DELETE /identity/v3/projects/11e22be7f45b427fa389d5cc140cf41e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:36:36.010972 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdb604-939d-43e8-9bd6-7a41d542cc19 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:36:36.012488 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-61fdb604-939d-43e8-9bd6-7a41d542cc19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:36:36.026031 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdb604-939d-43e8-9bd6-7a41d542cc19 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:36:36.087954 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e442fa5-10a2-43fc-a6da-cdd23558f75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:36:36.088978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e442fa5-10a2-43fc-a6da-cdd23558f75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:36.089260 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e442fa5-10a2-43fc-a6da-cdd23558f75e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:36.089534 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e442fa5-10a2-43fc-a6da-cdd23558f75e admin admin] PATH_INFO: `/v3/users/de0c157620054e81a6d9dc6ff25f6576` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:36.105944 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e442fa5-10a2-43fc-a6da-cdd23558f75e admin admin] RBAC: Authorizing `identity:delete_user(user_id=de0c157620054e81a6d9dc6ff25f6576)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:36:36.108047 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e442fa5-10a2-43fc-a6da-cdd23558f75e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:36:36.348957 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4e442fa5-10a2-43fc-a6da-cdd23558f75e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de0c157620054e81a6d9dc6ff25f6576'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:36.360719 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4e442fa5-10a2-43fc-a6da-cdd23558f75e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de0c157620054e81a6d9dc6ff25f6576'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:36.361389 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4e442fa5-10a2-43fc-a6da-cdd23558f75e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de0c157620054e81a6d9dc6ff25f6576'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:36.361979 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4e442fa5-10a2-43fc-a6da-cdd23558f75e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de0c157620054e81a6d9dc6ff25f6576'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:36.368606 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4e442fa5-10a2-43fc-a6da-cdd23558f75e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de0c157620054e81a6d9dc6ff25f6576'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:36.455133 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1237/2446] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:36:36 2022] DELETE /identity/v3/users/de0c157620054e81a6d9dc6ff25f6576 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:36:36.902775 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab48d1-8439-4571-beb9-cd413904fb49 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:36:36.904229 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1cab48d1-8439-4571-beb9-cd413904fb49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:36:36.916857 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab48d1-8439-4571-beb9-cd413904fb49 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:36:36.973374 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2148326-1bca-4597-8b94-e049d17f9189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:36:36.974253 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2148326-1bca-4597-8b94-e049d17f9189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:36.974534 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2148326-1bca-4597-8b94-e049d17f9189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:36.974806 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2148326-1bca-4597-8b94-e049d17f9189 admin admin] PATH_INFO: `/v3/projects/828403bb1a3a4a65b1bbdd62f9fe668f` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:36.985920 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2148326-1bca-4597-8b94-e049d17f9189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=828403bb1a3a4a65b1bbdd62f9fe668f)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:36:36.987840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2148326-1bca-4597-8b94-e049d17f9189 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:36:37.099818 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e2148326-1bca-4597-8b94-e049d17f9189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '828403bb1a3a4a65b1bbdd62f9fe668f', 'request_id': 'req-e2148326-1bca-4597-8b94-e049d17f9189'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:37.186673 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e2148326-1bca-4597-8b94-e049d17f9189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '828403bb1a3a4a65b1bbdd62f9fe668f', 'request_id': 'req-e2148326-1bca-4597-8b94-e049d17f9189'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:37.193809 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e2148326-1bca-4597-8b94-e049d17f9189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '828403bb1a3a4a65b1bbdd62f9fe668f', 'request_id': 'req-e2148326-1bca-4597-8b94-e049d17f9189'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:37.205598 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e2148326-1bca-4597-8b94-e049d17f9189 admin admin] The token cache is being invalidate because project 828403bb1a3a4a65b1bbdd62f9fe668f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:36:37.205887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e2148326-1bca-4597-8b94-e049d17f9189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:37.206541 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-e2148326-1bca-4597-8b94-e049d17f9189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:36:37.208157 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1210/2447] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:36:36 2022] DELETE /identity/v3/projects/828403bb1a3a4a65b1bbdd62f9fe668f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:36:37.214490 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30858a11-856c-4f8c-801e-406ed4c529ac None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:37.215004 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30858a11-856c-4f8c-801e-406ed4c529ac None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:37.215120 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30858a11-856c-4f8c-801e-406ed4c529ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:37.263672 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-30858a11-856c-4f8c-801e-406ed4c529ac None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:36:37.265305 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-30858a11-856c-4f8c-801e-406ed4c529ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:36:37.325969 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1238/2448] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:36:37.334422 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a299942-7ec3-428a-a713-51608f90f738 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:37.334645 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a299942-7ec3-428a-a713-51608f90f738 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:37.334917 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a299942-7ec3-428a-a713-51608f90f738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:37.353835 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-6a299942-7ec3-428a-a713-51608f90f738 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:36:37.355099 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6a299942-7ec3-428a-a713-51608f90f738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:36:37.363311 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1211/2449] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:36:37.367464 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30858a11-856c-4f8c-801e-406ed4c529ac None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:36:37.376922 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30858a11-856c-4f8c-801e-406ed4c529ac None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:36:37.381374 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4d8c3-487c-4007-afc4-5156aa1036f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:36:37.382017 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4d8c3-487c-4007-afc4-5156aa1036f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:37.382294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4d8c3-487c-4007-afc4-5156aa1036f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:37.382562 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4d8c3-487c-4007-afc4-5156aa1036f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:37.383273 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4d8c3-487c-4007-afc4-5156aa1036f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:36:37.383577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4d8c3-487c-4007-afc4-5156aa1036f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:36:37.385197 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4d8c3-487c-4007-afc4-5156aa1036f1 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:36:37.396961 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1239/2450] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:36:37.401188 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a299942-7ec3-428a-a713-51608f90f738 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:36:37.410808 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a299942-7ec3-428a-a713-51608f90f738 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:36:37.415440 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbe425-f23b-4a02-bab4-ff34aec07bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:36:37.416080 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbe425-f23b-4a02-bab4-ff34aec07bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:37.416365 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbe425-f23b-4a02-bab4-ff34aec07bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:37.416642 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbe425-f23b-4a02-bab4-ff34aec07bc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:37.417363 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbe425-f23b-4a02-bab4-ff34aec07bc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:36:37.419275 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbe425-f23b-4a02-bab4-ff34aec07bc2 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:36:37.584355 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1212/2451] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:36:37 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:36:37.589197 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4d8c3-487c-4007-afc4-5156aa1036f1 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:36:37.596002 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4d8c3-487c-4007-afc4-5156aa1036f1 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:36:37.650682 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3e8b0-1358-4029-8e55-c610807fa300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:36:37.651860 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3e8b0-1358-4029-8e55-c610807fa300 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:37.651860 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3e8b0-1358-4029-8e55-c610807fa300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:37.651860 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3e8b0-1358-4029-8e55-c610807fa300 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:37.652558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3e8b0-1358-4029-8e55-c610807fa300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:36:37.654500 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3e8b0-1358-4029-8e55-c610807fa300 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:36:37.746774 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1240/2452] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:36:37 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:36:37.751202 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbe425-f23b-4a02-bab4-ff34aec07bc2 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:36:37.761274 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbe425-f23b-4a02-bab4-ff34aec07bc2 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:36:37.766390 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652eec79-7e82-4eca-a640-ea71cf716a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:36:37.767044 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652eec79-7e82-4eca-a640-ea71cf716a8e admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:37.767327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652eec79-7e82-4eca-a640-ea71cf716a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:37.767602 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652eec79-7e82-4eca-a640-ea71cf716a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:37.768320 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652eec79-7e82-4eca-a640-ea71cf716a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:36:37.769964 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652eec79-7e82-4eca-a640-ea71cf716a8e admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:36:37.779481 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1213/2453] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:36:37.784201 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3e8b0-1358-4029-8e55-c610807fa300 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:36:37.794338 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3e8b0-1358-4029-8e55-c610807fa300 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:36:37.798967 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cc3dc-e5b0-4612-8804-1e18b621a72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:36:37.799626 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cc3dc-e5b0-4612-8804-1e18b621a72a admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:37.799911 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cc3dc-e5b0-4612-8804-1e18b621a72a admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:37.800187 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cc3dc-e5b0-4612-8804-1e18b621a72a admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:37.800977 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2cc3dc-e5b0-4612-8804-1e18b621a72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:36:37.802569 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2cc3dc-e5b0-4612-8804-1e18b621a72a admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:36:37.814215 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1241/2454] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:36:37.817188 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652eec79-7e82-4eca-a640-ea71cf716a8e admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:36:37.826918 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652eec79-7e82-4eca-a640-ea71cf716a8e admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:36:37.832164 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd29368-2d59-4080-ba8c-7c0d5aae27ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:36:37.833084 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd29368-2d59-4080-ba8c-7c0d5aae27ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:37.833369 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd29368-2d59-4080-ba8c-7c0d5aae27ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:37.833648 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd29368-2d59-4080-ba8c-7c0d5aae27ea admin admin] PATH_INFO: `/v3/projects/818c00532bbc4962bd1b3ea89d1edcf5/users/75caec29f3b7480982d90bb45d99ed99/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:37.848177 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd29368-2d59-4080-ba8c-7c0d5aae27ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=818c00532bbc4962bd1b3ea89d1edcf5, user_id=75caec29f3b7480982d90bb45d99ed99, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:36:37.850824 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd29368-2d59-4080-ba8c-7c0d5aae27ea admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:36:37.928967 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1214/2455] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:36:37 2022] PUT /identity/v3/projects/818c00532bbc4962bd1b3ea89d1edcf5/users/75caec29f3b7480982d90bb45d99ed99/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:36:37.933970 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f8bf3-9e0d-4d65-a32b-e28343ac8611 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:37.934366 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f8bf3-9e0d-4d65-a32b-e28343ac8611 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:37.934657 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f8bf3-9e0d-4d65-a32b-e28343ac8611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:37.953333 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-505f8bf3-9e0d-4d65-a32b-e28343ac8611 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:36:37.954535 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-505f8bf3-9e0d-4d65-a32b-e28343ac8611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:36:38.012351 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1242/2456] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:36:38.021739 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd29368-2d59-4080-ba8c-7c0d5aae27ea admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:36:38.023440 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-ccd29368-2d59-4080-ba8c-7c0d5aae27ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:36:38.078560 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd29368-2d59-4080-ba8c-7c0d5aae27ea admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:36:38.082566 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3e3dc-cd76-40e9-8c6c-13b6a6869617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:36:38.083203 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3e3dc-cd76-40e9-8c6c-13b6a6869617 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:38.083492 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3e3dc-cd76-40e9-8c6c-13b6a6869617 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:38.083765 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3e3dc-cd76-40e9-8c6c-13b6a6869617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:38.092537 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3e3dc-cd76-40e9-8c6c-13b6a6869617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:36:38.094688 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3e3dc-cd76-40e9-8c6c-13b6a6869617 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:36:38.103873 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1215/2457] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:36:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:36:39.522064 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aeef19-31d7-4749-8745-b484899612af None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:39.522606 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aeef19-31d7-4749-8745-b484899612af None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:39.522606 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aeef19-31d7-4749-8745-b484899612af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:39.552118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-f7aeef19-31d7-4749-8745-b484899612af None None] MFA Rules not processed for user `75caec29f3b7480982d90bb45d99ed99`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:36:39.553382 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f7aeef19-31d7-4749-8745-b484899612af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:36:39.631912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1243/2458] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:36:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:36:39.643259 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3e3dc-cd76-40e9-8c6c-13b6a6869617 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:36:39.645076 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-63a3e3dc-cd76-40e9-8c6c-13b6a6869617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:36:39.703710 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3e3dc-cd76-40e9-8c6c-13b6a6869617 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:36:39.707379 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9931ed8-0e77-4ebc-af8b-56772d11b9bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:36:39.708022 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9931ed8-0e77-4ebc-af8b-56772d11b9bd service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:36:39.708302 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9931ed8-0e77-4ebc-af8b-56772d11b9bd service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:36:39.708574 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9931ed8-0e77-4ebc-af8b-56772d11b9bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:36:39.716787 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9931ed8-0e77-4ebc-af8b-56772d11b9bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:36:39.718830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9931ed8-0e77-4ebc-af8b-56772d11b9bd service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:36:39.727919 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1216/2459] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:36:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:38:00.475443 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aeef19-31d7-4749-8745-b484899612af None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:00.477132 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f7aeef19-31d7-4749-8745-b484899612af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:00.546175 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aeef19-31d7-4749-8745-b484899612af None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:00.551181 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a64157-0e87-4941-9399-c364a1163150 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b917ce4f7f34b289218f7d36a43983e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:00.551825 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a64157-0e87-4941-9399-c364a1163150 service placement] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:00.552110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a64157-0e87-4941-9399-c364a1163150 service placement] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:00.552387 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a64157-0e87-4941-9399-c364a1163150 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:00.554161 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e1a64157-0e87-4941-9399-c364a1163150 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:00.565238 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a64157-0e87-4941-9399-c364a1163150 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:00.566822 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a64157-0e87-4941-9399-c364a1163150 service placement] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:00.576499 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1244/2460] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:38:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:39:34.928099 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9931ed8-0e77-4ebc-af8b-56772d11b9bd service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:34.929509 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b9931ed8-0e77-4ebc-af8b-56772d11b9bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:34.940955 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9931ed8-0e77-4ebc-af8b-56772d11b9bd service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:34.944474 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630708d1-aabb-484e-9097-2c6f4aecb9e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:34.945130 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630708d1-aabb-484e-9097-2c6f4aecb9e5 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:34.945407 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630708d1-aabb-484e-9097-2c6f4aecb9e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:34.945679 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630708d1-aabb-484e-9097-2c6f4aecb9e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:34.947319 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-630708d1-aabb-484e-9097-2c6f4aecb9e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:35.022482 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630708d1-aabb-484e-9097-2c6f4aecb9e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:35.023918 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630708d1-aabb-484e-9097-2c6f4aecb9e5 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:35.041893 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1217/2461] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:39:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:39:36.405550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a64157-0e87-4941-9399-c364a1163150 service placement] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:36.406966 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e1a64157-0e87-4941-9399-c364a1163150 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:36.419332 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a64157-0e87-4941-9399-c364a1163150 service placement] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:36.423086 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf30b7-6929-40f1-bea0-a031781b68c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:36.424246 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf30b7-6929-40f1-bea0-a031781b68c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:36.424530 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf30b7-6929-40f1-bea0-a031781b68c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:36.424829 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf30b7-6929-40f1-bea0-a031781b68c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:36.426782 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-8cdf30b7-6929-40f1-bea0-a031781b68c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:36.499292 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf30b7-6929-40f1-bea0-a031781b68c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:36.500764 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf30b7-6929-40f1-bea0-a031781b68c0 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:36.512233 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1245/2462] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:39:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:40:03.169438 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630708d1-aabb-484e-9097-2c6f4aecb9e5 service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:03.178945 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630708d1-aabb-484e-9097-2c6f4aecb9e5 service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:03.182467 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7acaa-d68a-420c-a676-ebc48beb00ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:03.183089 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7acaa-d68a-420c-a676-ebc48beb00ae service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:03.183371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7acaa-d68a-420c-a676-ebc48beb00ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:03.183645 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7acaa-d68a-420c-a676-ebc48beb00ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:03.185372 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7ac7acaa-d68a-420c-a676-ebc48beb00ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:03.197378 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7acaa-d68a-420c-a676-ebc48beb00ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:03.198823 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7acaa-d68a-420c-a676-ebc48beb00ae service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:03.206940 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1218/2463] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:40:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:40:32.689472 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf30b7-6929-40f1-bea0-a031781b68c0 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:32.699131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf30b7-6929-40f1-bea0-a031781b68c0 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:32.702573 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d923291-6156-4415-8157-9b02cc18ffb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:32.703197 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d923291-6156-4415-8157-9b02cc18ffb5 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:32.703475 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d923291-6156-4415-8157-9b02cc18ffb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:32.703747 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d923291-6156-4415-8157-9b02cc18ffb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:32.705498 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0d923291-6156-4415-8157-9b02cc18ffb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:32.762998 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d923291-6156-4415-8157-9b02cc18ffb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:32.764477 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d923291-6156-4415-8157-9b02cc18ffb5 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:32.773616 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1246/2464] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:40:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:40:32.876085 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7acaa-d68a-420c-a676-ebc48beb00ae service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:32.877536 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7ac7acaa-d68a-420c-a676-ebc48beb00ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:32.898186 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7acaa-d68a-420c-a676-ebc48beb00ae service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:32.899328 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882660e-c1a6-43b7-8a49-6202fd5a9c82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:32.899973 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882660e-c1a6-43b7-8a49-6202fd5a9c82 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:32.900256 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882660e-c1a6-43b7-8a49-6202fd5a9c82 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:32.900531 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882660e-c1a6-43b7-8a49-6202fd5a9c82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:32.902333 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7882660e-c1a6-43b7-8a49-6202fd5a9c82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:32.962384 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882660e-c1a6-43b7-8a49-6202fd5a9c82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:32.963926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882660e-c1a6-43b7-8a49-6202fd5a9c82 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:32.973286 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1219/2465] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:40:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:40:34.198334 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d923291-6156-4415-8157-9b02cc18ffb5 service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:34.207742 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d923291-6156-4415-8157-9b02cc18ffb5 service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:34.211270 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d48f4e-440a-43cc-962b-f25ba386ba0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:34.211895 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d48f4e-440a-43cc-962b-f25ba386ba0a service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:34.212172 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d48f4e-440a-43cc-962b-f25ba386ba0a service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:34.212441 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d48f4e-440a-43cc-962b-f25ba386ba0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:34.214211 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-c7d48f4e-440a-43cc-962b-f25ba386ba0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:34.227725 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d48f4e-440a-43cc-962b-f25ba386ba0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:34.229194 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d48f4e-440a-43cc-962b-f25ba386ba0a service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:34.240555 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1247/2466] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:40:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:40:37.672164 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882660e-c1a6-43b7-8a49-6202fd5a9c82 service nova] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:37.689142 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882660e-c1a6-43b7-8a49-6202fd5a9c82 service nova] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:37.696191 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660e66d-07a2-424d-a1da-3e23e2c905cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:37.696863 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660e66d-07a2-424d-a1da-3e23e2c905cb service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:37.697345 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660e66d-07a2-424d-a1da-3e23e2c905cb service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:37.697889 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660e66d-07a2-424d-a1da-3e23e2c905cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:37.699732 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-0660e66d-07a2-424d-a1da-3e23e2c905cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:37.714947 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660e66d-07a2-424d-a1da-3e23e2c905cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:37.716807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660e66d-07a2-424d-a1da-3e23e2c905cb service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:37.728578 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1220/2467] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:40:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:40:40.559986 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295722c-dbd8-4e36-9692-7c125c9a85a5 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:40.560500 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295722c-dbd8-4e36-9692-7c125c9a85a5 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:40.560687 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295722c-dbd8-4e36-9692-7c125c9a85a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:40.581246 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1804a-36ce-400d-b872-e94871dba065 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:40.581764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1804a-36ce-400d-b872-e94871dba065 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:40.581920 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1804a-36ce-400d-b872-e94871dba065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:40.620213 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-a295722c-dbd8-4e36-9692-7c125c9a85a5 None None] MFA Rules not processed for user `728607c7138540d69532b0b806b9ccaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:40.621507 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a295722c-dbd8-4e36-9692-7c125c9a85a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:40.640577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1248/2468] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:40:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:40:40.653306 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-8fb1804a-36ce-400d-b872-e94871dba065 None None] MFA Rules not processed for user `556058de7b9f48b8a10188ec64496e72`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:40.654499 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-8fb1804a-36ce-400d-b872-e94871dba065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:40.721620 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1221/2469] 10.222.0.52 () {58 vars in 967 bytes} [Tue Mar 8 13:40:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:40:40.863990 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295722c-dbd8-4e36-9692-7c125c9a85a5 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:40.865455 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a295722c-dbd8-4e36-9692-7c125c9a85a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:40.960770 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295722c-dbd8-4e36-9692-7c125c9a85a5 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:40.965822 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3780d-912c-4538-8b16-8ded1eb1cf7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f375d86747d248fa95f487b073d92d83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:40.966477 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3780d-912c-4538-8b16-8ded1eb1cf7c service swift] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:40.966762 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3780d-912c-4538-8b16-8ded1eb1cf7c service swift] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:40.967038 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3780d-912c-4538-8b16-8ded1eb1cf7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:40.976388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3780d-912c-4538-8b16-8ded1eb1cf7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:40.981681 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3780d-912c-4538-8b16-8ded1eb1cf7c service swift] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:40.990393 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1249/2470] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 13:40:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:40:41.247890 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1804a-36ce-400d-b872-e94871dba065 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:41.257733 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1804a-36ce-400d-b872-e94871dba065 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:41.261302 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2785e-e542-4c8a-adf0-cce898079326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:41.261925 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2785e-e542-4c8a-adf0-cce898079326 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:41.262204 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2785e-e542-4c8a-adf0-cce898079326 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:41.262480 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2785e-e542-4c8a-adf0-cce898079326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:41.264465 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7ef2785e-e542-4c8a-adf0-cce898079326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:41.276338 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2785e-e542-4c8a-adf0-cce898079326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:41.277954 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2785e-e542-4c8a-adf0-cce898079326 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:41.287124 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1222/2471] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:40:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:40:42.713998 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3780d-912c-4538-8b16-8ded1eb1cf7c service swift] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:42.718568 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-52c3780d-912c-4538-8b16-8ded1eb1cf7c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:42.732357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3780d-912c-4538-8b16-8ded1eb1cf7c service swift] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:42.740021 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80f59d-a24d-4070-9125-7eeabad2f552 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b917ce4f7f34b289218f7d36a43983e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:42.747478 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80f59d-a24d-4070-9125-7eeabad2f552 service placement] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:42.747478 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80f59d-a24d-4070-9125-7eeabad2f552 service placement] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:42.747478 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80f59d-a24d-4070-9125-7eeabad2f552 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:42.747478 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-cc80f59d-a24d-4070-9125-7eeabad2f552 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:42.769718 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80f59d-a24d-4070-9125-7eeabad2f552 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:42.771549 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80f59d-a24d-4070-9125-7eeabad2f552 service placement] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:42.784491 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1250/2472] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:40:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:40:43.170035 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2785e-e542-4c8a-adf0-cce898079326 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:43.171524 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7ef2785e-e542-4c8a-adf0-cce898079326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:43.187553 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2785e-e542-4c8a-adf0-cce898079326 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:43.193974 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb479d13-d12f-4314-adfd-8fc01cadc9ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:43.194639 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb479d13-d12f-4314-adfd-8fc01cadc9ac service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:43.194928 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb479d13-d12f-4314-adfd-8fc01cadc9ac service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:43.195206 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb479d13-d12f-4314-adfd-8fc01cadc9ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:43.197323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-cb479d13-d12f-4314-adfd-8fc01cadc9ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:43.214327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb479d13-d12f-4314-adfd-8fc01cadc9ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:43.216042 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb479d13-d12f-4314-adfd-8fc01cadc9ac service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:43.230022 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1223/2473] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:40:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:40:43.664321 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80f59d-a24d-4070-9125-7eeabad2f552 service placement] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:43.677448 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80f59d-a24d-4070-9125-7eeabad2f552 service placement] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:43.681139 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dcaa1-2672-4ac4-bd8b-50c43a63f91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:43.682445 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dcaa1-2672-4ac4-bd8b-50c43a63f91d service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:43.682959 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dcaa1-2672-4ac4-bd8b-50c43a63f91d service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:43.683436 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dcaa1-2672-4ac4-bd8b-50c43a63f91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:43.685609 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-8b0dcaa1-2672-4ac4-bd8b-50c43a63f91d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:43.699899 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dcaa1-2672-4ac4-bd8b-50c43a63f91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:43.701486 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dcaa1-2672-4ac4-bd8b-50c43a63f91d service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:43.712156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1251/2474] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:40:43.837970 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d79134-ab1d-4ace-9744-1bcd3dc23c6c None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:43.838700 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d79134-ab1d-4ace-9744-1bcd3dc23c6c None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:43.839174 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d79134-ab1d-4ace-9744-1bcd3dc23c6c None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:43.841262 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1224/2475] 10.222.0.52 () {54 vars in 912 bytes} [Tue Mar 8 13:40:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:43.846952 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7accfad-8454-4c68-83c9-ce56d782a5d6 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:43.848591 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7accfad-8454-4c68-83c9-ce56d782a5d6 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:43.849196 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7accfad-8454-4c68-83c9-ce56d782a5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:43.895811 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-d7accfad-8454-4c68-83c9-ce56d782a5d6 None None] MFA Rules not processed for user `9b917ce4f7f34b289218f7d36a43983e`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:43.897601 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-d7accfad-8454-4c68-83c9-ce56d782a5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:43.913369 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1252/2476] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 13:40:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:40:43.938812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d79134-ab1d-4ace-9744-1bcd3dc23c6c None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:43.957998 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d79134-ab1d-4ace-9744-1bcd3dc23c6c None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:43.965099 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc743973-68e7-4805-9890-ff43331d89ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b917ce4f7f34b289218f7d36a43983e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:43.966198 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc743973-68e7-4805-9890-ff43331d89ac service placement] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:43.966756 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc743973-68e7-4805-9890-ff43331d89ac service placement] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:43.967205 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc743973-68e7-4805-9890-ff43331d89ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:43.980560 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc743973-68e7-4805-9890-ff43331d89ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:43.982866 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc743973-68e7-4805-9890-ff43331d89ac service placement] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:43.996554 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1225/2477] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:40:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:40:50.694629 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df7c2f-a6e5-4d77-af67-6c65db616bf1 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:50.695147 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df7c2f-a6e5-4d77-af67-6c65db616bf1 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:50.695286 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df7c2f-a6e5-4d77-af67-6c65db616bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:50.721431 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-25df7c2f-a6e5-4d77-af67-6c65db616bf1 None None] MFA Rules not processed for user `ced48ea897124de6b874e797b6d74f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:50.723432 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-25df7c2f-a6e5-4d77-af67-6c65db616bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:50.730656 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1253/2478] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:40:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:40:53.526028 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc743973-68e7-4805-9890-ff43331d89ac service placement] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:53.538976 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc743973-68e7-4805-9890-ff43331d89ac service placement] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:53.544728 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10e9b7-a4a9-4096-b0ec-42774ed45ef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:53.545450 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10e9b7-a4a9-4096-b0ec-42774ed45ef4 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:53.545801 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10e9b7-a4a9-4096-b0ec-42774ed45ef4 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:53.546146 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10e9b7-a4a9-4096-b0ec-42774ed45ef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:53.548019 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1c10e9b7-a4a9-4096-b0ec-42774ed45ef4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:53.561477 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10e9b7-a4a9-4096-b0ec-42774ed45ef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:53.563182 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10e9b7-a4a9-4096-b0ec-42774ed45ef4 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:53.575947 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1226/2479] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:40:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:40:54.600167 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df7c2f-a6e5-4d77-af67-6c65db616bf1 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:54.603315 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-25df7c2f-a6e5-4d77-af67-6c65db616bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:54.647997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df7c2f-a6e5-4d77-af67-6c65db616bf1 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:54.661553 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c36490-dc92-463d-aa55-629657732913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:54.662624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c36490-dc92-463d-aa55-629657732913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:54.662978 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c36490-dc92-463d-aa55-629657732913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:54.663327 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c36490-dc92-463d-aa55-629657732913 admin admin] PATH_INFO: `/v3/users/f98c597d9e1a45e7bd8267b730a0b84b` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:54.691424 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c36490-dc92-463d-aa55-629657732913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f98c597d9e1a45e7bd8267b730a0b84b)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:54.694099 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c36490-dc92-463d-aa55-629657732913 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:54.907846 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-31c36490-dc92-463d-aa55-629657732913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f98c597d9e1a45e7bd8267b730a0b84b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:40:54.920107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-31c36490-dc92-463d-aa55-629657732913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f98c597d9e1a45e7bd8267b730a0b84b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:40:54.921105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-31c36490-dc92-463d-aa55-629657732913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f98c597d9e1a45e7bd8267b730a0b84b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:40:54.921918 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-31c36490-dc92-463d-aa55-629657732913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f98c597d9e1a45e7bd8267b730a0b84b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:40:54.930650 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-31c36490-dc92-463d-aa55-629657732913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f98c597d9e1a45e7bd8267b730a0b84b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:40:55.013877 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1254/2480] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:40:54 2022] DELETE /identity/v3/users/f98c597d9e1a45e7bd8267b730a0b84b => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:40:55.315612 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10e9b7-a4a9-4096-b0ec-42774ed45ef4 service nova] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:55.326993 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10e9b7-a4a9-4096-b0ec-42774ed45ef4 service nova] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:55.399609 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945837c-6f35-41fa-a18e-67330d7d7658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:55.400486 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945837c-6f35-41fa-a18e-67330d7d7658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:55.400812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945837c-6f35-41fa-a18e-67330d7d7658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:55.401714 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945837c-6f35-41fa-a18e-67330d7d7658 admin admin] PATH_INFO: `/v3/projects/52fda171a20f4fe3b366624e9c26e12a` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:55.413469 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945837c-6f35-41fa-a18e-67330d7d7658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52fda171a20f4fe3b366624e9c26e12a)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:55.415437 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945837c-6f35-41fa-a18e-67330d7d7658 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:55.610025 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f945837c-6f35-41fa-a18e-67330d7d7658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52fda171a20f4fe3b366624e9c26e12a', 'request_id': 'req-f945837c-6f35-41fa-a18e-67330d7d7658'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:40:55.710705 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f945837c-6f35-41fa-a18e-67330d7d7658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52fda171a20f4fe3b366624e9c26e12a', 'request_id': 'req-f945837c-6f35-41fa-a18e-67330d7d7658'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:40:55.716812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f945837c-6f35-41fa-a18e-67330d7d7658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52fda171a20f4fe3b366624e9c26e12a', 'request_id': 'req-f945837c-6f35-41fa-a18e-67330d7d7658'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:40:55.728533 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f945837c-6f35-41fa-a18e-67330d7d7658 admin admin] The token cache is being invalidate because project 52fda171a20f4fe3b366624e9c26e12a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:40:55.729088 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f945837c-6f35-41fa-a18e-67330d7d7658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:40:55.729737 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f945837c-6f35-41fa-a18e-67330d7d7658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:40:55.731353 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1227/2481] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:40:55 2022] DELETE /identity/v3/projects/52fda171a20f4fe3b366624e9c26e12a => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:40:55.735657 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c36490-dc92-463d-aa55-629657732913 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:55.737125 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-31c36490-dc92-463d-aa55-629657732913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:55.750865 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c36490-dc92-463d-aa55-629657732913 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:55.806597 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09382604-1b6e-44d3-b818-5ca32a83423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:55.807478 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09382604-1b6e-44d3-b818-5ca32a83423e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:55.807767 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09382604-1b6e-44d3-b818-5ca32a83423e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:55.808038 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09382604-1b6e-44d3-b818-5ca32a83423e admin admin] PATH_INFO: `/v3/users/477824a6ae014cca9d5668a845e2a1de` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:55.824383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09382604-1b6e-44d3-b818-5ca32a83423e admin admin] RBAC: Authorizing `identity:delete_user(user_id=477824a6ae014cca9d5668a845e2a1de)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:55.826351 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09382604-1b6e-44d3-b818-5ca32a83423e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:56.067714 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-09382604-1b6e-44d3-b818-5ca32a83423e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '477824a6ae014cca9d5668a845e2a1de'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:40:56.078953 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-09382604-1b6e-44d3-b818-5ca32a83423e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '477824a6ae014cca9d5668a845e2a1de'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:40:56.079608 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-09382604-1b6e-44d3-b818-5ca32a83423e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '477824a6ae014cca9d5668a845e2a1de'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:40:56.080200 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-09382604-1b6e-44d3-b818-5ca32a83423e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '477824a6ae014cca9d5668a845e2a1de'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:40:56.086994 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-09382604-1b6e-44d3-b818-5ca32a83423e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '477824a6ae014cca9d5668a845e2a1de'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:40:56.210649 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1255/2482] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:40:55 2022] DELETE /identity/v3/users/477824a6ae014cca9d5668a845e2a1de => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:40:56.495009 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945837c-6f35-41fa-a18e-67330d7d7658 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:56.496776 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f945837c-6f35-41fa-a18e-67330d7d7658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:56.512211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945837c-6f35-41fa-a18e-67330d7d7658 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:56.597429 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d0617-1808-4b07-b1bf-7a94e9ebdfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:56.599039 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d0617-1808-4b07-b1bf-7a94e9ebdfe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:56.600505 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d0617-1808-4b07-b1bf-7a94e9ebdfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:56.602167 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d0617-1808-4b07-b1bf-7a94e9ebdfe9 admin admin] PATH_INFO: `/v3/projects/3de6173449844b499d3ea695164d0db9` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:56.627029 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d0617-1808-4b07-b1bf-7a94e9ebdfe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de6173449844b499d3ea695164d0db9)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:56.629346 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d0617-1808-4b07-b1bf-7a94e9ebdfe9 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:56.867988 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-735d0617-1808-4b07-b1bf-7a94e9ebdfe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de6173449844b499d3ea695164d0db9', 'request_id': 'req-735d0617-1808-4b07-b1bf-7a94e9ebdfe9'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:40:56.991278 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-735d0617-1808-4b07-b1bf-7a94e9ebdfe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de6173449844b499d3ea695164d0db9', 'request_id': 'req-735d0617-1808-4b07-b1bf-7a94e9ebdfe9'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:40:56.998399 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-735d0617-1808-4b07-b1bf-7a94e9ebdfe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de6173449844b499d3ea695164d0db9', 'request_id': 'req-735d0617-1808-4b07-b1bf-7a94e9ebdfe9'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:40:57.013754 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-735d0617-1808-4b07-b1bf-7a94e9ebdfe9 admin admin] The token cache is being invalidate because project 3de6173449844b499d3ea695164d0db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:40:57.014041 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-735d0617-1808-4b07-b1bf-7a94e9ebdfe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:40:57.014910 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-735d0617-1808-4b07-b1bf-7a94e9ebdfe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:40:57.020838 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1228/2483] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:40:56 2022] DELETE /identity/v3/projects/3de6173449844b499d3ea695164d0db9 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:41:33.344773 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09382604-1b6e-44d3-b818-5ca32a83423e admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:41:33.346170 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-09382604-1b6e-44d3-b818-5ca32a83423e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:41:33.423737 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09382604-1b6e-44d3-b818-5ca32a83423e admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:41:33.483780 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9b262-4c5a-4869-9f8f-f239acbbd155 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:41:33.484702 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9b262-4c5a-4869-9f8f-f239acbbd155 service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:33.484988 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9b262-4c5a-4869-9f8f-f239acbbd155 service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:33.485264 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9b262-4c5a-4869-9f8f-f239acbbd155 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:33.487026 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-6af9b262-4c5a-4869-9f8f-f239acbbd155 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:41:33.563772 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9b262-4c5a-4869-9f8f-f239acbbd155 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:41:33.566269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9b262-4c5a-4869-9f8f-f239acbbd155 service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:41:33.593813 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1256/2484] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:41:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:41:40.670434 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d0617-1808-4b07-b1bf-7a94e9ebdfe9 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:41:40.671870 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-735d0617-1808-4b07-b1bf-7a94e9ebdfe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:41:40.727059 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d0617-1808-4b07-b1bf-7a94e9ebdfe9 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:41:40.731487 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec328013-7895-4858-9d16-c36ad192980c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:41:40.732204 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328013-7895-4858-9d16-c36ad192980c service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:40.732687 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328013-7895-4858-9d16-c36ad192980c service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:40.732984 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328013-7895-4858-9d16-c36ad192980c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:40.735045 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-ec328013-7895-4858-9d16-c36ad192980c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:41:40.798196 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec328013-7895-4858-9d16-c36ad192980c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:41:40.799658 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec328013-7895-4858-9d16-c36ad192980c service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:41:40.809020 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1229/2485] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:41:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:42:40.683823 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9b262-4c5a-4869-9f8f-f239acbbd155 service nova] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:40.685293 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-6af9b262-4c5a-4869-9f8f-f239acbbd155 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:42:40.748377 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9b262-4c5a-4869-9f8f-f239acbbd155 service nova] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:40.751923 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d952a5-7a85-4736-b5ba-4d0eb4398e96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:40.752563 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d952a5-7a85-4736-b5ba-4d0eb4398e96 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:40.752882 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d952a5-7a85-4736-b5ba-4d0eb4398e96 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:40.753157 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d952a5-7a85-4736-b5ba-4d0eb4398e96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:40.754982 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e4d952a5-7a85-4736-b5ba-4d0eb4398e96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:42:40.817666 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d952a5-7a85-4736-b5ba-4d0eb4398e96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:40.819163 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d952a5-7a85-4736-b5ba-4d0eb4398e96 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:40.829063 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1257/2486] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:42:41.670002 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec328013-7895-4858-9d16-c36ad192980c service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:41.673255 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-ec328013-7895-4858-9d16-c36ad192980c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:42:41.697634 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec328013-7895-4858-9d16-c36ad192980c service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:41.702880 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8cb1b-01c8-4142-847b-4b30f1d59560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:41.703759 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8cb1b-01c8-4142-847b-4b30f1d59560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:41.704044 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8cb1b-01c8-4142-847b-4b30f1d59560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:41.704321 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8cb1b-01c8-4142-847b-4b30f1d59560 admin admin] PATH_INFO: `/v3/users/75caec29f3b7480982d90bb45d99ed99` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:41.705550 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8cb1b-01c8-4142-847b-4b30f1d59560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75caec29f3b7480982d90bb45d99ed99)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:41.707554 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8cb1b-01c8-4142-847b-4b30f1d59560 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:41.998036 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-59e8cb1b-01c8-4142-847b-4b30f1d59560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75caec29f3b7480982d90bb45d99ed99'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:42:42.009439 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-59e8cb1b-01c8-4142-847b-4b30f1d59560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75caec29f3b7480982d90bb45d99ed99'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:42:42.010205 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-59e8cb1b-01c8-4142-847b-4b30f1d59560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75caec29f3b7480982d90bb45d99ed99'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:42:42.088430 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-59e8cb1b-01c8-4142-847b-4b30f1d59560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75caec29f3b7480982d90bb45d99ed99'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:42:42.089202 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-59e8cb1b-01c8-4142-847b-4b30f1d59560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75caec29f3b7480982d90bb45d99ed99'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:42:42.101210 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1230/2487] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:42:41 2022] DELETE /identity/v3/users/75caec29f3b7480982d90bb45d99ed99 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:42:42.347264 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d952a5-7a85-4736-b5ba-4d0eb4398e96 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:42.357637 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d952a5-7a85-4736-b5ba-4d0eb4398e96 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:42.414582 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb801d-3208-452b-b62e-d8c4958c306b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:42.415432 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb801d-3208-452b-b62e-d8c4958c306b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:42.415710 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb801d-3208-452b-b62e-d8c4958c306b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:42.416040 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb801d-3208-452b-b62e-d8c4958c306b admin admin] PATH_INFO: `/v3/projects/818c00532bbc4962bd1b3ea89d1edcf5` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:42.417430 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb801d-3208-452b-b62e-d8c4958c306b admin admin] RBAC: Authorizing `identity:delete_project(project_id=818c00532bbc4962bd1b3ea89d1edcf5)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:42.419339 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb801d-3208-452b-b62e-d8c4958c306b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:42.705289 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d5eb801d-3208-452b-b62e-d8c4958c306b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818c00532bbc4962bd1b3ea89d1edcf5', 'request_id': 'req-d5eb801d-3208-452b-b62e-d8c4958c306b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:42:42.710632 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d5eb801d-3208-452b-b62e-d8c4958c306b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818c00532bbc4962bd1b3ea89d1edcf5', 'request_id': 'req-d5eb801d-3208-452b-b62e-d8c4958c306b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:42:42.717015 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d5eb801d-3208-452b-b62e-d8c4958c306b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818c00532bbc4962bd1b3ea89d1edcf5', 'request_id': 'req-d5eb801d-3208-452b-b62e-d8c4958c306b'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:42:42.853094 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d5eb801d-3208-452b-b62e-d8c4958c306b admin admin] The token cache is being invalidate because project 818c00532bbc4962bd1b3ea89d1edcf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:42:42.853308 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d5eb801d-3208-452b-b62e-d8c4958c306b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:42:42.854279 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d5eb801d-3208-452b-b62e-d8c4958c306b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:42:42.855969 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1258/2488] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:42:42 2022] DELETE /identity/v3/projects/818c00532bbc4962bd1b3ea89d1edcf5 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:42:42.862949 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862c323-c1cb-4b8f-b5b7-0cd9c8b106eb None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:42.863514 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862c323-c1cb-4b8f-b5b7-0cd9c8b106eb None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:42.863514 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862c323-c1cb-4b8f-b5b7-0cd9c8b106eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:42.881355 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-f862c323-c1cb-4b8f-b5b7-0cd9c8b106eb None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:42:42.882840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f862c323-c1cb-4b8f-b5b7-0cd9c8b106eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:42:42.941251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1231/2489] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:42:42.949979 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de0d32-2194-404f-992f-5985ee95a17c None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:42.958072 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de0d32-2194-404f-992f-5985ee95a17c None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:42.958072 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de0d32-2194-404f-992f-5985ee95a17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:42.969481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-00de0d32-2194-404f-992f-5985ee95a17c None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:42:42.970685 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-00de0d32-2194-404f-992f-5985ee95a17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:42:42.979197 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1259/2490] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:42:42.985783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862c323-c1cb-4b8f-b5b7-0cd9c8b106eb None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:42.996322 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862c323-c1cb-4b8f-b5b7-0cd9c8b106eb None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:43.000964 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209d180-b4af-4f32-acdb-05039f2918f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:43.003815 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209d180-b4af-4f32-acdb-05039f2918f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:43.003815 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209d180-b4af-4f32-acdb-05039f2918f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:43.003815 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209d180-b4af-4f32-acdb-05039f2918f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:43.003815 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209d180-b4af-4f32-acdb-05039f2918f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:43.003815 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209d180-b4af-4f32-acdb-05039f2918f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:43.004819 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209d180-b4af-4f32-acdb-05039f2918f0 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:43.016708 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1232/2491] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:43.021052 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de0d32-2194-404f-992f-5985ee95a17c None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:43.030426 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de0d32-2194-404f-992f-5985ee95a17c None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:43.035035 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73915014-9f80-4a05-a1d8-4ed83bab04d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:43.035673 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73915014-9f80-4a05-a1d8-4ed83bab04d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:43.035960 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73915014-9f80-4a05-a1d8-4ed83bab04d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:43.036232 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73915014-9f80-4a05-a1d8-4ed83bab04d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:43.036995 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73915014-9f80-4a05-a1d8-4ed83bab04d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:43.038893 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73915014-9f80-4a05-a1d8-4ed83bab04d5 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:43.180334 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1260/2492] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:42:43 2022] POST /identity/v3/projects => generated 369 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:42:43.192246 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209d180-b4af-4f32-acdb-05039f2918f0 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:43.195789 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209d180-b4af-4f32-acdb-05039f2918f0 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:43.249722 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e553ad-c493-4def-8371-7f73ac00eb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:43.250363 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e553ad-c493-4def-8371-7f73ac00eb99 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:43.250646 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e553ad-c493-4def-8371-7f73ac00eb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:43.250924 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e553ad-c493-4def-8371-7f73ac00eb99 admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:43.251604 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e553ad-c493-4def-8371-7f73ac00eb99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:43.253630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e553ad-c493-4def-8371-7f73ac00eb99 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:43.402913 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1233/2493] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:42:43 2022] POST /identity/v3/users => generated 285 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:42:43.406983 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73915014-9f80-4a05-a1d8-4ed83bab04d5 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:43.418465 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73915014-9f80-4a05-a1d8-4ed83bab04d5 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:43.422910 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccf803-5983-4e8d-9e09-9a694398ad4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:43.423650 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccf803-5983-4e8d-9e09-9a694398ad4e admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:43.423926 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccf803-5983-4e8d-9e09-9a694398ad4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:43.424195 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccf803-5983-4e8d-9e09-9a694398ad4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:43.424963 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccf803-5983-4e8d-9e09-9a694398ad4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:43.426564 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccf803-5983-4e8d-9e09-9a694398ad4e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:43.437132 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1261/2494] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:42:43.441063 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e553ad-c493-4def-8371-7f73ac00eb99 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:43.451177 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e553ad-c493-4def-8371-7f73ac00eb99 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:43.455862 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d0c2e-06b4-4151-9b87-0faea14a3bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:43.456514 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d0c2e-06b4-4151-9b87-0faea14a3bfa admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:43.456836 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d0c2e-06b4-4151-9b87-0faea14a3bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:43.457122 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d0c2e-06b4-4151-9b87-0faea14a3bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:43.457878 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d0c2e-06b4-4151-9b87-0faea14a3bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:43.459715 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d0c2e-06b4-4151-9b87-0faea14a3bfa admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:43.470331 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1234/2495] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:42:43.474333 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccf803-5983-4e8d-9e09-9a694398ad4e admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:43.485156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccf803-5983-4e8d-9e09-9a694398ad4e admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:43.489551 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1b771-d284-4d23-86b4-9221e200744b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:43.490641 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1b771-d284-4d23-86b4-9221e200744b admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:43.490923 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1b771-d284-4d23-86b4-9221e200744b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:43.491195 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1b771-d284-4d23-86b4-9221e200744b admin admin] PATH_INFO: `/v3/projects/46f8ff42cdc044eca86dc2472e1f7ffd/users/fc9d8cc61b444709a7148aa0d479b62b/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:43.505119 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1b771-d284-4d23-86b4-9221e200744b admin admin] RBAC: Authorizing `identity:create_grant(project_id=46f8ff42cdc044eca86dc2472e1f7ffd, user_id=fc9d8cc61b444709a7148aa0d479b62b, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:43.507748 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1b771-d284-4d23-86b4-9221e200744b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:43.613611 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1262/2496] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:42:43 2022] PUT /identity/v3/projects/46f8ff42cdc044eca86dc2472e1f7ffd/users/fc9d8cc61b444709a7148aa0d479b62b/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:42:43.623595 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331d995-262e-46c6-ac23-c200e2da64e3 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:43.623911 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331d995-262e-46c6-ac23-c200e2da64e3 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:43.624191 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331d995-262e-46c6-ac23-c200e2da64e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:43.651513 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-6331d995-262e-46c6-ac23-c200e2da64e3 None None] MFA Rules not processed for user `fc9d8cc61b444709a7148aa0d479b62b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:42:43.652752 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6331d995-262e-46c6-ac23-c200e2da64e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:42:43.716103 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1235/2497] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:42:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:42:43.727717 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1b771-d284-4d23-86b4-9221e200744b admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:43.730082 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-24e1b771-d284-4d23-86b4-9221e200744b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:42:43.807612 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1b771-d284-4d23-86b4-9221e200744b admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:43.811322 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de94637-c363-4f67-b672-4c5257a38ab4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81124c3324d7427a9f29270b88e88f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:43.811967 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de94637-c363-4f67-b672-4c5257a38ab4 service glance] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:43.812251 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de94637-c363-4f67-b672-4c5257a38ab4 service glance] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:43.812531 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de94637-c363-4f67-b672-4c5257a38ab4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:43.820743 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de94637-c363-4f67-b672-4c5257a38ab4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:43.822716 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de94637-c363-4f67-b672-4c5257a38ab4 service glance] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:43.831275 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1263/2498] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:42:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:43:05.450934 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331d995-262e-46c6-ac23-c200e2da64e3 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:43:05.452914 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6331d995-262e-46c6-ac23-c200e2da64e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:43:05.595478 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331d995-262e-46c6-ac23-c200e2da64e3 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:43:05.600831 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fef54a-8573-417c-b3ba-af3cd359b704 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b917ce4f7f34b289218f7d36a43983e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:43:05.601415 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fef54a-8573-417c-b3ba-af3cd359b704 service placement] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:43:05.601693 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fef54a-8573-417c-b3ba-af3cd359b704 service placement] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:43:05.601961 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fef54a-8573-417c-b3ba-af3cd359b704 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:43:05.604069 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b3fef54a-8573-417c-b3ba-af3cd359b704 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:43:05.616073 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fef54a-8573-417c-b3ba-af3cd359b704 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:43:05.617721 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fef54a-8573-417c-b3ba-af3cd359b704 service placement] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:43:05.628291 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1236/2499] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:43:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:44:33.698703 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de94637-c363-4f67-b672-4c5257a38ab4 service glance] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:44:33.700101 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-6de94637-c363-4f67-b672-4c5257a38ab4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:33.764718 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de94637-c363-4f67-b672-4c5257a38ab4 service glance] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:44:33.768952 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf92ad-da9c-4b12-a02e-c97f683f2308 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:44:33.769589 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf92ad-da9c-4b12-a02e-c97f683f2308 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:33.769870 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf92ad-da9c-4b12-a02e-c97f683f2308 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:33.770144 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf92ad-da9c-4b12-a02e-c97f683f2308 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:33.771901 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f1cf92ad-da9c-4b12-a02e-c97f683f2308 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:33.828010 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf92ad-da9c-4b12-a02e-c97f683f2308 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:44:33.829472 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf92ad-da9c-4b12-a02e-c97f683f2308 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:44:33.840280 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1264/2500] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:44:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:44:37.856082 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fef54a-8573-417c-b3ba-af3cd359b704 service placement] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:44:37.857764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b3fef54a-8573-417c-b3ba-af3cd359b704 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:37.910683 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fef54a-8573-417c-b3ba-af3cd359b704 service placement] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:44:37.914209 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06805921-ecf2-4767-865d-b8b73b84209a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:44:37.914840 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06805921-ecf2-4767-865d-b8b73b84209a service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:37.915118 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06805921-ecf2-4767-865d-b8b73b84209a service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:37.915390 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06805921-ecf2-4767-865d-b8b73b84209a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:37.917263 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-06805921-ecf2-4767-865d-b8b73b84209a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:37.997602 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06805921-ecf2-4767-865d-b8b73b84209a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:44:37.999065 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06805921-ecf2-4767-865d-b8b73b84209a service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:44:38.020527 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1237/2501] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:44:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:08.156937 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf92ad-da9c-4b12-a02e-c97f683f2308 service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:08.158887 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f1cf92ad-da9c-4b12-a02e-c97f683f2308 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:08.179657 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf92ad-da9c-4b12-a02e-c97f683f2308 service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:08.183179 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a002f4-d95a-4a3b-82bb-25f0ab62d449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:08.183812 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a002f4-d95a-4a3b-82bb-25f0ab62d449 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:08.184096 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a002f4-d95a-4a3b-82bb-25f0ab62d449 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:08.184374 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a002f4-d95a-4a3b-82bb-25f0ab62d449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:08.186210 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-59a002f4-d95a-4a3b-82bb-25f0ab62d449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:08.195572 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a002f4-d95a-4a3b-82bb-25f0ab62d449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:08.197077 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a002f4-d95a-4a3b-82bb-25f0ab62d449 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:08.205221 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1265/2502] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:35.198034 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06805921-ecf2-4767-865d-b8b73b84209a service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:35.215946 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06805921-ecf2-4767-865d-b8b73b84209a service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:35.219668 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b84fd-6a90-4c11-8f28-49bf517ff8dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:35.220374 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b84fd-6a90-4c11-8f28-49bf517ff8dd service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:35.220709 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b84fd-6a90-4c11-8f28-49bf517ff8dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:35.220992 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b84fd-6a90-4c11-8f28-49bf517ff8dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:35.222744 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-242b84fd-6a90-4c11-8f28-49bf517ff8dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:35.236268 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b84fd-6a90-4c11-8f28-49bf517ff8dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:35.237655 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b84fd-6a90-4c11-8f28-49bf517ff8dd service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:35.248348 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1238/2503] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:46:33.743742 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a002f4-d95a-4a3b-82bb-25f0ab62d449 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:46:33.745253 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-59a002f4-d95a-4a3b-82bb-25f0ab62d449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:33.760377 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a002f4-d95a-4a3b-82bb-25f0ab62d449 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:46:33.765811 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c557e-5c86-452e-84c8-111944a2819a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:46:33.766927 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c557e-5c86-452e-84c8-111944a2819a service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:33.767211 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c557e-5c86-452e-84c8-111944a2819a service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:33.767485 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c557e-5c86-452e-84c8-111944a2819a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:33.769221 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9b5c557e-5c86-452e-84c8-111944a2819a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:33.824666 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c557e-5c86-452e-84c8-111944a2819a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:46:33.826306 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c557e-5c86-452e-84c8-111944a2819a service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:46:33.835205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1266/2504] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:46:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:46:35.407986 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b84fd-6a90-4c11-8f28-49bf517ff8dd service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:46:35.409406 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-242b84fd-6a90-4c11-8f28-49bf517ff8dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:35.441832 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b84fd-6a90-4c11-8f28-49bf517ff8dd service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:46:35.445405 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291aa743-8b98-4432-95b2-79f194de278c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:46:35.446028 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291aa743-8b98-4432-95b2-79f194de278c service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:35.446651 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291aa743-8b98-4432-95b2-79f194de278c service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:35.446931 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291aa743-8b98-4432-95b2-79f194de278c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:35.448692 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-291aa743-8b98-4432-95b2-79f194de278c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:35.523466 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291aa743-8b98-4432-95b2-79f194de278c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:46:35.524940 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291aa743-8b98-4432-95b2-79f194de278c service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:46:35.542674 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1239/2505] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:46:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:46:35.618270 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c557e-5c86-452e-84c8-111944a2819a service nova] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:46:35.627943 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c557e-5c86-452e-84c8-111944a2819a service nova] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:46:35.631448 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1ff01-8f13-4e57-8a36-661fc11d36ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:46:35.632084 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1ff01-8f13-4e57-8a36-661fc11d36ad service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:35.632366 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1ff01-8f13-4e57-8a36-661fc11d36ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:35.632642 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1ff01-8f13-4e57-8a36-661fc11d36ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:35.634410 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-c0b1ff01-8f13-4e57-8a36-661fc11d36ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:35.691999 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1ff01-8f13-4e57-8a36-661fc11d36ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:46:35.693459 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1ff01-8f13-4e57-8a36-661fc11d36ad service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:46:35.703146 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1267/2506] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:46:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:46:37.513107 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291aa743-8b98-4432-95b2-79f194de278c service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:46:37.526918 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291aa743-8b98-4432-95b2-79f194de278c service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:46:37.533965 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bbf85-6530-434e-b028-46ba1be2a9b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:46:37.536381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bbf85-6530-434e-b028-46ba1be2a9b1 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:37.536381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bbf85-6530-434e-b028-46ba1be2a9b1 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:37.536381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bbf85-6530-434e-b028-46ba1be2a9b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:37.537793 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-577bbf85-6530-434e-b028-46ba1be2a9b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:37.551768 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bbf85-6530-434e-b028-46ba1be2a9b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:46:37.553438 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bbf85-6530-434e-b028-46ba1be2a9b1 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:46:37.565080 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1240/2507] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:46:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:48:09.453349 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1ff01-8f13-4e57-8a36-661fc11d36ad service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:48:09.464511 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1ff01-8f13-4e57-8a36-661fc11d36ad service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:48:09.469409 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490cfd44-bcf7-4c0c-ac62-23b6d73eeefc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b917ce4f7f34b289218f7d36a43983e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:48:09.470037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cfd44-bcf7-4c0c-ac62-23b6d73eeefc service placement] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:09.470318 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cfd44-bcf7-4c0c-ac62-23b6d73eeefc service placement] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:09.470601 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cfd44-bcf7-4c0c-ac62-23b6d73eeefc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:09.479475 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490cfd44-bcf7-4c0c-ac62-23b6d73eeefc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:48:09.481133 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490cfd44-bcf7-4c0c-ac62-23b6d73eeefc service placement] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:48:09.490907 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1268/2508] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:48:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:48:36.014688 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bbf85-6530-434e-b028-46ba1be2a9b1 service nova] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:48:36.023659 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bbf85-6530-434e-b028-46ba1be2a9b1 service nova] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:48:36.027356 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137072c-b64b-435a-b7b6-4f177ebba2c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:48:36.027981 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137072c-b64b-435a-b7b6-4f177ebba2c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:36.028269 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137072c-b64b-435a-b7b6-4f177ebba2c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:36.028815 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137072c-b64b-435a-b7b6-4f177ebba2c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:36.036802 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137072c-b64b-435a-b7b6-4f177ebba2c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:48:36.038226 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137072c-b64b-435a-b7b6-4f177ebba2c1 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:48:36.046712 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1241/2509] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:48:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:48:38.655156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490cfd44-bcf7-4c0c-ac62-23b6d73eeefc service placement] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:48:38.676880 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490cfd44-bcf7-4c0c-ac62-23b6d73eeefc service placement] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:48:38.690284 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8a589-9ed0-4a6a-9172-ce0661d3d561 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:48:38.692107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8a589-9ed0-4a6a-9172-ce0661d3d561 service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:38.693827 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8a589-9ed0-4a6a-9172-ce0661d3d561 service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:38.694310 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8a589-9ed0-4a6a-9172-ce0661d3d561 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:38.701055 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b0d8a589-9ed0-4a6a-9172-ce0661d3d561 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:48:38.745276 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8a589-9ed0-4a6a-9172-ce0661d3d561 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:48:38.745276 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8a589-9ed0-4a6a-9172-ce0661d3d561 service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:48:38.779567 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1269/2510] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:48:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:48:44.399488 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72438f1-4812-41c5-a9ff-b014d68fbb0e None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:44.400036 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72438f1-4812-41c5-a9ff-b014d68fbb0e None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:44.400036 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72438f1-4812-41c5-a9ff-b014d68fbb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:44.417132 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-c72438f1-4812-41c5-a9ff-b014d68fbb0e None None] MFA Rules not processed for user `728607c7138540d69532b0b806b9ccaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:48:44.418329 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c72438f1-4812-41c5-a9ff-b014d68fbb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:48:44.425191 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1242/2511] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:48:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:48:44.727382 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8a589-9ed0-4a6a-9172-ce0661d3d561 service nova] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:48:44.736939 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8a589-9ed0-4a6a-9172-ce0661d3d561 service nova] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:48:44.740349 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97774b6-9969-450e-bfff-e880756ab730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:48:44.740999 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97774b6-9969-450e-bfff-e880756ab730 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:44.741279 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97774b6-9969-450e-bfff-e880756ab730 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:44.741551 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97774b6-9969-450e-bfff-e880756ab730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:44.743826 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-c97774b6-9969-450e-bfff-e880756ab730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:48:44.764728 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97774b6-9969-450e-bfff-e880756ab730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:48:44.766142 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97774b6-9969-450e-bfff-e880756ab730 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:48:44.774020 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1270/2512] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:48:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:48:45.184651 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72438f1-4812-41c5-a9ff-b014d68fbb0e None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:48:45.186168 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c72438f1-4812-41c5-a9ff-b014d68fbb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:48:45.200973 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72438f1-4812-41c5-a9ff-b014d68fbb0e None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:48:45.205872 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba40f0d-b293-4583-9b17-856385c6832a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b917ce4f7f34b289218f7d36a43983e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:48:45.206537 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba40f0d-b293-4583-9b17-856385c6832a service placement] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:45.206817 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba40f0d-b293-4583-9b17-856385c6832a service placement] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:45.207089 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba40f0d-b293-4583-9b17-856385c6832a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:45.208880 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6ba40f0d-b293-4583-9b17-856385c6832a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:48:45.220994 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba40f0d-b293-4583-9b17-856385c6832a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:48:45.225972 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba40f0d-b293-4583-9b17-856385c6832a service placement] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:48:45.237220 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1243/2513] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:48:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:48:54.256591 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97774b6-9969-450e-bfff-e880756ab730 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:48:54.258364 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-c97774b6-9969-450e-bfff-e880756ab730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:48:54.273813 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97774b6-9969-450e-bfff-e880756ab730 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:48:54.279229 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb50403-afed-43e5-95a9-9f8751153979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:48:54.279864 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb50403-afed-43e5-95a9-9f8751153979 service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:54.280144 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb50403-afed-43e5-95a9-9f8751153979 service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:54.280419 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb50403-afed-43e5-95a9-9f8751153979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:54.282131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0fb50403-afed-43e5-95a9-9f8751153979 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:48:54.294552 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb50403-afed-43e5-95a9-9f8751153979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:48:54.296126 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb50403-afed-43e5-95a9-9f8751153979 service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:48:54.306981 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1271/2514] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:48:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:49:39.067632 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba40f0d-b293-4583-9b17-856385c6832a service placement] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:49:39.077756 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba40f0d-b293-4583-9b17-856385c6832a service placement] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:49:39.081432 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264756b-bd4f-4851-8b11-49dd1103f3bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:49:39.082124 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264756b-bd4f-4851-8b11-49dd1103f3bb service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:49:39.082458 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264756b-bd4f-4851-8b11-49dd1103f3bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:49:39.082731 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264756b-bd4f-4851-8b11-49dd1103f3bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:49:39.093270 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264756b-bd4f-4851-8b11-49dd1103f3bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:49:39.094806 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264756b-bd4f-4851-8b11-49dd1103f3bb service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:49:39.105676 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1244/2515] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:49:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:50:14.155539 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb50403-afed-43e5-95a9-9f8751153979 service nova] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:50:14.165944 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb50403-afed-43e5-95a9-9f8751153979 service nova] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:50:14.169848 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949c789-c439-4657-a442-e6388685c171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:50:14.170507 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949c789-c439-4657-a442-e6388685c171 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:14.170789 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949c789-c439-4657-a442-e6388685c171 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:14.171069 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949c789-c439-4657-a442-e6388685c171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:14.180681 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949c789-c439-4657-a442-e6388685c171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:50:14.184113 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949c789-c439-4657-a442-e6388685c171 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:50:14.197842 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1272/2516] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:50:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:50:35.071768 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264756b-bd4f-4851-8b11-49dd1103f3bb service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:50:35.080168 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264756b-bd4f-4851-8b11-49dd1103f3bb service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:50:35.084347 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b06aa-70c2-4499-8031-8942424d27ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:50:35.085013 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b06aa-70c2-4499-8031-8942424d27ad service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:35.085297 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b06aa-70c2-4499-8031-8942424d27ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:35.085572 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b06aa-70c2-4499-8031-8942424d27ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:35.095423 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b06aa-70c2-4499-8031-8942424d27ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:50:35.096881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b06aa-70c2-4499-8031-8942424d27ad service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:50:35.108816 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1245/2517] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:50:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:50:37.330084 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949c789-c439-4657-a442-e6388685c171 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:50:37.339974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949c789-c439-4657-a442-e6388685c171 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:50:37.348961 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc90373-13c7-44fa-9253-f561ec91fdca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:50:37.349717 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc90373-13c7-44fa-9253-f561ec91fdca service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:37.350141 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc90373-13c7-44fa-9253-f561ec91fdca service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:37.350416 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc90373-13c7-44fa-9253-f561ec91fdca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:37.359702 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc90373-13c7-44fa-9253-f561ec91fdca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:50:37.361165 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc90373-13c7-44fa-9253-f561ec91fdca service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:50:37.387693 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1273/2518] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:50:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:51:35.254624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b06aa-70c2-4499-8031-8942424d27ad service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:51:35.272120 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b06aa-70c2-4499-8031-8942424d27ad service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:51:35.277557 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669b88e-5d59-4e7b-a172-b44340e53488 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:51:35.278184 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669b88e-5d59-4e7b-a172-b44340e53488 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:51:35.278495 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669b88e-5d59-4e7b-a172-b44340e53488 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:51:35.278772 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669b88e-5d59-4e7b-a172-b44340e53488 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:51:35.287019 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669b88e-5d59-4e7b-a172-b44340e53488 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:51:35.288600 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669b88e-5d59-4e7b-a172-b44340e53488 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:51:35.297298 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1246/2519] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:51:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:36.140287 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc90373-13c7-44fa-9253-f561ec91fdca service cinder] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:36.148948 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc90373-13c7-44fa-9253-f561ec91fdca service cinder] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:36.152527 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee764f-9b68-46fb-8167-94da29b779cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:36.153190 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee764f-9b68-46fb-8167-94da29b779cd service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:36.153473 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee764f-9b68-46fb-8167-94da29b779cd service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:36.153748 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee764f-9b68-46fb-8167-94da29b779cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:36.162439 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee764f-9b68-46fb-8167-94da29b779cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:36.163871 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee764f-9b68-46fb-8167-94da29b779cd service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:36.190931 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1274/2520] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:38.152140 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669b88e-5d59-4e7b-a172-b44340e53488 service nova] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:38.162545 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669b88e-5d59-4e7b-a172-b44340e53488 service nova] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:38.166104 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff54c9-2031-4137-945c-dd91e08748a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:38.166736 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff54c9-2031-4137-945c-dd91e08748a9 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:38.167013 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff54c9-2031-4137-945c-dd91e08748a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:38.167283 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff54c9-2031-4137-945c-dd91e08748a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:38.177698 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff54c9-2031-4137-945c-dd91e08748a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:38.179155 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff54c9-2031-4137-945c-dd91e08748a9 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:38.214455 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1247/2521] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:39.823232 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb9df4-d2e8-4da1-8830-6299a117156c None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:39.825471 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb9df4-d2e8-4da1-8830-6299a117156c None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:39.825471 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb9df4-d2e8-4da1-8830-6299a117156c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:39.918425 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-89bb9df4-d2e8-4da1-8830-6299a117156c None None] MFA Rules not processed for user `5f1befc68f5a43c492efef77b1ec480a`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:39.921054 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-89bb9df4-d2e8-4da1-8830-6299a117156c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:39.933126 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1275/2522] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:52:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:40.008355 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff54c9-2031-4137-945c-dd91e08748a9 service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:40.022841 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff54c9-2031-4137-945c-dd91e08748a9 service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:40.037253 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bfbc2-22c5-42b9-b6c2-21896615ee20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:40.037253 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bfbc2-22c5-42b9-b6c2-21896615ee20 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:40.037253 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bfbc2-22c5-42b9-b6c2-21896615ee20 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:40.037253 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bfbc2-22c5-42b9-b6c2-21896615ee20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:40.039482 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f20bfbc2-22c5-42b9-b6c2-21896615ee20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:40.149421 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bfbc2-22c5-42b9-b6c2-21896615ee20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:40.151317 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bfbc2-22c5-42b9-b6c2-21896615ee20 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:40.170359 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1248/2523] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:41.602371 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb9df4-d2e8-4da1-8830-6299a117156c None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:41.615874 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb9df4-d2e8-4da1-8830-6299a117156c None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:41.621600 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2471e-661b-4712-ac95-eba22de37106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:41.622401 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2471e-661b-4712-ac95-eba22de37106 service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:41.623104 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2471e-661b-4712-ac95-eba22de37106 service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:41.623276 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2471e-661b-4712-ac95-eba22de37106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:41.633865 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2471e-661b-4712-ac95-eba22de37106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:41.635501 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2471e-661b-4712-ac95-eba22de37106 service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:41.646884 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1276/2524] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:44.029376 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bfbc2-22c5-42b9-b6c2-21896615ee20 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:44.031515 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f20bfbc2-22c5-42b9-b6c2-21896615ee20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:44.043428 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bfbc2-22c5-42b9-b6c2-21896615ee20 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:44.048044 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe6636-7618-45b8-a6ca-77cff21aed48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:44.048967 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6636-7618-45b8-a6ca-77cff21aed48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:44.049246 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6636-7618-45b8-a6ca-77cff21aed48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:44.049548 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6636-7618-45b8-a6ca-77cff21aed48 admin admin] PATH_INFO: `/v3/users/658d1271fb264cb59e62a921492457c2` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:44.050766 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe6636-7618-45b8-a6ca-77cff21aed48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=658d1271fb264cb59e62a921492457c2)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:44.052785 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe6636-7618-45b8-a6ca-77cff21aed48 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:44.420089 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-5ffe6636-7618-45b8-a6ca-77cff21aed48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658d1271fb264cb59e62a921492457c2'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:44.432483 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-5ffe6636-7618-45b8-a6ca-77cff21aed48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658d1271fb264cb59e62a921492457c2'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:44.433207 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-5ffe6636-7618-45b8-a6ca-77cff21aed48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658d1271fb264cb59e62a921492457c2'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:44.560552 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-5ffe6636-7618-45b8-a6ca-77cff21aed48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658d1271fb264cb59e62a921492457c2'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:44.561228 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-5ffe6636-7618-45b8-a6ca-77cff21aed48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658d1271fb264cb59e62a921492457c2'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:44.574066 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1249/2525] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:44 2022] DELETE /identity/v3/users/658d1271fb264cb59e62a921492457c2 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:44.825224 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2471e-661b-4712-ac95-eba22de37106 service nova] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:44.838004 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2471e-661b-4712-ac95-eba22de37106 service nova] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:44.895139 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a220f2-20fb-4dbb-957e-9246e2774411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:44.896652 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a220f2-20fb-4dbb-957e-9246e2774411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:44.896953 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a220f2-20fb-4dbb-957e-9246e2774411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:44.897226 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a220f2-20fb-4dbb-957e-9246e2774411 admin admin] PATH_INFO: `/v3/projects/e18e69f500fe484994f99d9e8b599b78` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:44.898428 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a220f2-20fb-4dbb-957e-9246e2774411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e18e69f500fe484994f99d9e8b599b78)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:44.900342 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a220f2-20fb-4dbb-957e-9246e2774411 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.005266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-40a220f2-20fb-4dbb-957e-9246e2774411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e18e69f500fe484994f99d9e8b599b78', 'request_id': 'req-40a220f2-20fb-4dbb-957e-9246e2774411'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:45.010437 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-40a220f2-20fb-4dbb-957e-9246e2774411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e18e69f500fe484994f99d9e8b599b78', 'request_id': 'req-40a220f2-20fb-4dbb-957e-9246e2774411'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:45.016543 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-40a220f2-20fb-4dbb-957e-9246e2774411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e18e69f500fe484994f99d9e8b599b78', 'request_id': 'req-40a220f2-20fb-4dbb-957e-9246e2774411'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:45.102549 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-40a220f2-20fb-4dbb-957e-9246e2774411 admin admin] The token cache is being invalidate because project e18e69f500fe484994f99d9e8b599b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:45.102832 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-40a220f2-20fb-4dbb-957e-9246e2774411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:45.103460 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-40a220f2-20fb-4dbb-957e-9246e2774411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:45.105045 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1277/2526] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:44 2022] DELETE /identity/v3/projects/e18e69f500fe484994f99d9e8b599b78 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:45.110996 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623698fe-b389-4215-ac7e-0b18d8dc9614 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.119185 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623698fe-b389-4215-ac7e-0b18d8dc9614 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.119185 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623698fe-b389-4215-ac7e-0b18d8dc9614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.165473 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-623698fe-b389-4215-ac7e-0b18d8dc9614 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:45.166662 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-623698fe-b389-4215-ac7e-0b18d8dc9614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:45.224674 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1250/2527] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:45.232434 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38024ff3-5499-4f10-83d1-006c9fafd237 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.233271 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38024ff3-5499-4f10-83d1-006c9fafd237 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.234000 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38024ff3-5499-4f10-83d1-006c9fafd237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.253405 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-38024ff3-5499-4f10-83d1-006c9fafd237 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:45.254620 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-38024ff3-5499-4f10-83d1-006c9fafd237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:45.262610 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1278/2528] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:45.266945 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623698fe-b389-4215-ac7e-0b18d8dc9614 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.277550 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623698fe-b389-4215-ac7e-0b18d8dc9614 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.282911 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d3bda-a317-477f-bf8d-1b80f16cd738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.283720 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d3bda-a317-477f-bf8d-1b80f16cd738 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.283941 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d3bda-a317-477f-bf8d-1b80f16cd738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.284231 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d3bda-a317-477f-bf8d-1b80f16cd738 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.284997 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d3bda-a317-477f-bf8d-1b80f16cd738 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:45.290949 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d3bda-a317-477f-bf8d-1b80f16cd738 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.290949 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d3bda-a317-477f-bf8d-1b80f16cd738 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.299259 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1251/2529] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:45.303558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38024ff3-5499-4f10-83d1-006c9fafd237 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.313248 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38024ff3-5499-4f10-83d1-006c9fafd237 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.318003 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5a8f8-554a-4cbd-a8be-1cfeddbabef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.318663 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5a8f8-554a-4cbd-a8be-1cfeddbabef8 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.318945 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5a8f8-554a-4cbd-a8be-1cfeddbabef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.319220 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5a8f8-554a-4cbd-a8be-1cfeddbabef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.319933 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5a8f8-554a-4cbd-a8be-1cfeddbabef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.321872 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5a8f8-554a-4cbd-a8be-1cfeddbabef8 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.419437 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1279/2530] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:45 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:45.423893 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d3bda-a317-477f-bf8d-1b80f16cd738 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.433795 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d3bda-a317-477f-bf8d-1b80f16cd738 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.490091 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856ac4e-659f-47e0-9d9e-066434189641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.490754 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856ac4e-659f-47e0-9d9e-066434189641 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.491033 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856ac4e-659f-47e0-9d9e-066434189641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.491307 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856ac4e-659f-47e0-9d9e-066434189641 admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.491993 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856ac4e-659f-47e0-9d9e-066434189641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.494037 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856ac4e-659f-47e0-9d9e-066434189641 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.577662 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1252/2531] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:45 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:45.581527 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5a8f8-554a-4cbd-a8be-1cfeddbabef8 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.591582 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5a8f8-554a-4cbd-a8be-1cfeddbabef8 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.596922 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8cde8-e2a4-4784-8729-f19f75c417e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.597576 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8cde8-e2a4-4784-8729-f19f75c417e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.597857 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8cde8-e2a4-4784-8729-f19f75c417e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.598129 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8cde8-e2a4-4784-8729-f19f75c417e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.598846 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8cde8-e2a4-4784-8729-f19f75c417e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.600422 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8cde8-e2a4-4784-8729-f19f75c417e3 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.610620 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1280/2532] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:45.614373 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856ac4e-659f-47e0-9d9e-066434189641 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.624352 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856ac4e-659f-47e0-9d9e-066434189641 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.628987 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474e8d1-5e5e-459d-913e-3e49b9599999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.629634 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474e8d1-5e5e-459d-913e-3e49b9599999 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.629918 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474e8d1-5e5e-459d-913e-3e49b9599999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.630191 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474e8d1-5e5e-459d-913e-3e49b9599999 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.630942 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474e8d1-5e5e-459d-913e-3e49b9599999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.632531 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474e8d1-5e5e-459d-913e-3e49b9599999 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.642162 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1253/2533] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:45.646220 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8cde8-e2a4-4784-8729-f19f75c417e3 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.656588 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8cde8-e2a4-4784-8729-f19f75c417e3 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.661060 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a253c-7770-4878-8928-f648edf8b356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.661917 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a253c-7770-4878-8928-f648edf8b356 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.662192 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a253c-7770-4878-8928-f648edf8b356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.662459 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a253c-7770-4878-8928-f648edf8b356 admin admin] PATH_INFO: `/v3/projects/a60059b33bff4478b15817811c0b8867/users/0321792cd82c4f7692f9f806a47560d8/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.676228 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a253c-7770-4878-8928-f648edf8b356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a60059b33bff4478b15817811c0b8867, user_id=0321792cd82c4f7692f9f806a47560d8, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.678892 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a253c-7770-4878-8928-f648edf8b356 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.759382 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1281/2534] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:45 2022] PUT /identity/v3/projects/a60059b33bff4478b15817811c0b8867/users/0321792cd82c4f7692f9f806a47560d8/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:45.770549 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a010f-4e80-4f05-bbc8-6d31f0c2ba88 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.770923 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a010f-4e80-4f05-bbc8-6d31f0c2ba88 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.771280 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a010f-4e80-4f05-bbc8-6d31f0c2ba88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.799772 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-1c9a010f-4e80-4f05-bbc8-6d31f0c2ba88 None None] MFA Rules not processed for user `0321792cd82c4f7692f9f806a47560d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:45.801051 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1c9a010f-4e80-4f05-bbc8-6d31f0c2ba88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:45.867138 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1254/2535] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:52:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:45.878788 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a253c-7770-4878-8928-f648edf8b356 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.880565 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-d28a253c-7770-4878-8928-f648edf8b356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:45.954364 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a253c-7770-4878-8928-f648edf8b356 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.960256 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d703603-0032-408e-a7cc-400a9c79fb1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.960946 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d703603-0032-408e-a7cc-400a9c79fb1d service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.961267 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d703603-0032-408e-a7cc-400a9c79fb1d service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.961537 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d703603-0032-408e-a7cc-400a9c79fb1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.970967 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d703603-0032-408e-a7cc-400a9c79fb1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.972953 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d703603-0032-408e-a7cc-400a9c79fb1d service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.981834 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1282/2536] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:53.579762 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a010f-4e80-4f05-bbc8-6d31f0c2ba88 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:53.581257 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1c9a010f-4e80-4f05-bbc8-6d31f0c2ba88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:53.645463 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a010f-4e80-4f05-bbc8-6d31f0c2ba88 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:53.650077 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac570ef-0120-4cf4-91ef-d21f3b105160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:53.650971 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac570ef-0120-4cf4-91ef-d21f3b105160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:53.651251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac570ef-0120-4cf4-91ef-d21f3b105160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:53.651547 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac570ef-0120-4cf4-91ef-d21f3b105160 admin admin] PATH_INFO: `/v3/users/fc9d8cc61b444709a7148aa0d479b62b` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:53.669522 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac570ef-0120-4cf4-91ef-d21f3b105160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc9d8cc61b444709a7148aa0d479b62b)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:53.672098 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac570ef-0120-4cf4-91ef-d21f3b105160 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:53.842712 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-aac570ef-0120-4cf4-91ef-d21f3b105160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc9d8cc61b444709a7148aa0d479b62b'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:53.856119 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-aac570ef-0120-4cf4-91ef-d21f3b105160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc9d8cc61b444709a7148aa0d479b62b'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:53.856857 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-aac570ef-0120-4cf4-91ef-d21f3b105160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc9d8cc61b444709a7148aa0d479b62b'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:53.921908 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-aac570ef-0120-4cf4-91ef-d21f3b105160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc9d8cc61b444709a7148aa0d479b62b'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:53.922684 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-aac570ef-0120-4cf4-91ef-d21f3b105160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc9d8cc61b444709a7148aa0d479b62b'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:53.936419 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1255/2537] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:53 2022] DELETE /identity/v3/users/fc9d8cc61b444709a7148aa0d479b62b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:53.940649 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244b96a-1c59-4f90-b86d-81ab5b005c9d None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:53.941292 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244b96a-1c59-4f90-b86d-81ab5b005c9d None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:53.941292 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244b96a-1c59-4f90-b86d-81ab5b005c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:53.958827 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-b244b96a-1c59-4f90-b86d-81ab5b005c9d None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:53.960204 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b244b96a-1c59-4f90-b86d-81ab5b005c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:54.023557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1283/2538] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:54.033354 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac570ef-0120-4cf4-91ef-d21f3b105160 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:54.040275 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-aac570ef-0120-4cf4-91ef-d21f3b105160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:54.092131 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac570ef-0120-4cf4-91ef-d21f3b105160 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:54.095785 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225769f7-c89e-4b10-96e4-523cb348d87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:54.096706 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225769f7-c89e-4b10-96e4-523cb348d87d service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:54.096990 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225769f7-c89e-4b10-96e4-523cb348d87d service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:54.097260 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225769f7-c89e-4b10-96e4-523cb348d87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:54.106028 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225769f7-c89e-4b10-96e4-523cb348d87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:54.108067 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225769f7-c89e-4b10-96e4-523cb348d87d service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:54.117402 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1256/2539] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:54.629534 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244b96a-1c59-4f90-b86d-81ab5b005c9d None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:54.631272 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b244b96a-1c59-4f90-b86d-81ab5b005c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:54.645142 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244b96a-1c59-4f90-b86d-81ab5b005c9d None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:54.650471 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699bce0-c997-46a5-8acf-c9d2e36347a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:54.651244 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699bce0-c997-46a5-8acf-c9d2e36347a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:54.651704 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699bce0-c997-46a5-8acf-c9d2e36347a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:54.652136 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699bce0-c997-46a5-8acf-c9d2e36347a4 admin admin] PATH_INFO: `/v3/projects/46f8ff42cdc044eca86dc2472e1f7ffd` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:54.676551 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699bce0-c997-46a5-8acf-c9d2e36347a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46f8ff42cdc044eca86dc2472e1f7ffd)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:54.676551 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699bce0-c997-46a5-8acf-c9d2e36347a4 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:54.798580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1699bce0-c997-46a5-8acf-c9d2e36347a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46f8ff42cdc044eca86dc2472e1f7ffd', 'request_id': 'req-1699bce0-c997-46a5-8acf-c9d2e36347a4'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:54.803873 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1699bce0-c997-46a5-8acf-c9d2e36347a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46f8ff42cdc044eca86dc2472e1f7ffd', 'request_id': 'req-1699bce0-c997-46a5-8acf-c9d2e36347a4'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:54.811087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1699bce0-c997-46a5-8acf-c9d2e36347a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46f8ff42cdc044eca86dc2472e1f7ffd', 'request_id': 'req-1699bce0-c997-46a5-8acf-c9d2e36347a4'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:54.877877 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1699bce0-c997-46a5-8acf-c9d2e36347a4 admin admin] The token cache is being invalidate because project 46f8ff42cdc044eca86dc2472e1f7ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:54.878094 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1699bce0-c997-46a5-8acf-c9d2e36347a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:54.878733 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1699bce0-c997-46a5-8acf-c9d2e36347a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:54.880268 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1284/2540] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:54 2022] DELETE /identity/v3/projects/46f8ff42cdc044eca86dc2472e1f7ffd => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:54.885200 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f57cc7-eba5-4b3a-be72-c8452889c3b2 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:54.885709 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f57cc7-eba5-4b3a-be72-c8452889c3b2 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:54.885854 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f57cc7-eba5-4b3a-be72-c8452889c3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:54.904130 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-70f57cc7-eba5-4b3a-be72-c8452889c3b2 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:54.906007 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-70f57cc7-eba5-4b3a-be72-c8452889c3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:54.962191 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1257/2541] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:54.969921 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b07afc-0099-4565-b3d2-e305759801a8 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:54.970422 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b07afc-0099-4565-b3d2-e305759801a8 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:54.970542 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b07afc-0099-4565-b3d2-e305759801a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:54.988307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-88b07afc-0099-4565-b3d2-e305759801a8 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:54.989536 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-88b07afc-0099-4565-b3d2-e305759801a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:54.997514 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1285/2542] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:55.001576 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f57cc7-eba5-4b3a-be72-c8452889c3b2 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.010878 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f57cc7-eba5-4b3a-be72-c8452889c3b2 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.015575 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8bdbf-829c-4625-80c4-8d602bd32b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.016220 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8bdbf-829c-4625-80c4-8d602bd32b8f admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.016501 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8bdbf-829c-4625-80c4-8d602bd32b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.016814 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8bdbf-829c-4625-80c4-8d602bd32b8f admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.017537 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8bdbf-829c-4625-80c4-8d602bd32b8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:55.017849 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8bdbf-829c-4625-80c4-8d602bd32b8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.019451 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8bdbf-829c-4625-80c4-8d602bd32b8f admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.031085 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1258/2543] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:55.035140 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b07afc-0099-4565-b3d2-e305759801a8 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.043960 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b07afc-0099-4565-b3d2-e305759801a8 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.049401 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc44bec-b791-49b7-8f80-d474e6a212c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.050045 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc44bec-b791-49b7-8f80-d474e6a212c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.050354 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc44bec-b791-49b7-8f80-d474e6a212c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.050629 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc44bec-b791-49b7-8f80-d474e6a212c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.051323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc44bec-b791-49b7-8f80-d474e6a212c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.053256 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc44bec-b791-49b7-8f80-d474e6a212c9 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.136723 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1286/2544] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:55 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:52:55.140852 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8bdbf-829c-4625-80c4-8d602bd32b8f admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.150762 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8bdbf-829c-4625-80c4-8d602bd32b8f admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.206032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f119790-d4a0-4ddf-b881-a5ccbf71ee10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.206710 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f119790-d4a0-4ddf-b881-a5ccbf71ee10 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.206994 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f119790-d4a0-4ddf-b881-a5ccbf71ee10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.207269 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f119790-d4a0-4ddf-b881-a5ccbf71ee10 admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.207966 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f119790-d4a0-4ddf-b881-a5ccbf71ee10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.209923 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f119790-d4a0-4ddf-b881-a5ccbf71ee10 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.315634 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc44bec-b791-49b7-8f80-d474e6a212c9 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.320004 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1259/2545] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:55 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:55.320137 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-fdc44bec-b791-49b7-8f80-d474e6a212c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:55.323416 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f119790-d4a0-4ddf-b881-a5ccbf71ee10 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.332872 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc44bec-b791-49b7-8f80-d474e6a212c9 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.334030 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f119790-d4a0-4ddf-b881-a5ccbf71ee10 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.337421 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1875b91-bb52-4595-8cdf-3e00a049d02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.338284 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1875b91-bb52-4595-8cdf-3e00a049d02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.338561 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1875b91-bb52-4595-8cdf-3e00a049d02c admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.338788 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e0fa0-8463-4de9-a4ce-fc6ac539b59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.338918 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1875b91-bb52-4595-8cdf-3e00a049d02c admin admin] PATH_INFO: `/v3/users/0321792cd82c4f7692f9f806a47560d8` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.339493 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e0fa0-8463-4de9-a4ce-fc6ac539b59e admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.339807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e0fa0-8463-4de9-a4ce-fc6ac539b59e admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.340080 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e0fa0-8463-4de9-a4ce-fc6ac539b59e admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.340211 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1875b91-bb52-4595-8cdf-3e00a049d02c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0321792cd82c4f7692f9f806a47560d8)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.341099 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e0fa0-8463-4de9-a4ce-fc6ac539b59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.342203 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1875b91-bb52-4595-8cdf-3e00a049d02c admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.342701 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e0fa0-8463-4de9-a4ce-fc6ac539b59e admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.353217 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1260/2546] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:52:55.357125 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e0fa0-8463-4de9-a4ce-fc6ac539b59e admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.367300 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e0fa0-8463-4de9-a4ce-fc6ac539b59e admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.371886 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218753eb-edfe-487b-9519-ecb2e08ca23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.372573 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218753eb-edfe-487b-9519-ecb2e08ca23a admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.372899 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218753eb-edfe-487b-9519-ecb2e08ca23a admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.373724 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218753eb-edfe-487b-9519-ecb2e08ca23a admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.374433 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218753eb-edfe-487b-9519-ecb2e08ca23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.376018 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218753eb-edfe-487b-9519-ecb2e08ca23a admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.386376 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1261/2547] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:52:55.390874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218753eb-edfe-487b-9519-ecb2e08ca23a admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.400134 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218753eb-edfe-487b-9519-ecb2e08ca23a admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.405323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8135b-66b3-41ee-8d30-df0347417cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.406167 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8135b-66b3-41ee-8d30-df0347417cab admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.406445 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8135b-66b3-41ee-8d30-df0347417cab admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.406719 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8135b-66b3-41ee-8d30-df0347417cab admin admin] PATH_INFO: `/v3/projects/eab8d126a4574df48a127b8c3a03b20d/users/f88b139b7ac7488c9b48216350775c71/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.420450 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8135b-66b3-41ee-8d30-df0347417cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab8d126a4574df48a127b8c3a03b20d, user_id=f88b139b7ac7488c9b48216350775c71, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.423161 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8135b-66b3-41ee-8d30-df0347417cab admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.554857 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1262/2548] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:55 2022] PUT /identity/v3/projects/eab8d126a4574df48a127b8c3a03b20d/users/f88b139b7ac7488c9b48216350775c71/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:52:55.560034 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d3e03-1423-4323-91c8-9bec9da98efa None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.560343 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d3e03-1423-4323-91c8-9bec9da98efa None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.560673 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d3e03-1423-4323-91c8-9bec9da98efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.579725 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-cb6d3e03-1423-4323-91c8-9bec9da98efa None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:55.583045 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-e1875b91-bb52-4595-8cdf-3e00a049d02c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0321792cd82c4f7692f9f806a47560d8'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:55.583193 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-cb6d3e03-1423-4323-91c8-9bec9da98efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:55.592703 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-e1875b91-bb52-4595-8cdf-3e00a049d02c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0321792cd82c4f7692f9f806a47560d8'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:55.593508 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-e1875b91-bb52-4595-8cdf-3e00a049d02c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0321792cd82c4f7692f9f806a47560d8'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:55.594108 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-e1875b91-bb52-4595-8cdf-3e00a049d02c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0321792cd82c4f7692f9f806a47560d8'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:55.601009 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-e1875b91-bb52-4595-8cdf-3e00a049d02c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0321792cd82c4f7692f9f806a47560d8'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:55.649710 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1263/2549] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:55.651982 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1287/2550] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:55 2022] DELETE /identity/v3/users/0321792cd82c4f7692f9f806a47560d8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:55.656925 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f631d67-2c37-4ac2-8403-2f7678328c98 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.664075 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f631d67-2c37-4ac2-8403-2f7678328c98 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.664075 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f631d67-2c37-4ac2-8403-2f7678328c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.664684 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d3e03-1423-4323-91c8-9bec9da98efa None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.664684 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-cb6d3e03-1423-4323-91c8-9bec9da98efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:55.677673 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-6f631d67-2c37-4ac2-8403-2f7678328c98 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:55.679045 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-6f631d67-2c37-4ac2-8403-2f7678328c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:55.728537 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d3e03-1423-4323-91c8-9bec9da98efa None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.749304 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1288/2551] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:55.771152 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f631d67-2c37-4ac2-8403-2f7678328c98 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.801528 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d7db0-e38a-46d8-b2f7-8cdee8478b01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.802178 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d7db0-e38a-46d8-b2f7-8cdee8478b01 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.802460 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d7db0-e38a-46d8-b2f7-8cdee8478b01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.802730 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d7db0-e38a-46d8-b2f7-8cdee8478b01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.813211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d7db0-e38a-46d8-b2f7-8cdee8478b01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.815032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d7db0-e38a-46d8-b2f7-8cdee8478b01 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.827067 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1264/2552] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:55.837345 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f631d67-2c37-4ac2-8403-2f7678328c98 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.841664 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f635441-a718-4025-9b7c-0c4a647703d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.843031 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f635441-a718-4025-9b7c-0c4a647703d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.843314 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f635441-a718-4025-9b7c-0c4a647703d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.843587 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f635441-a718-4025-9b7c-0c4a647703d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.854005 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f635441-a718-4025-9b7c-0c4a647703d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.855461 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f635441-a718-4025-9b7c-0c4a647703d1 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.866813 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1289/2553] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:56.385570 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d7db0-e38a-46d8-b2f7-8cdee8478b01 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:56.387112 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6f1d7db0-e38a-46d8-b2f7-8cdee8478b01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:56.404788 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d7db0-e38a-46d8-b2f7-8cdee8478b01 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:56.410834 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd9fec-644c-4aca-b2c8-b3f0de3133ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:56.411918 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd9fec-644c-4aca-b2c8-b3f0de3133ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:56.412204 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd9fec-644c-4aca-b2c8-b3f0de3133ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:56.412910 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd9fec-644c-4aca-b2c8-b3f0de3133ab admin admin] PATH_INFO: `/v3/projects/a60059b33bff4478b15817811c0b8867` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:56.414661 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd9fec-644c-4aca-b2c8-b3f0de3133ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a60059b33bff4478b15817811c0b8867)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:56.417027 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd9fec-644c-4aca-b2c8-b3f0de3133ab admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:56.703330 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b1dd9fec-644c-4aca-b2c8-b3f0de3133ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a60059b33bff4478b15817811c0b8867', 'request_id': 'req-b1dd9fec-644c-4aca-b2c8-b3f0de3133ab'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:56.789355 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b1dd9fec-644c-4aca-b2c8-b3f0de3133ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a60059b33bff4478b15817811c0b8867', 'request_id': 'req-b1dd9fec-644c-4aca-b2c8-b3f0de3133ab'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:56.797092 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b1dd9fec-644c-4aca-b2c8-b3f0de3133ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a60059b33bff4478b15817811c0b8867', 'request_id': 'req-b1dd9fec-644c-4aca-b2c8-b3f0de3133ab'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:56.808648 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b1dd9fec-644c-4aca-b2c8-b3f0de3133ab admin admin] The token cache is being invalidate because project a60059b33bff4478b15817811c0b8867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:56.809042 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b1dd9fec-644c-4aca-b2c8-b3f0de3133ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:56.809755 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-b1dd9fec-644c-4aca-b2c8-b3f0de3133ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:56.811876 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1265/2554] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:56 2022] DELETE /identity/v3/projects/a60059b33bff4478b15817811c0b8867 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:56.817148 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8950551-a25d-4c2a-bfee-c7fe258408fc None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:56.817650 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8950551-a25d-4c2a-bfee-c7fe258408fc None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:56.823019 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8950551-a25d-4c2a-bfee-c7fe258408fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:56.837808 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-e8950551-a25d-4c2a-bfee-c7fe258408fc None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:56.839103 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e8950551-a25d-4c2a-bfee-c7fe258408fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:56.902337 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1290/2555] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:56.912902 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f84f5-f09c-4f30-a3a7-0dea66c282ef None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:56.913251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f84f5-f09c-4f30-a3a7-0dea66c282ef None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:56.913465 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f84f5-f09c-4f30-a3a7-0dea66c282ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:56.933032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-ee0f84f5-f09c-4f30-a3a7-0dea66c282ef None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:56.934215 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-ee0f84f5-f09c-4f30-a3a7-0dea66c282ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:56.943499 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1266/2556] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:56.948052 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8950551-a25d-4c2a-bfee-c7fe258408fc None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:56.958698 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8950551-a25d-4c2a-bfee-c7fe258408fc None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:56.963659 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7655ca3-8bf7-4aed-9a6e-075d01bf722d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:56.964322 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7655ca3-8bf7-4aed-9a6e-075d01bf722d admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:56.964604 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7655ca3-8bf7-4aed-9a6e-075d01bf722d admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:56.964909 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7655ca3-8bf7-4aed-9a6e-075d01bf722d admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:56.965807 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7655ca3-8bf7-4aed-9a6e-075d01bf722d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:56.966119 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7655ca3-8bf7-4aed-9a6e-075d01bf722d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:56.968387 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7655ca3-8bf7-4aed-9a6e-075d01bf722d admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:56.980732 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1291/2557] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:56.985334 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f84f5-f09c-4f30-a3a7-0dea66c282ef None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:56.995060 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f84f5-f09c-4f30-a3a7-0dea66c282ef None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:56.999871 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c527b-807c-43d1-beda-1720398f4050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:57.000522 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c527b-807c-43d1-beda-1720398f4050 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:57.000837 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c527b-807c-43d1-beda-1720398f4050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:57.001218 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c527b-807c-43d1-beda-1720398f4050 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:57.001799 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c527b-807c-43d1-beda-1720398f4050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:57.003718 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c527b-807c-43d1-beda-1720398f4050 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:57.133409 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1267/2558] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:56 2022] POST /identity/v3/projects => generated 363 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:57.137518 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7655ca3-8bf7-4aed-9a6e-075d01bf722d admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:57.147655 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7655ca3-8bf7-4aed-9a6e-075d01bf722d admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:57.219478 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0adfc-5be1-468e-9afc-2291d7d285ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:57.220111 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0adfc-5be1-468e-9afc-2291d7d285ba admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:57.220395 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0adfc-5be1-468e-9afc-2291d7d285ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:57.220694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0adfc-5be1-468e-9afc-2291d7d285ba admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:57.221713 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0adfc-5be1-468e-9afc-2291d7d285ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:57.223660 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0adfc-5be1-468e-9afc-2291d7d285ba admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:57.340146 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1292/2559] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:57 2022] POST /identity/v3/users => generated 282 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:57.341476 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c527b-807c-43d1-beda-1720398f4050 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:57.353118 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c527b-807c-43d1-beda-1720398f4050 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:57.359448 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177d4b7-77db-471b-8913-6e5522263aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:57.360411 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177d4b7-77db-471b-8913-6e5522263aae admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:57.361132 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177d4b7-77db-471b-8913-6e5522263aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:57.361410 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177d4b7-77db-471b-8913-6e5522263aae admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:57.362148 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177d4b7-77db-471b-8913-6e5522263aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:57.363848 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177d4b7-77db-471b-8913-6e5522263aae admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:57.376778 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1268/2560] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:57.380720 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0adfc-5be1-468e-9afc-2291d7d285ba admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:57.390927 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0adfc-5be1-468e-9afc-2291d7d285ba admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:57.397345 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e0f17-3b61-4353-bec8-28f634493233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:57.398106 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e0f17-3b61-4353-bec8-28f634493233 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:57.398388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e0f17-3b61-4353-bec8-28f634493233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:57.398666 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e0f17-3b61-4353-bec8-28f634493233 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:57.399394 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e0f17-3b61-4353-bec8-28f634493233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:57.401036 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e0f17-3b61-4353-bec8-28f634493233 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:57.415195 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1293/2561] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:57.416338 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177d4b7-77db-471b-8913-6e5522263aae admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:57.427077 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177d4b7-77db-471b-8913-6e5522263aae admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:57.434360 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9038466-c18e-400c-a956-17c97349fac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:57.435895 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9038466-c18e-400c-a956-17c97349fac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:57.436513 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9038466-c18e-400c-a956-17c97349fac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:57.437109 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9038466-c18e-400c-a956-17c97349fac6 admin admin] PATH_INFO: `/v3/projects/75caa499303d4a27ab32c2409c558f30/users/1e1b48147b6f491393ab976688e1f67c/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:57.454656 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9038466-c18e-400c-a956-17c97349fac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75caa499303d4a27ab32c2409c558f30, user_id=1e1b48147b6f491393ab976688e1f67c, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:57.457464 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9038466-c18e-400c-a956-17c97349fac6 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:57.549595 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1269/2562] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:57 2022] PUT /identity/v3/projects/75caa499303d4a27ab32c2409c558f30/users/1e1b48147b6f491393ab976688e1f67c/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:57.559985 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4666f21-3a54-44d8-838f-58ef88d15b20 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:57.560796 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4666f21-3a54-44d8-838f-58ef88d15b20 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:57.561111 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4666f21-3a54-44d8-838f-58ef88d15b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:57.587969 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-d4666f21-3a54-44d8-838f-58ef88d15b20 None None] MFA Rules not processed for user `1e1b48147b6f491393ab976688e1f67c`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:57.589200 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-d4666f21-3a54-44d8-838f-58ef88d15b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:57.688858 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1294/2563] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:52:57 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:57.693305 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9038466-c18e-400c-a956-17c97349fac6 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:57.766193 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9038466-c18e-400c-a956-17c97349fac6 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:57.777402 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe17d30-67f8-4ba2-8ee6-0475b3124cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:57.778084 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe17d30-67f8-4ba2-8ee6-0475b3124cac admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:57.778374 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe17d30-67f8-4ba2-8ee6-0475b3124cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:57.778694 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe17d30-67f8-4ba2-8ee6-0475b3124cac admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:57.779643 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe17d30-67f8-4ba2-8ee6-0475b3124cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:57.781825 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe17d30-67f8-4ba2-8ee6-0475b3124cac admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:57.898508 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1270/2564] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:57 2022] POST /identity/v3/projects => generated 365 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:57.898850 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4666f21-3a54-44d8-838f-58ef88d15b20 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:57.909480 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4666f21-3a54-44d8-838f-58ef88d15b20 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:57.977363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24819da2-2e12-409a-9206-ec2a68d4bc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:57.977868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24819da2-2e12-409a-9206-ec2a68d4bc1d admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:57.978143 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24819da2-2e12-409a-9206-ec2a68d4bc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:57.978415 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24819da2-2e12-409a-9206-ec2a68d4bc1d admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:57.979103 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24819da2-2e12-409a-9206-ec2a68d4bc1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:57.981100 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24819da2-2e12-409a-9206-ec2a68d4bc1d admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:58.083929 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1295/2565] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:57 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:52:58.087934 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe17d30-67f8-4ba2-8ee6-0475b3124cac admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:58.100284 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe17d30-67f8-4ba2-8ee6-0475b3124cac admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:58.106518 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94318705-02ea-409e-aded-5aaaa3d479fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:58.110105 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94318705-02ea-409e-aded-5aaaa3d479fa admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:58.110485 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94318705-02ea-409e-aded-5aaaa3d479fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:58.110761 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94318705-02ea-409e-aded-5aaaa3d479fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:58.111699 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94318705-02ea-409e-aded-5aaaa3d479fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:58.113530 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94318705-02ea-409e-aded-5aaaa3d479fa admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:58.132493 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24819da2-2e12-409a-9206-ec2a68d4bc1d admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:58.132749 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1271/2566] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:58.143979 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24819da2-2e12-409a-9206-ec2a68d4bc1d admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:58.149762 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85480c86-ec26-445a-97f5-df59d7a64f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:58.150777 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85480c86-ec26-445a-97f5-df59d7a64f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:58.151239 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85480c86-ec26-445a-97f5-df59d7a64f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:58.151704 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85480c86-ec26-445a-97f5-df59d7a64f3b admin admin] PATH_INFO: `/v3/projects/b4463c9f9f9f464baddf505d744e1651/users/ab75faa1350a4aef905bf8fc8c736fb4/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:58.169385 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85480c86-ec26-445a-97f5-df59d7a64f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4463c9f9f9f464baddf505d744e1651, user_id=ab75faa1350a4aef905bf8fc8c736fb4, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:58.172422 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85480c86-ec26-445a-97f5-df59d7a64f3b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:58.258141 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1296/2567] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:58 2022] PUT /identity/v3/projects/b4463c9f9f9f464baddf505d744e1651/users/ab75faa1350a4aef905bf8fc8c736fb4/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:52:58.262275 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94318705-02ea-409e-aded-5aaaa3d479fa admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:58.272604 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94318705-02ea-409e-aded-5aaaa3d479fa admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:58.341090 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe7e2f-3c98-4b67-8b76-96b7c008ad99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:58.341596 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe7e2f-3c98-4b67-8b76-96b7c008ad99 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:58.341954 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe7e2f-3c98-4b67-8b76-96b7c008ad99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:58.342302 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe7e2f-3c98-4b67-8b76-96b7c008ad99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:58.343115 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe7e2f-3c98-4b67-8b76-96b7c008ad99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:58.346208 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe7e2f-3c98-4b67-8b76-96b7c008ad99 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:58.363393 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1272/2568] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:58.367338 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85480c86-ec26-445a-97f5-df59d7a64f3b admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:58.385881 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85480c86-ec26-445a-97f5-df59d7a64f3b admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:58.395412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61702691-59f5-4687-8ab6-17e9c24cbcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:58.399284 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61702691-59f5-4687-8ab6-17e9c24cbcd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:58.399284 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61702691-59f5-4687-8ab6-17e9c24cbcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:58.399284 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61702691-59f5-4687-8ab6-17e9c24cbcd6 admin admin] PATH_INFO: `/v3/projects/b4463c9f9f9f464baddf505d744e1651/users/ab75faa1350a4aef905bf8fc8c736fb4/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:58.399284 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61702691-59f5-4687-8ab6-17e9c24cbcd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4463c9f9f9f464baddf505d744e1651, user_id=ab75faa1350a4aef905bf8fc8c736fb4, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:58.402129 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61702691-59f5-4687-8ab6-17e9c24cbcd6 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:58.422226 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1297/2569] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:58 2022] PUT /identity/v3/projects/b4463c9f9f9f464baddf505d744e1651/users/ab75faa1350a4aef905bf8fc8c736fb4/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:58.432072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11626a-e333-4157-9db4-568b83183761 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:58.432604 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11626a-e333-4157-9db4-568b83183761 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:58.432741 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11626a-e333-4157-9db4-568b83183761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:58.460783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-6a11626a-e333-4157-9db4-568b83183761 None None] MFA Rules not processed for user `ab75faa1350a4aef905bf8fc8c736fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:58.462022 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6a11626a-e333-4157-9db4-568b83183761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:58.539372 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1273/2570] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:52:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:58.553399 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61702691-59f5-4687-8ab6-17e9c24cbcd6 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:58.555303 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-61702691-59f5-4687-8ab6-17e9c24cbcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:58.618132 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61702691-59f5-4687-8ab6-17e9c24cbcd6 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:58.623547 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e7ea4-8654-4504-b31c-7e03b4563471 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:58.624323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e7ea4-8654-4504-b31c-7e03b4563471 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:58.624605 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e7ea4-8654-4504-b31c-7e03b4563471 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:58.624943 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e7ea4-8654-4504-b31c-7e03b4563471 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:58.636178 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e7ea4-8654-4504-b31c-7e03b4563471 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:58.637713 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e7ea4-8654-4504-b31c-7e03b4563471 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:58.649238 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1298/2571] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:59.132049 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11626a-e333-4157-9db4-568b83183761 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:59.235662 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11626a-e333-4157-9db4-568b83183761 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:59.241692 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31883c76-b830-4e53-b6d0-d514af0fe99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:59.242576 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31883c76-b830-4e53-b6d0-d514af0fe99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:59.242860 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31883c76-b830-4e53-b6d0-d514af0fe99d admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:59.243312 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31883c76-b830-4e53-b6d0-d514af0fe99d admin admin] PATH_INFO: `/v3/users/1e1b48147b6f491393ab976688e1f67c` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:59.244887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31883c76-b830-4e53-b6d0-d514af0fe99d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e1b48147b6f491393ab976688e1f67c)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:59.247065 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31883c76-b830-4e53-b6d0-d514af0fe99d admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:59.479140 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-31883c76-b830-4e53-b6d0-d514af0fe99d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e1b48147b6f491393ab976688e1f67c'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:59.491884 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-31883c76-b830-4e53-b6d0-d514af0fe99d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e1b48147b6f491393ab976688e1f67c'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:59.493073 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-31883c76-b830-4e53-b6d0-d514af0fe99d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e1b48147b6f491393ab976688e1f67c'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:59.581424 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-31883c76-b830-4e53-b6d0-d514af0fe99d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e1b48147b6f491393ab976688e1f67c'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:59.582053 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-31883c76-b830-4e53-b6d0-d514af0fe99d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e1b48147b6f491393ab976688e1f67c'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:59.594914 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1274/2572] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:59 2022] DELETE /identity/v3/users/1e1b48147b6f491393ab976688e1f67c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:59.599958 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526f54f-30ca-4fbd-9fcc-50079323dcef None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:59.600860 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526f54f-30ca-4fbd-9fcc-50079323dcef None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:59.601155 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526f54f-30ca-4fbd-9fcc-50079323dcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:59.618942 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-a526f54f-30ca-4fbd-9fcc-50079323dcef None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:59.622942 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a526f54f-30ca-4fbd-9fcc-50079323dcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:59.817859 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1299/2573] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:59.828934 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31883c76-b830-4e53-b6d0-d514af0fe99d admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:59.830390 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-31883c76-b830-4e53-b6d0-d514af0fe99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:59.899471 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31883c76-b830-4e53-b6d0-d514af0fe99d admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:59.903555 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f62d14-364e-49e5-8b15-6269af3b6a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:59.904372 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f62d14-364e-49e5-8b15-6269af3b6a52 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:59.904758 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f62d14-364e-49e5-8b15-6269af3b6a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:59.905099 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f62d14-364e-49e5-8b15-6269af3b6a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:59.914825 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f62d14-364e-49e5-8b15-6269af3b6a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:59.916601 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f62d14-364e-49e5-8b15-6269af3b6a52 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:59.927340 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1275/2574] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:00.511940 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526f54f-30ca-4fbd-9fcc-50079323dcef None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:00.514324 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a526f54f-30ca-4fbd-9fcc-50079323dcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:00.526514 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526f54f-30ca-4fbd-9fcc-50079323dcef None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:00.531910 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e1466-702d-4981-9cf0-3b8e6e5e8bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:00.532945 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e1466-702d-4981-9cf0-3b8e6e5e8bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:00.533457 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e1466-702d-4981-9cf0-3b8e6e5e8bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:00.533830 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e1466-702d-4981-9cf0-3b8e6e5e8bc3 admin admin] PATH_INFO: `/v3/projects/75caa499303d4a27ab32c2409c558f30` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:00.535145 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e1466-702d-4981-9cf0-3b8e6e5e8bc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75caa499303d4a27ab32c2409c558f30)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:00.537255 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e1466-702d-4981-9cf0-3b8e6e5e8bc3 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:00.742545 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3d9e1466-702d-4981-9cf0-3b8e6e5e8bc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75caa499303d4a27ab32c2409c558f30', 'request_id': 'req-3d9e1466-702d-4981-9cf0-3b8e6e5e8bc3'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:00.758343 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3d9e1466-702d-4981-9cf0-3b8e6e5e8bc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75caa499303d4a27ab32c2409c558f30', 'request_id': 'req-3d9e1466-702d-4981-9cf0-3b8e6e5e8bc3'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:00.766318 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3d9e1466-702d-4981-9cf0-3b8e6e5e8bc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75caa499303d4a27ab32c2409c558f30', 'request_id': 'req-3d9e1466-702d-4981-9cf0-3b8e6e5e8bc3'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:00.864698 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3d9e1466-702d-4981-9cf0-3b8e6e5e8bc3 admin admin] The token cache is being invalidate because project 75caa499303d4a27ab32c2409c558f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:00.865003 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3d9e1466-702d-4981-9cf0-3b8e6e5e8bc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:00.870016 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3d9e1466-702d-4981-9cf0-3b8e6e5e8bc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:00.870016 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1300/2575] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:00 2022] DELETE /identity/v3/projects/75caa499303d4a27ab32c2409c558f30 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:00.871673 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f62d14-364e-49e5-8b15-6269af3b6a52 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:00.881467 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f62d14-364e-49e5-8b15-6269af3b6a52 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:00.941660 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144c342-cd26-4e02-89ba-23668176fce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:00.942839 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144c342-cd26-4e02-89ba-23668176fce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:00.943099 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144c342-cd26-4e02-89ba-23668176fce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:00.943418 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144c342-cd26-4e02-89ba-23668176fce1 admin admin] PATH_INFO: `/v3/users/ab75faa1350a4aef905bf8fc8c736fb4` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:00.944874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144c342-cd26-4e02-89ba-23668176fce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab75faa1350a4aef905bf8fc8c736fb4)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:00.948910 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144c342-cd26-4e02-89ba-23668176fce1 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:01.144196 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7144c342-cd26-4e02-89ba-23668176fce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab75faa1350a4aef905bf8fc8c736fb4'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:01.158318 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7144c342-cd26-4e02-89ba-23668176fce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab75faa1350a4aef905bf8fc8c736fb4'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:01.159546 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7144c342-cd26-4e02-89ba-23668176fce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab75faa1350a4aef905bf8fc8c736fb4'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:01.257830 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7144c342-cd26-4e02-89ba-23668176fce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab75faa1350a4aef905bf8fc8c736fb4'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:01.258554 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7144c342-cd26-4e02-89ba-23668176fce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab75faa1350a4aef905bf8fc8c736fb4'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:01.271887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1276/2576] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:00 2022] DELETE /identity/v3/users/ab75faa1350a4aef905bf8fc8c736fb4 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:01.786284 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e1466-702d-4981-9cf0-3b8e6e5e8bc3 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:01.795930 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-3d9e1466-702d-4981-9cf0-3b8e6e5e8bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:01.820622 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e1466-702d-4981-9cf0-3b8e6e5e8bc3 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:01.898891 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7d0d2-1592-41fc-9608-8b83f5ba8d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:01.900000 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7d0d2-1592-41fc-9608-8b83f5ba8d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:01.900342 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7d0d2-1592-41fc-9608-8b83f5ba8d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:01.900843 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7d0d2-1592-41fc-9608-8b83f5ba8d78 admin admin] PATH_INFO: `/v3/projects/b4463c9f9f9f464baddf505d744e1651` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:01.902638 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7d0d2-1592-41fc-9608-8b83f5ba8d78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4463c9f9f9f464baddf505d744e1651)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:01.905621 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7d0d2-1592-41fc-9608-8b83f5ba8d78 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:02.031640 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda5a6-db72-4814-b5c9-e2d2628b3cd0 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:02.031640 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda5a6-db72-4814-b5c9-e2d2628b3cd0 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:02.031640 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda5a6-db72-4814-b5c9-e2d2628b3cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:02.070878 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-61f7d0d2-1592-41fc-9608-8b83f5ba8d78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4463c9f9f9f464baddf505d744e1651', 'request_id': 'req-61f7d0d2-1592-41fc-9608-8b83f5ba8d78'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:02.072327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-98fda5a6-db72-4814-b5c9-e2d2628b3cd0 None None] MFA Rules not processed for user `f88b139b7ac7488c9b48216350775c71`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:02.073308 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-98fda5a6-db72-4814-b5c9-e2d2628b3cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:02.078269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-61f7d0d2-1592-41fc-9608-8b83f5ba8d78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4463c9f9f9f464baddf505d744e1651', 'request_id': 'req-61f7d0d2-1592-41fc-9608-8b83f5ba8d78'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:02.087172 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-61f7d0d2-1592-41fc-9608-8b83f5ba8d78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4463c9f9f9f464baddf505d744e1651', 'request_id': 'req-61f7d0d2-1592-41fc-9608-8b83f5ba8d78'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:02.164547 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-61f7d0d2-1592-41fc-9608-8b83f5ba8d78 admin admin] The token cache is being invalidate because project b4463c9f9f9f464baddf505d744e1651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:02.165228 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-61f7d0d2-1592-41fc-9608-8b83f5ba8d78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:02.166426 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-61f7d0d2-1592-41fc-9608-8b83f5ba8d78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:02.170209 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1301/2577] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:01 2022] DELETE /identity/v3/projects/b4463c9f9f9f464baddf505d744e1651 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:02.174834 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1277/2578] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:53:02.175012 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c373f-9e26-4d2f-a91a-47a5fa05eeb7 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:02.175154 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c373f-9e26-4d2f-a91a-47a5fa05eeb7 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:02.175606 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c373f-9e26-4d2f-a91a-47a5fa05eeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:02.181458 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fda5a6-db72-4814-b5c9-e2d2628b3cd0 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:02.184064 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-98fda5a6-db72-4814-b5c9-e2d2628b3cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:02.205770 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-b12c373f-9e26-4d2f-a91a-47a5fa05eeb7 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:02.206743 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b12c373f-9e26-4d2f-a91a-47a5fa05eeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:02.259493 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fda5a6-db72-4814-b5c9-e2d2628b3cd0 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:02.264517 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746aa7f3-cdd6-470b-a0ed-1f0691ceb3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:02.265308 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746aa7f3-cdd6-470b-a0ed-1f0691ceb3c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:02.265720 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746aa7f3-cdd6-470b-a0ed-1f0691ceb3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:02.266002 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746aa7f3-cdd6-470b-a0ed-1f0691ceb3c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:02.266700 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746aa7f3-cdd6-470b-a0ed-1f0691ceb3c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:02.268784 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746aa7f3-cdd6-470b-a0ed-1f0691ceb3c9 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:02.272652 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1302/2579] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:53:02.280082 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969ccbe-9ad7-4861-b304-9c573f53255c None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:02.280372 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969ccbe-9ad7-4861-b304-9c573f53255c None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:02.280877 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969ccbe-9ad7-4861-b304-9c573f53255c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:02.300760 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-6969ccbe-9ad7-4861-b304-9c573f53255c None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:02.301999 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-6969ccbe-9ad7-4861-b304-9c573f53255c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:02.310094 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1303/2580] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:53:02.314430 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969ccbe-9ad7-4861-b304-9c573f53255c None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:02.323944 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969ccbe-9ad7-4861-b304-9c573f53255c None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:02.329705 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8281c-acfe-42ca-b8ae-04b740579735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:02.330502 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8281c-acfe-42ca-b8ae-04b740579735 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:02.330939 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8281c-acfe-42ca-b8ae-04b740579735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:02.331061 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8281c-acfe-42ca-b8ae-04b740579735 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:02.331771 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8281c-acfe-42ca-b8ae-04b740579735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:53:02.332078 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8281c-acfe-42ca-b8ae-04b740579735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:02.333744 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8281c-acfe-42ca-b8ae-04b740579735 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:02.350772 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1304/2581] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:53:02.351702 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8281c-acfe-42ca-b8ae-04b740579735 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:02.352794 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1278/2582] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:02 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:02.358189 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746aa7f3-cdd6-470b-a0ed-1f0691ceb3c9 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:02.360504 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-746aa7f3-cdd6-470b-a0ed-1f0691ceb3c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:02.362728 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8281c-acfe-42ca-b8ae-04b740579735 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:02.434790 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746aa7f3-cdd6-470b-a0ed-1f0691ceb3c9 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:02.435434 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a030c-c39f-440b-9c38-476cdfefca31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:02.436125 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a030c-c39f-440b-9c38-476cdfefca31 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:02.436400 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a030c-c39f-440b-9c38-476cdfefca31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:02.436685 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a030c-c39f-440b-9c38-476cdfefca31 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:02.437381 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a030c-c39f-440b-9c38-476cdfefca31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:02.439264 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a030c-c39f-440b-9c38-476cdfefca31 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:02.439974 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650544a-a96d-4058-a53a-3e6be5a08eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:02.440637 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650544a-a96d-4058-a53a-3e6be5a08eda admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:02.440951 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650544a-a96d-4058-a53a-3e6be5a08eda admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:02.441229 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650544a-a96d-4058-a53a-3e6be5a08eda admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:02.441915 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650544a-a96d-4058-a53a-3e6be5a08eda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:02.443863 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650544a-a96d-4058-a53a-3e6be5a08eda admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:02.522182 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1305/2583] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:02 2022] POST /identity/v3/projects => generated 367 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:02.526203 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a030c-c39f-440b-9c38-476cdfefca31 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:02.533995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1279/2584] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:02 2022] POST /identity/v3/users => generated 299 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:02.535423 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650544a-a96d-4058-a53a-3e6be5a08eda admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:02.545396 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650544a-a96d-4058-a53a-3e6be5a08eda admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:02.589258 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a030c-c39f-440b-9c38-476cdfefca31 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:02.594185 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd714b4-9287-429c-a69f-48ad73294c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:02.594882 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd714b4-9287-429c-a69f-48ad73294c1b admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:02.595170 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd714b4-9287-429c-a69f-48ad73294c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:02.595448 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd714b4-9287-429c-a69f-48ad73294c1b admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:02.596394 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd714b4-9287-429c-a69f-48ad73294c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:02.598358 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd714b4-9287-429c-a69f-48ad73294c1b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:02.601181 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de139cb8-4581-4ac7-890c-349144ef67a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:02.601923 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de139cb8-4581-4ac7-890c-349144ef67a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:02.602206 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de139cb8-4581-4ac7-890c-349144ef67a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:02.602482 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de139cb8-4581-4ac7-890c-349144ef67a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:02.603199 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de139cb8-4581-4ac7-890c-349144ef67a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:02.604979 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de139cb8-4581-4ac7-890c-349144ef67a7 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:02.614718 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1280/2585] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:53:02.621418 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de139cb8-4581-4ac7-890c-349144ef67a7 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:02.631562 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de139cb8-4581-4ac7-890c-349144ef67a7 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:02.636292 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec7c4d-7cce-4415-ab5f-b564f6c681b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:02.637172 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec7c4d-7cce-4415-ab5f-b564f6c681b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:02.637459 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec7c4d-7cce-4415-ab5f-b564f6c681b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:02.641717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec7c4d-7cce-4415-ab5f-b564f6c681b2 admin admin] PATH_INFO: `/v3/projects/3a0ad0c63485438ea5c96440d54a16a4/users/067cf24e92ad4d88988cb9814c404384/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:02.652902 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec7c4d-7cce-4415-ab5f-b564f6c681b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0ad0c63485438ea5c96440d54a16a4, user_id=067cf24e92ad4d88988cb9814c404384, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:02.655832 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec7c4d-7cce-4415-ab5f-b564f6c681b2 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:02.669213 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1306/2586] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:02 2022] POST /identity/v3/users => generated 284 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:53:02.673185 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd714b4-9287-429c-a69f-48ad73294c1b admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:02.683012 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd714b4-9287-429c-a69f-48ad73294c1b admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:02.688121 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bd039-24a6-443f-845a-260eeb42fd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:02.688796 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bd039-24a6-443f-845a-260eeb42fd18 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:02.689076 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bd039-24a6-443f-845a-260eeb42fd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:02.689347 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bd039-24a6-443f-845a-260eeb42fd18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:02.690076 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bd039-24a6-443f-845a-260eeb42fd18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:02.691654 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bd039-24a6-443f-845a-260eeb42fd18 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:02.701584 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1307/2587] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:53:02.705331 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bd039-24a6-443f-845a-260eeb42fd18 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:02.714483 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bd039-24a6-443f-845a-260eeb42fd18 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:02.719068 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1281/2588] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:02 2022] PUT /identity/v3/projects/3a0ad0c63485438ea5c96440d54a16a4/users/067cf24e92ad4d88988cb9814c404384/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:02.728979 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec7c4d-7cce-4415-ab5f-b564f6c681b2 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:02.770192 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e525bb8-bbc5-4d0e-a643-c2765e24f5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:02.770849 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e525bb8-bbc5-4d0e-a643-c2765e24f5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:02.771127 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e525bb8-bbc5-4d0e-a643-c2765e24f5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:02.771394 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e525bb8-bbc5-4d0e-a643-c2765e24f5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:02.772156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e525bb8-bbc5-4d0e-a643-c2765e24f5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:02.773897 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e525bb8-bbc5-4d0e-a643-c2765e24f5b0 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:02.784400 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1308/2589] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:53:02.788923 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e525bb8-bbc5-4d0e-a643-c2765e24f5b0 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:02.790054 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec7c4d-7cce-4415-ab5f-b564f6c681b2 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:02.795903 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50100f1b-7d3b-49b1-a6e8-e6cef988ec61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:02.796951 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50100f1b-7d3b-49b1-a6e8-e6cef988ec61 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:02.797365 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50100f1b-7d3b-49b1-a6e8-e6cef988ec61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:02.797567 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50100f1b-7d3b-49b1-a6e8-e6cef988ec61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:02.798317 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50100f1b-7d3b-49b1-a6e8-e6cef988ec61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:02.799478 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e525bb8-bbc5-4d0e-a643-c2765e24f5b0 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:02.799881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50100f1b-7d3b-49b1-a6e8-e6cef988ec61 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:02.806675 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e116be7-dbf9-4601-bf97-bfab37997fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:02.807580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e116be7-dbf9-4601-bf97-bfab37997fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:02.807862 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e116be7-dbf9-4601-bf97-bfab37997fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:02.808143 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e116be7-dbf9-4601-bf97-bfab37997fc8 admin admin] PATH_INFO: `/v3/projects/9a269b028d534daab856af8524e186b6/users/665e10c27c7e45d3bb83064086e3a996/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:02.816826 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1282/2590] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:53:02.821230 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50100f1b-7d3b-49b1-a6e8-e6cef988ec61 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:02.825824 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e116be7-dbf9-4601-bf97-bfab37997fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a269b028d534daab856af8524e186b6, user_id=665e10c27c7e45d3bb83064086e3a996, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:02.828694 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e116be7-dbf9-4601-bf97-bfab37997fc8 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:02.834723 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50100f1b-7d3b-49b1-a6e8-e6cef988ec61 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:02.839722 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96d35e-3412-4bec-9d61-bf16a2b97940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:02.840634 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96d35e-3412-4bec-9d61-bf16a2b97940 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:02.841019 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96d35e-3412-4bec-9d61-bf16a2b97940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:02.841895 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96d35e-3412-4bec-9d61-bf16a2b97940 admin admin] PATH_INFO: `/v3/projects/3a0ad0c63485438ea5c96440d54a16a4/users/067cf24e92ad4d88988cb9814c404384/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:02.844172 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96d35e-3412-4bec-9d61-bf16a2b97940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0ad0c63485438ea5c96440d54a16a4, user_id=067cf24e92ad4d88988cb9814c404384, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:02.847337 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96d35e-3412-4bec-9d61-bf16a2b97940 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:02.860855 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1283/2591] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:02 2022] PUT /identity/v3/projects/3a0ad0c63485438ea5c96440d54a16a4/users/067cf24e92ad4d88988cb9814c404384/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:02.915814 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1309/2592] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:02 2022] PUT /identity/v3/projects/9a269b028d534daab856af8524e186b6/users/665e10c27c7e45d3bb83064086e3a996/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:02.926566 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be98290-7f08-4f07-a360-35205e2e142a None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:02.926857 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be98290-7f08-4f07-a360-35205e2e142a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:02.927136 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be98290-7f08-4f07-a360-35205e2e142a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:02.961807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-5be98290-7f08-4f07-a360-35205e2e142a None None] MFA Rules not processed for user `665e10c27c7e45d3bb83064086e3a996`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:02.963032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-5be98290-7f08-4f07-a360-35205e2e142a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:03.049683 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1284/2593] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:03.053863 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e116be7-dbf9-4601-bf97-bfab37997fc8 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:03.138085 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e116be7-dbf9-4601-bf97-bfab37997fc8 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:03.143718 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566a1d4-2f14-4e36-beee-8e6a3b59be27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:03.144560 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566a1d4-2f14-4e36-beee-8e6a3b59be27 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:03.145115 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566a1d4-2f14-4e36-beee-8e6a3b59be27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:03.145546 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566a1d4-2f14-4e36-beee-8e6a3b59be27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:03.146412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566a1d4-2f14-4e36-beee-8e6a3b59be27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:03.148317 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566a1d4-2f14-4e36-beee-8e6a3b59be27 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:03.234679 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1310/2594] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:03 2022] POST /identity/v3/projects => generated 367 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:03.238794 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be98290-7f08-4f07-a360-35205e2e142a None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:03.260745 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be98290-7f08-4f07-a360-35205e2e142a None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:03.382684 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e30f7c-6dee-4ff7-ab37-69e18a939b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:03.383436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e30f7c-6dee-4ff7-ab37-69e18a939b7e admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:03.383793 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e30f7c-6dee-4ff7-ab37-69e18a939b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:03.384122 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e30f7c-6dee-4ff7-ab37-69e18a939b7e admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:03.385126 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e30f7c-6dee-4ff7-ab37-69e18a939b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:03.387116 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e30f7c-6dee-4ff7-ab37-69e18a939b7e admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:03.470369 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1285/2595] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:03 2022] POST /identity/v3/users => generated 290 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:03.474439 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566a1d4-2f14-4e36-beee-8e6a3b59be27 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:03.495874 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566a1d4-2f14-4e36-beee-8e6a3b59be27 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:03.501543 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b07fb-ad3a-407f-95bb-af4e28a3d256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:03.502366 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b07fb-ad3a-407f-95bb-af4e28a3d256 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:03.502757 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b07fb-ad3a-407f-95bb-af4e28a3d256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:03.503112 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b07fb-ad3a-407f-95bb-af4e28a3d256 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:03.503945 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b07fb-ad3a-407f-95bb-af4e28a3d256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:03.506314 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b07fb-ad3a-407f-95bb-af4e28a3d256 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:03.523016 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1311/2596] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:03.527007 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e30f7c-6dee-4ff7-ab37-69e18a939b7e admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:03.537433 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e30f7c-6dee-4ff7-ab37-69e18a939b7e admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:03.558852 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f51c7-f64f-4997-9348-67ab659fc681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:03.559976 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f51c7-f64f-4997-9348-67ab659fc681 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:03.561441 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f51c7-f64f-4997-9348-67ab659fc681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:03.561846 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f51c7-f64f-4997-9348-67ab659fc681 admin admin] PATH_INFO: `/v3/projects/dba7f455615e4434a7038236c0e0486a/users/37c5f7bcceeb44509d15c92954896648/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:03.580214 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f51c7-f64f-4997-9348-67ab659fc681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba7f455615e4434a7038236c0e0486a, user_id=37c5f7bcceeb44509d15c92954896648, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:03.582939 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f51c7-f64f-4997-9348-67ab659fc681 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:03.703800 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1286/2597] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:03 2022] PUT /identity/v3/projects/dba7f455615e4434a7038236c0e0486a/users/37c5f7bcceeb44509d15c92954896648/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:03.707772 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b07fb-ad3a-407f-95bb-af4e28a3d256 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:03.717442 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b07fb-ad3a-407f-95bb-af4e28a3d256 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:03.782768 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046f466-0b68-423d-9da6-44b7c0bc4ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:03.783580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046f466-0b68-423d-9da6-44b7c0bc4ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:03.783961 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046f466-0b68-423d-9da6-44b7c0bc4ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:03.784366 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046f466-0b68-423d-9da6-44b7c0bc4ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:03.785239 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046f466-0b68-423d-9da6-44b7c0bc4ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:03.786975 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046f466-0b68-423d-9da6-44b7c0bc4ec9 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:03.799109 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1312/2598] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:03.803997 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f51c7-f64f-4997-9348-67ab659fc681 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:03.815996 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f51c7-f64f-4997-9348-67ab659fc681 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:03.820751 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a125b0-d019-4fc8-a14a-5b4fa901d971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:03.821798 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a125b0-d019-4fc8-a14a-5b4fa901d971 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:03.827298 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a125b0-d019-4fc8-a14a-5b4fa901d971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:03.827298 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a125b0-d019-4fc8-a14a-5b4fa901d971 admin admin] PATH_INFO: `/v3/projects/dba7f455615e4434a7038236c0e0486a/users/37c5f7bcceeb44509d15c92954896648/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:03.827298 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a125b0-d019-4fc8-a14a-5b4fa901d971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba7f455615e4434a7038236c0e0486a, user_id=37c5f7bcceeb44509d15c92954896648, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:03.827298 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a125b0-d019-4fc8-a14a-5b4fa901d971 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:03.838032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1287/2599] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:03 2022] PUT /identity/v3/projects/dba7f455615e4434a7038236c0e0486a/users/37c5f7bcceeb44509d15c92954896648/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:03.850472 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50c6f6-9a63-413c-bf43-3057a43bc6a0 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:03.851060 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50c6f6-9a63-413c-bf43-3057a43bc6a0 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:03.855858 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50c6f6-9a63-413c-bf43-3057a43bc6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:03.893772 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-4d50c6f6-9a63-413c-bf43-3057a43bc6a0 None None] MFA Rules not processed for user `37c5f7bcceeb44509d15c92954896648`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:03.895739 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-4d50c6f6-9a63-413c-bf43-3057a43bc6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:03.971058 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1313/2600] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:03 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:04.042107 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a125b0-d019-4fc8-a14a-5b4fa901d971 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:04.045002 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-31a125b0-d019-4fc8-a14a-5b4fa901d971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:04.104483 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a125b0-d019-4fc8-a14a-5b4fa901d971 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:04.108396 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d4ae8-6d00-4016-909e-94a3ef32f1f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:04.109069 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d4ae8-6d00-4016-909e-94a3ef32f1f2 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:04.109349 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d4ae8-6d00-4016-909e-94a3ef32f1f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:04.109624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d4ae8-6d00-4016-909e-94a3ef32f1f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:04.118489 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d4ae8-6d00-4016-909e-94a3ef32f1f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:04.119913 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d4ae8-6d00-4016-909e-94a3ef32f1f2 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:04.129810 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1288/2601] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:04 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:07.782819 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50c6f6-9a63-413c-bf43-3057a43bc6a0 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:07.884091 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50c6f6-9a63-413c-bf43-3057a43bc6a0 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:07.889815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3697ae9-fca1-4ecc-8e4c-62744ffe4100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:07.890708 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3697ae9-fca1-4ecc-8e4c-62744ffe4100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:07.890993 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3697ae9-fca1-4ecc-8e4c-62744ffe4100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:07.891267 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3697ae9-fca1-4ecc-8e4c-62744ffe4100 admin admin] PATH_INFO: `/v3/users/665e10c27c7e45d3bb83064086e3a996` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:07.892771 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3697ae9-fca1-4ecc-8e4c-62744ffe4100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=665e10c27c7e45d3bb83064086e3a996)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:07.894891 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3697ae9-fca1-4ecc-8e4c-62744ffe4100 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:08.095028 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-b3697ae9-fca1-4ecc-8e4c-62744ffe4100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665e10c27c7e45d3bb83064086e3a996'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:08.107614 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-b3697ae9-fca1-4ecc-8e4c-62744ffe4100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665e10c27c7e45d3bb83064086e3a996'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:08.108327 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-b3697ae9-fca1-4ecc-8e4c-62744ffe4100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665e10c27c7e45d3bb83064086e3a996'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:08.108955 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-b3697ae9-fca1-4ecc-8e4c-62744ffe4100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665e10c27c7e45d3bb83064086e3a996'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:08.115531 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-b3697ae9-fca1-4ecc-8e4c-62744ffe4100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665e10c27c7e45d3bb83064086e3a996'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:08.218114 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1314/2602] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:07 2022] DELETE /identity/v3/users/665e10c27c7e45d3bb83064086e3a996 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:08.230018 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac78036-0de9-4c92-8597-5b6a035537b3 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:08.230541 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac78036-0de9-4c92-8597-5b6a035537b3 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:08.230733 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac78036-0de9-4c92-8597-5b6a035537b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:08.260004 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-8ac78036-0de9-4c92-8597-5b6a035537b3 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:08.261911 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-8ac78036-0de9-4c92-8597-5b6a035537b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:08.355731 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1289/2603] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:08.368184 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3697ae9-fca1-4ecc-8e4c-62744ffe4100 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:08.371220 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b3697ae9-fca1-4ecc-8e4c-62744ffe4100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:08.454207 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3697ae9-fca1-4ecc-8e4c-62744ffe4100 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:08.459265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9068e-b4ed-4427-b204-bc8effb01b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:08.459924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9068e-b4ed-4427-b204-bc8effb01b55 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:08.460208 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9068e-b4ed-4427-b204-bc8effb01b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:08.460484 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9068e-b4ed-4427-b204-bc8effb01b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:08.471269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9068e-b4ed-4427-b204-bc8effb01b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:08.472767 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9068e-b4ed-4427-b204-bc8effb01b55 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:08.483651 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1315/2604] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:08.946144 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac78036-0de9-4c92-8597-5b6a035537b3 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:08.947330 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-8ac78036-0de9-4c92-8597-5b6a035537b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:08.964617 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac78036-0de9-4c92-8597-5b6a035537b3 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:08.978106 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d75d86-287b-4f19-8bd1-15a9fa720783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:08.979223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d75d86-287b-4f19-8bd1-15a9fa720783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:08.979498 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d75d86-287b-4f19-8bd1-15a9fa720783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:08.979929 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d75d86-287b-4f19-8bd1-15a9fa720783 admin admin] PATH_INFO: `/v3/projects/9a269b028d534daab856af8524e186b6` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:08.981603 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d75d86-287b-4f19-8bd1-15a9fa720783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a269b028d534daab856af8524e186b6)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:08.983986 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d75d86-287b-4f19-8bd1-15a9fa720783 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:09.127716 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-44d75d86-287b-4f19-8bd1-15a9fa720783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a269b028d534daab856af8524e186b6', 'request_id': 'req-44d75d86-287b-4f19-8bd1-15a9fa720783'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.192943 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-44d75d86-287b-4f19-8bd1-15a9fa720783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a269b028d534daab856af8524e186b6', 'request_id': 'req-44d75d86-287b-4f19-8bd1-15a9fa720783'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.199502 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-44d75d86-287b-4f19-8bd1-15a9fa720783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a269b028d534daab856af8524e186b6', 'request_id': 'req-44d75d86-287b-4f19-8bd1-15a9fa720783'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.223371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-44d75d86-287b-4f19-8bd1-15a9fa720783 admin admin] The token cache is being invalidate because project 9a269b028d534daab856af8524e186b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:09.223673 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-44d75d86-287b-4f19-8bd1-15a9fa720783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.224345 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-44d75d86-287b-4f19-8bd1-15a9fa720783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.229380 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1290/2605] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:08 2022] DELETE /identity/v3/projects/9a269b028d534daab856af8524e186b6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:09.231335 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9068e-b4ed-4427-b204-bc8effb01b55 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:09.249456 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9068e-b4ed-4427-b204-bc8effb01b55 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:09.328691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bd97b-fb05-4d14-b998-ca113a18fe48 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:09.332874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bd97b-fb05-4d14-b998-ca113a18fe48 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:09.333317 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bd97b-fb05-4d14-b998-ca113a18fe48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:09.356231 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c312613-c2ee-49ca-ae6c-4755ef188515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:09.357381 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c312613-c2ee-49ca-ae6c-4755ef188515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:09.357966 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c312613-c2ee-49ca-ae6c-4755ef188515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:09.357966 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c312613-c2ee-49ca-ae6c-4755ef188515 admin admin] PATH_INFO: `/v3/users/37c5f7bcceeb44509d15c92954896648` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:09.359272 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c312613-c2ee-49ca-ae6c-4755ef188515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c5f7bcceeb44509d15c92954896648)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:09.361261 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c312613-c2ee-49ca-ae6c-4755ef188515 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:09.368791 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-287bd97b-fb05-4d14-b998-ca113a18fe48 None None] MFA Rules not processed for user `067cf24e92ad4d88988cb9814c404384`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:09.370812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-287bd97b-fb05-4d14-b998-ca113a18fe48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:09.476528 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1291/2606] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:09.495016 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bd97b-fb05-4d14-b998-ca113a18fe48 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:09.496652 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-287bd97b-fb05-4d14-b998-ca113a18fe48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:09.582208 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bd97b-fb05-4d14-b998-ca113a18fe48 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:09.586682 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b020d2f-8850-4f37-b171-dd8147219c81 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81124c3324d7427a9f29270b88e88f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:09.587330 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b020d2f-8850-4f37-b171-dd8147219c81 service glance] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:09.587613 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b020d2f-8850-4f37-b171-dd8147219c81 service glance] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:09.587890 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b020d2f-8850-4f37-b171-dd8147219c81 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:09.589848 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-2b020d2f-8850-4f37-b171-dd8147219c81 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:09.609760 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-6c312613-c2ee-49ca-ae6c-4755ef188515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c5f7bcceeb44509d15c92954896648'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.623607 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-6c312613-c2ee-49ca-ae6c-4755ef188515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c5f7bcceeb44509d15c92954896648'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.624464 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-6c312613-c2ee-49ca-ae6c-4755ef188515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c5f7bcceeb44509d15c92954896648'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.625299 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-6c312613-c2ee-49ca-ae6c-4755ef188515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c5f7bcceeb44509d15c92954896648'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.633046 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-6c312613-c2ee-49ca-ae6c-4755ef188515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c5f7bcceeb44509d15c92954896648'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.654712 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b020d2f-8850-4f37-b171-dd8147219c81 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:09.656479 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b020d2f-8850-4f37-b171-dd8147219c81 service glance] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:09.667618 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1292/2607] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:53:09.747349 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1316/2608] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:09 2022] DELETE /identity/v3/users/37c5f7bcceeb44509d15c92954896648 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:09.964078 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12f5d1-4ffc-41f0-a8d3-874b04b90321 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:09.964377 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12f5d1-4ffc-41f0-a8d3-874b04b90321 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:09.964937 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12f5d1-4ffc-41f0-a8d3-874b04b90321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:10.039306 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-1c12f5d1-4ffc-41f0-a8d3-874b04b90321 None None] MFA Rules not processed for user `556058de7b9f48b8a10188ec64496e72`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:10.040542 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1c12f5d1-4ffc-41f0-a8d3-874b04b90321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:10.115736 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1293/2609] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 13:53:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:53:10.277482 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c312613-c2ee-49ca-ae6c-4755ef188515 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:10.283033 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12f5d1-4ffc-41f0-a8d3-874b04b90321 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:10.283434 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-6c312613-c2ee-49ca-ae6c-4755ef188515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:10.283546 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1c12f5d1-4ffc-41f0-a8d3-874b04b90321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:10.357475 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c312613-c2ee-49ca-ae6c-4755ef188515 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:10.362863 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6145bf9-d3bf-4345-9cd2-ef9c44658f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:10.363997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6145bf9-d3bf-4345-9cd2-ef9c44658f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:10.364425 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6145bf9-d3bf-4345-9cd2-ef9c44658f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:10.364898 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6145bf9-d3bf-4345-9cd2-ef9c44658f82 admin admin] PATH_INFO: `/v3/projects/dba7f455615e4434a7038236c0e0486a` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:10.366088 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6145bf9-d3bf-4345-9cd2-ef9c44658f82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dba7f455615e4434a7038236c0e0486a)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:10.368116 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6145bf9-d3bf-4345-9cd2-ef9c44658f82 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:10.399003 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12f5d1-4ffc-41f0-a8d3-874b04b90321 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:10.404924 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71a59d-4da2-4c36-b036-9db76ccc54fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f375d86747d248fa95f487b073d92d83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:10.405612 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71a59d-4da2-4c36-b036-9db76ccc54fc service swift] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:10.409035 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71a59d-4da2-4c36-b036-9db76ccc54fc service swift] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:10.409035 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71a59d-4da2-4c36-b036-9db76ccc54fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:10.414762 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71a59d-4da2-4c36-b036-9db76ccc54fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:10.416453 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71a59d-4da2-4c36-b036-9db76ccc54fc service swift] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:10.426289 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1294/2610] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 13:53:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:53:10.513530 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-e6145bf9-d3bf-4345-9cd2-ef9c44658f82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dba7f455615e4434a7038236c0e0486a', 'request_id': 'req-e6145bf9-d3bf-4345-9cd2-ef9c44658f82'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:10.522635 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-e6145bf9-d3bf-4345-9cd2-ef9c44658f82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dba7f455615e4434a7038236c0e0486a', 'request_id': 'req-e6145bf9-d3bf-4345-9cd2-ef9c44658f82'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:10.531620 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-e6145bf9-d3bf-4345-9cd2-ef9c44658f82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dba7f455615e4434a7038236c0e0486a', 'request_id': 'req-e6145bf9-d3bf-4345-9cd2-ef9c44658f82'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:10.623232 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-e6145bf9-d3bf-4345-9cd2-ef9c44658f82 admin admin] The token cache is being invalidate because project dba7f455615e4434a7038236c0e0486a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:10.623522 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-e6145bf9-d3bf-4345-9cd2-ef9c44658f82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:10.624365 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-e6145bf9-d3bf-4345-9cd2-ef9c44658f82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:10.626604 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1317/2611] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:10 2022] DELETE /identity/v3/projects/dba7f455615e4434a7038236c0e0486a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:10.631571 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589cdf7-6f3e-4ecf-ac34-60d8640dca42 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:10.632086 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589cdf7-6f3e-4ecf-ac34-60d8640dca42 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:10.632488 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589cdf7-6f3e-4ecf-ac34-60d8640dca42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:10.652210 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-7589cdf7-6f3e-4ecf-ac34-60d8640dca42 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:10.653757 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7589cdf7-6f3e-4ecf-ac34-60d8640dca42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:10.723887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1295/2612] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:10.732169 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e730e0a-c8df-4538-8aa9-9ac2b2cae5d7 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:10.732483 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e730e0a-c8df-4538-8aa9-9ac2b2cae5d7 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:10.732786 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e730e0a-c8df-4538-8aa9-9ac2b2cae5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:10.753415 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-4e730e0a-c8df-4538-8aa9-9ac2b2cae5d7 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:10.754664 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-4e730e0a-c8df-4538-8aa9-9ac2b2cae5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:10.767970 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589cdf7-6f3e-4ecf-ac34-60d8640dca42 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:10.780866 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1318/2613] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:10.791780 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589cdf7-6f3e-4ecf-ac34-60d8640dca42 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:10.801568 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226a0ac-80f8-4539-8ac3-80ee53ca4f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:10.802813 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226a0ac-80f8-4539-8ac3-80ee53ca4f63 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:10.807099 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226a0ac-80f8-4539-8ac3-80ee53ca4f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:10.807530 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226a0ac-80f8-4539-8ac3-80ee53ca4f63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:10.808233 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226a0ac-80f8-4539-8ac3-80ee53ca4f63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:53:10.808549 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226a0ac-80f8-4539-8ac3-80ee53ca4f63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:10.811378 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226a0ac-80f8-4539-8ac3-80ee53ca4f63 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:10.842590 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1296/2614] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:53:10.847695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e730e0a-c8df-4538-8aa9-9ac2b2cae5d7 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:10.856377 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e730e0a-c8df-4538-8aa9-9ac2b2cae5d7 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:10.891360 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24051530-1562-4336-bf69-875af4c4b282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:10.892159 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24051530-1562-4336-bf69-875af4c4b282 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:10.892525 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24051530-1562-4336-bf69-875af4c4b282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:10.892900 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24051530-1562-4336-bf69-875af4c4b282 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:10.893681 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24051530-1562-4336-bf69-875af4c4b282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:10.895798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24051530-1562-4336-bf69-875af4c4b282 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:11.332547 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1319/2615] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:10 2022] POST /identity/v3/projects => generated 375 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:11.334005 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226a0ac-80f8-4539-8ac3-80ee53ca4f63 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:11.353494 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226a0ac-80f8-4539-8ac3-80ee53ca4f63 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:11.449073 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13412696-807a-4dd9-b6d0-5febd8b75bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:11.455641 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13412696-807a-4dd9-b6d0-5febd8b75bda admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:11.455641 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13412696-807a-4dd9-b6d0-5febd8b75bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:11.455641 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13412696-807a-4dd9-b6d0-5febd8b75bda admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:11.455641 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13412696-807a-4dd9-b6d0-5febd8b75bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:11.455641 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13412696-807a-4dd9-b6d0-5febd8b75bda admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:11.712325 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1297/2616] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:11 2022] POST /identity/v3/users => generated 288 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:53:11.712563 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24051530-1562-4336-bf69-875af4c4b282 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:11.712563 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24051530-1562-4336-bf69-875af4c4b282 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:11.712563 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b32ab-540a-4da5-9a55-289823d2db05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:11.712563 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b32ab-540a-4da5-9a55-289823d2db05 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:11.713001 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b32ab-540a-4da5-9a55-289823d2db05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:11.713001 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b32ab-540a-4da5-9a55-289823d2db05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:11.713001 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b32ab-540a-4da5-9a55-289823d2db05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:11.713001 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b32ab-540a-4da5-9a55-289823d2db05 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:11.713001 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1320/2617] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:11.713433 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13412696-807a-4dd9-b6d0-5febd8b75bda admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:11.713980 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13412696-807a-4dd9-b6d0-5febd8b75bda admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:11.725678 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847e6eb-b0f0-42f7-8d20-dadf41f5c472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:11.728493 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847e6eb-b0f0-42f7-8d20-dadf41f5c472 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:11.728881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847e6eb-b0f0-42f7-8d20-dadf41f5c472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:11.729336 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847e6eb-b0f0-42f7-8d20-dadf41f5c472 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:11.730084 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847e6eb-b0f0-42f7-8d20-dadf41f5c472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:11.731796 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847e6eb-b0f0-42f7-8d20-dadf41f5c472 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:11.744396 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1298/2618] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:11.762521 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b32ab-540a-4da5-9a55-289823d2db05 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:11.774293 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b32ab-540a-4da5-9a55-289823d2db05 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:11.784061 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df11b8a-e2df-455b-8114-8b92181c9bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:11.786496 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df11b8a-e2df-455b-8114-8b92181c9bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:11.786965 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df11b8a-e2df-455b-8114-8b92181c9bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:11.787420 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df11b8a-e2df-455b-8114-8b92181c9bc8 admin admin] PATH_INFO: `/v3/projects/5429fc1b239d4138a1bbb1e70af7070f/users/6781d2fd2db34da6a8aa3b939f70b2e0/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:11.806093 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df11b8a-e2df-455b-8114-8b92181c9bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5429fc1b239d4138a1bbb1e70af7070f, user_id=6781d2fd2db34da6a8aa3b939f70b2e0, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:11.809118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df11b8a-e2df-455b-8114-8b92181c9bc8 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:12.048205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1321/2619] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:11 2022] PUT /identity/v3/projects/5429fc1b239d4138a1bbb1e70af7070f/users/6781d2fd2db34da6a8aa3b939f70b2e0/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:12.058477 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14d5f2-c643-4bff-9da8-37ed3d923c27 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:12.060473 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14d5f2-c643-4bff-9da8-37ed3d923c27 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:12.060473 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14d5f2-c643-4bff-9da8-37ed3d923c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:12.088438 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-eb14d5f2-c643-4bff-9da8-37ed3d923c27 None None] MFA Rules not processed for user `6781d2fd2db34da6a8aa3b939f70b2e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:12.089686 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-eb14d5f2-c643-4bff-9da8-37ed3d923c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:12.160676 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1299/2620] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:12.175709 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df11b8a-e2df-455b-8114-8b92181c9bc8 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:12.177569 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0df11b8a-e2df-455b-8114-8b92181c9bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:12.247970 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df11b8a-e2df-455b-8114-8b92181c9bc8 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:12.252008 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb7069-0596-418c-9690-e1324ed77f16 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81124c3324d7427a9f29270b88e88f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:12.252932 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb7069-0596-418c-9690-e1324ed77f16 service glance] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:12.253423 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb7069-0596-418c-9690-e1324ed77f16 service glance] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:12.253919 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb7069-0596-418c-9690-e1324ed77f16 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:12.265980 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb7069-0596-418c-9690-e1324ed77f16 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:12.267445 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb7069-0596-418c-9690-e1324ed77f16 service glance] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:12.276997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1322/2621] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:16.261512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14d5f2-c643-4bff-9da8-37ed3d923c27 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:16.261512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-eb14d5f2-c643-4bff-9da8-37ed3d923c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:16.459507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14d5f2-c643-4bff-9da8-37ed3d923c27 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:16.497024 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eba598-c90a-4808-aadd-a8a6f2cee05e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b917ce4f7f34b289218f7d36a43983e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:16.497024 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eba598-c90a-4808-aadd-a8a6f2cee05e service placement] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:16.497024 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eba598-c90a-4808-aadd-a8a6f2cee05e service placement] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:16.497024 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eba598-c90a-4808-aadd-a8a6f2cee05e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:16.498172 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-92eba598-c90a-4808-aadd-a8a6f2cee05e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:16.498172 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eba598-c90a-4808-aadd-a8a6f2cee05e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:16.498172 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eba598-c90a-4808-aadd-a8a6f2cee05e service placement] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:16.551551 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1300/2622] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:53:21.646229 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843bceb-cf85-4abf-9bcf-326b9c1ca667 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:21.647100 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843bceb-cf85-4abf-9bcf-326b9c1ca667 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:21.647518 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843bceb-cf85-4abf-9bcf-326b9c1ca667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:21.667308 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-3843bceb-cf85-4abf-9bcf-326b9c1ca667 None None] MFA Rules not processed for user `f88b139b7ac7488c9b48216350775c71`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:21.669644 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-3843bceb-cf85-4abf-9bcf-326b9c1ca667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:21.732151 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1323/2623] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:21.998480 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eba598-c90a-4808-aadd-a8a6f2cee05e service placement] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:21.999968 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-92eba598-c90a-4808-aadd-a8a6f2cee05e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:22.058932 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eba598-c90a-4808-aadd-a8a6f2cee05e service placement] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:22.063070 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24a468-a756-4c57-a9a3-edaa1fc1abdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:22.064269 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24a468-a756-4c57-a9a3-edaa1fc1abdd service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:22.064269 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24a468-a756-4c57-a9a3-edaa1fc1abdd service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:22.064269 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24a468-a756-4c57-a9a3-edaa1fc1abdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:22.066051 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-0b24a468-a756-4c57-a9a3-edaa1fc1abdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:22.076490 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24a468-a756-4c57-a9a3-edaa1fc1abdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:22.077951 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24a468-a756-4c57-a9a3-edaa1fc1abdd service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:22.086240 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1301/2624] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:29.747053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491d54f-41c8-49a8-ad2d-ef7ca1f50973 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:29.747551 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491d54f-41c8-49a8-ad2d-ef7ca1f50973 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:29.747662 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491d54f-41c8-49a8-ad2d-ef7ca1f50973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:29.766859 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-e491d54f-41c8-49a8-ad2d-ef7ca1f50973 None None] MFA Rules not processed for user `556058de7b9f48b8a10188ec64496e72`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:29.768727 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e491d54f-41c8-49a8-ad2d-ef7ca1f50973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:29.830599 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1324/2625] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 13:53:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:29.843897 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24a468-a756-4c57-a9a3-edaa1fc1abdd service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:29.845629 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-0b24a468-a756-4c57-a9a3-edaa1fc1abdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:29.912867 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24a468-a756-4c57-a9a3-edaa1fc1abdd service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:29.917764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bfcf4-a08b-4506-b586-a17594dff469 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f375d86747d248fa95f487b073d92d83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:29.919156 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bfcf4-a08b-4506-b586-a17594dff469 service swift] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:29.919431 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bfcf4-a08b-4506-b586-a17594dff469 service swift] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:29.919701 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bfcf4-a08b-4506-b586-a17594dff469 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:29.927809 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bfcf4-a08b-4506-b586-a17594dff469 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:29.929616 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bfcf4-a08b-4506-b586-a17594dff469 service swift] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:29.937883 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1302/2626] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 13:53:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:53:37.770992 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491d54f-41c8-49a8-ad2d-ef7ca1f50973 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:37.864819 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491d54f-41c8-49a8-ad2d-ef7ca1f50973 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:37.864819 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1247b4-f0ff-4f6b-aa8b-7e384a2520e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:37.864819 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1247b4-f0ff-4f6b-aa8b-7e384a2520e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:37.864819 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1247b4-f0ff-4f6b-aa8b-7e384a2520e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:37.865385 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1247b4-f0ff-4f6b-aa8b-7e384a2520e3 admin admin] PATH_INFO: `/v3/users/6781d2fd2db34da6a8aa3b939f70b2e0` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:37.865385 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1247b4-f0ff-4f6b-aa8b-7e384a2520e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6781d2fd2db34da6a8aa3b939f70b2e0)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:37.865385 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1247b4-f0ff-4f6b-aa8b-7e384a2520e3 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:38.494098 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ed1247b4-f0ff-4f6b-aa8b-7e384a2520e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6781d2fd2db34da6a8aa3b939f70b2e0'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:38.508444 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ed1247b4-f0ff-4f6b-aa8b-7e384a2520e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6781d2fd2db34da6a8aa3b939f70b2e0'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:38.509329 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ed1247b4-f0ff-4f6b-aa8b-7e384a2520e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6781d2fd2db34da6a8aa3b939f70b2e0'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:38.509998 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ed1247b4-f0ff-4f6b-aa8b-7e384a2520e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6781d2fd2db34da6a8aa3b939f70b2e0'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:38.521098 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ed1247b4-f0ff-4f6b-aa8b-7e384a2520e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6781d2fd2db34da6a8aa3b939f70b2e0'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:38.617654 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1325/2627] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:37 2022] DELETE /identity/v3/users/6781d2fd2db34da6a8aa3b939f70b2e0 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:38.623037 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c701e05-1820-40ac-85b0-2b36bd557f2c None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:38.623695 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c701e05-1820-40ac-85b0-2b36bd557f2c None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:38.623695 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c701e05-1820-40ac-85b0-2b36bd557f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:38.654223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-7c701e05-1820-40ac-85b0-2b36bd557f2c None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:38.654223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7c701e05-1820-40ac-85b0-2b36bd557f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:38.754645 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1303/2628] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:53:38.764857 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1247b4-f0ff-4f6b-aa8b-7e384a2520e3 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:38.766513 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-ed1247b4-f0ff-4f6b-aa8b-7e384a2520e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:38.836917 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1247b4-f0ff-4f6b-aa8b-7e384a2520e3 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:38.841915 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e14043-3ed5-446c-8ae5-4e7519d58dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:38.842746 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e14043-3ed5-446c-8ae5-4e7519d58dff service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:38.843101 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e14043-3ed5-446c-8ae5-4e7519d58dff service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:38.843547 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e14043-3ed5-446c-8ae5-4e7519d58dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:38.855868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e14043-3ed5-446c-8ae5-4e7519d58dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:38.858618 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e14043-3ed5-446c-8ae5-4e7519d58dff service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:38.873087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1326/2629] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:39.709675 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c701e05-1820-40ac-85b0-2b36bd557f2c None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:39.709675 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7c701e05-1820-40ac-85b0-2b36bd557f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:39.723842 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c701e05-1820-40ac-85b0-2b36bd557f2c None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:39.728645 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00ca81-651f-4294-a6dc-2a137a6cb2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:39.729575 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00ca81-651f-4294-a6dc-2a137a6cb2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:39.729863 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00ca81-651f-4294-a6dc-2a137a6cb2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:39.730145 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00ca81-651f-4294-a6dc-2a137a6cb2a4 admin admin] PATH_INFO: `/v3/projects/5429fc1b239d4138a1bbb1e70af7070f` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:39.732069 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00ca81-651f-4294-a6dc-2a137a6cb2a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5429fc1b239d4138a1bbb1e70af7070f)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:39.734888 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00ca81-651f-4294-a6dc-2a137a6cb2a4 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:39.859880 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-5a00ca81-651f-4294-a6dc-2a137a6cb2a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5429fc1b239d4138a1bbb1e70af7070f', 'request_id': 'req-5a00ca81-651f-4294-a6dc-2a137a6cb2a4'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:39.942022 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-5a00ca81-651f-4294-a6dc-2a137a6cb2a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5429fc1b239d4138a1bbb1e70af7070f', 'request_id': 'req-5a00ca81-651f-4294-a6dc-2a137a6cb2a4'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:39.947918 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-5a00ca81-651f-4294-a6dc-2a137a6cb2a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5429fc1b239d4138a1bbb1e70af7070f', 'request_id': 'req-5a00ca81-651f-4294-a6dc-2a137a6cb2a4'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:39.959588 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-5a00ca81-651f-4294-a6dc-2a137a6cb2a4 admin admin] The token cache is being invalidate because project 5429fc1b239d4138a1bbb1e70af7070f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:39.959875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-5a00ca81-651f-4294-a6dc-2a137a6cb2a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:39.960507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-5a00ca81-651f-4294-a6dc-2a137a6cb2a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:39.962202 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1304/2630] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:39 2022] DELETE /identity/v3/projects/5429fc1b239d4138a1bbb1e70af7070f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:39.967937 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb75a3-47cb-4e7d-8190-f1e144f0a41c None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:39.968490 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb75a3-47cb-4e7d-8190-f1e144f0a41c None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:39.968490 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb75a3-47cb-4e7d-8190-f1e144f0a41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:39.986538 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-eefb75a3-47cb-4e7d-8190-f1e144f0a41c None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:39.987883 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-eefb75a3-47cb-4e7d-8190-f1e144f0a41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:40.052343 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1327/2631] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:40.062122 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf6c9b-ec48-4a7c-84b8-50b3cab7bc2d None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:40.062413 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf6c9b-ec48-4a7c-84b8-50b3cab7bc2d None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:40.062691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf6c9b-ec48-4a7c-84b8-50b3cab7bc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:40.082081 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-29bf6c9b-ec48-4a7c-84b8-50b3cab7bc2d None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:40.084025 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-29bf6c9b-ec48-4a7c-84b8-50b3cab7bc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:40.093952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1305/2632] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:40.098986 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb75a3-47cb-4e7d-8190-f1e144f0a41c None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:40.110177 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb75a3-47cb-4e7d-8190-f1e144f0a41c None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:40.114776 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4170f5-7436-45b7-922f-e500793b37af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:40.115435 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4170f5-7436-45b7-922f-e500793b37af admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:40.115846 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4170f5-7436-45b7-922f-e500793b37af admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:40.116123 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4170f5-7436-45b7-922f-e500793b37af admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:40.116882 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4170f5-7436-45b7-922f-e500793b37af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:53:40.117187 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4170f5-7436-45b7-922f-e500793b37af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:40.118932 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4170f5-7436-45b7-922f-e500793b37af admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:40.132408 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1328/2633] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:53:40.137167 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf6c9b-ec48-4a7c-84b8-50b3cab7bc2d None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:40.148988 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf6c9b-ec48-4a7c-84b8-50b3cab7bc2d None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:40.155644 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9a4e9-8289-4714-881a-06b2927c23df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:40.156310 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9a4e9-8289-4714-881a-06b2927c23df admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:40.156589 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9a4e9-8289-4714-881a-06b2927c23df admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:40.156907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9a4e9-8289-4714-881a-06b2927c23df admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:40.157661 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9a4e9-8289-4714-881a-06b2927c23df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:40.159590 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9a4e9-8289-4714-881a-06b2927c23df admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:40.274048 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1306/2634] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:40 2022] POST /identity/v3/projects => generated 359 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:40.275652 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4170f5-7436-45b7-922f-e500793b37af admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:40.287763 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4170f5-7436-45b7-922f-e500793b37af admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:40.365053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec4fb4-323b-4ee4-83fa-ee10d5aaaef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:40.365053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec4fb4-323b-4ee4-83fa-ee10d5aaaef0 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:40.365053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec4fb4-323b-4ee4-83fa-ee10d5aaaef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:40.365053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec4fb4-323b-4ee4-83fa-ee10d5aaaef0 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:40.365822 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec4fb4-323b-4ee4-83fa-ee10d5aaaef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:40.367063 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec4fb4-323b-4ee4-83fa-ee10d5aaaef0 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:40.518775 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1329/2635] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:40 2022] POST /identity/v3/users => generated 280 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:53:40.524606 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9a4e9-8289-4714-881a-06b2927c23df admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:40.536813 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9a4e9-8289-4714-881a-06b2927c23df admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:40.542024 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b41ef-4925-4d43-9ed3-a829a46f86f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:40.543579 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b41ef-4925-4d43-9ed3-a829a46f86f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:40.543842 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b41ef-4925-4d43-9ed3-a829a46f86f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:40.544215 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b41ef-4925-4d43-9ed3-a829a46f86f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:40.545912 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b41ef-4925-4d43-9ed3-a829a46f86f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:40.547787 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b41ef-4925-4d43-9ed3-a829a46f86f7 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:40.564535 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1307/2636] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:40.569674 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec4fb4-323b-4ee4-83fa-ee10d5aaaef0 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:40.579864 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec4fb4-323b-4ee4-83fa-ee10d5aaaef0 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:40.584847 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6c950-4f08-440c-bc1d-00184d623366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:40.585555 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6c950-4f08-440c-bc1d-00184d623366 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:40.585868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6c950-4f08-440c-bc1d-00184d623366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:40.586274 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6c950-4f08-440c-bc1d-00184d623366 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:40.587370 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6c950-4f08-440c-bc1d-00184d623366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:40.589362 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6c950-4f08-440c-bc1d-00184d623366 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:40.603240 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1330/2637] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:40.608343 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b41ef-4925-4d43-9ed3-a829a46f86f7 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:40.619757 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b41ef-4925-4d43-9ed3-a829a46f86f7 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:40.625251 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad1a2c-84dc-4742-9e02-4b5a84961de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:40.626829 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad1a2c-84dc-4742-9e02-4b5a84961de9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:40.626829 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad1a2c-84dc-4742-9e02-4b5a84961de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:40.626829 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad1a2c-84dc-4742-9e02-4b5a84961de9 admin admin] PATH_INFO: `/v3/projects/48db01dde3444b468140f0b0bdcad705/users/a210a7add5154254b05672059e2378c6/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:40.645442 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad1a2c-84dc-4742-9e02-4b5a84961de9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48db01dde3444b468140f0b0bdcad705, user_id=a210a7add5154254b05672059e2378c6, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:40.648079 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad1a2c-84dc-4742-9e02-4b5a84961de9 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:40.738289 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1308/2638] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:40 2022] PUT /identity/v3/projects/48db01dde3444b468140f0b0bdcad705/users/a210a7add5154254b05672059e2378c6/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:40.749838 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d60ac2-4d4b-434e-9e10-9ee14800ab4f None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:40.750135 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d60ac2-4d4b-434e-9e10-9ee14800ab4f None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:40.750411 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d60ac2-4d4b-434e-9e10-9ee14800ab4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:40.791273 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-d8d60ac2-4d4b-434e-9e10-9ee14800ab4f None None] MFA Rules not processed for user `a210a7add5154254b05672059e2378c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:40.792584 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-d8d60ac2-4d4b-434e-9e10-9ee14800ab4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:40.897026 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1331/2639] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:40 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:40.933887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad1a2c-84dc-4742-9e02-4b5a84961de9 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:40.936000 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-83ad1a2c-84dc-4742-9e02-4b5a84961de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:40.998743 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad1a2c-84dc-4742-9e02-4b5a84961de9 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:41.002323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da73bc1-f62a-40f8-8f88-70bbf2b1bbba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:41.002998 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da73bc1-f62a-40f8-8f88-70bbf2b1bbba service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:41.003278 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da73bc1-f62a-40f8-8f88-70bbf2b1bbba service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:41.003553 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da73bc1-f62a-40f8-8f88-70bbf2b1bbba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:41.011842 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da73bc1-f62a-40f8-8f88-70bbf2b1bbba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:41.013319 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da73bc1-f62a-40f8-8f88-70bbf2b1bbba service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:41.021872 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1309/2640] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:40 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:53:41.036304 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d60ac2-4d4b-434e-9e10-9ee14800ab4f None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:41.100371 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d60ac2-4d4b-434e-9e10-9ee14800ab4f None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:41.109474 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059fad1-6c09-474b-8365-f2c2b96e57c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:41.110654 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059fad1-6c09-474b-8365-f2c2b96e57c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:41.111120 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059fad1-6c09-474b-8365-f2c2b96e57c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:41.111594 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059fad1-6c09-474b-8365-f2c2b96e57c8 admin admin] PATH_INFO: `/v3/users/a210a7add5154254b05672059e2378c6` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:41.113432 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059fad1-6c09-474b-8365-f2c2b96e57c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a210a7add5154254b05672059e2378c6)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:41.116067 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059fad1-6c09-474b-8365-f2c2b96e57c8 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:41.302616 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4059fad1-6c09-474b-8365-f2c2b96e57c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a210a7add5154254b05672059e2378c6'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:41.329357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4059fad1-6c09-474b-8365-f2c2b96e57c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a210a7add5154254b05672059e2378c6'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:41.329357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4059fad1-6c09-474b-8365-f2c2b96e57c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a210a7add5154254b05672059e2378c6'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:41.329357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4059fad1-6c09-474b-8365-f2c2b96e57c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a210a7add5154254b05672059e2378c6'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:41.331871 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4059fad1-6c09-474b-8365-f2c2b96e57c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a210a7add5154254b05672059e2378c6'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:41.497756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1332/2641] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:41 2022] DELETE /identity/v3/users/a210a7add5154254b05672059e2378c6 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:41.502665 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699601f-72e3-40cd-a140-87a4a7e3946d None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:41.502953 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699601f-72e3-40cd-a140-87a4a7e3946d None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:41.511441 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699601f-72e3-40cd-a140-87a4a7e3946d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:41.521667 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-1699601f-72e3-40cd-a140-87a4a7e3946d None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:41.522936 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1699601f-72e3-40cd-a140-87a4a7e3946d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:41.583333 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1310/2642] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:41.593384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059fad1-6c09-474b-8365-f2c2b96e57c8 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:41.595125 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-4059fad1-6c09-474b-8365-f2c2b96e57c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:41.652674 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059fad1-6c09-474b-8365-f2c2b96e57c8 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:41.656373 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13767886-c504-4c6b-8e25-2b3ac3227f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:41.657070 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13767886-c504-4c6b-8e25-2b3ac3227f54 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:41.657350 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13767886-c504-4c6b-8e25-2b3ac3227f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:41.657752 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13767886-c504-4c6b-8e25-2b3ac3227f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:41.667066 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13767886-c504-4c6b-8e25-2b3ac3227f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:41.668670 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13767886-c504-4c6b-8e25-2b3ac3227f54 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:41.678387 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1333/2643] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:42.156972 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699601f-72e3-40cd-a140-87a4a7e3946d None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:42.158658 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1699601f-72e3-40cd-a140-87a4a7e3946d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:42.173066 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699601f-72e3-40cd-a140-87a4a7e3946d None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:42.180517 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055385e5-92b1-4610-a9e7-877063bf30c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:42.182032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055385e5-92b1-4610-a9e7-877063bf30c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:42.182596 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055385e5-92b1-4610-a9e7-877063bf30c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:42.184560 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055385e5-92b1-4610-a9e7-877063bf30c0 admin admin] PATH_INFO: `/v3/projects/48db01dde3444b468140f0b0bdcad705` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:42.184560 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055385e5-92b1-4610-a9e7-877063bf30c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48db01dde3444b468140f0b0bdcad705)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:42.187032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055385e5-92b1-4610-a9e7-877063bf30c0 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:42.295728 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-055385e5-92b1-4610-a9e7-877063bf30c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48db01dde3444b468140f0b0bdcad705', 'request_id': 'req-055385e5-92b1-4610-a9e7-877063bf30c0'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:42.370602 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-055385e5-92b1-4610-a9e7-877063bf30c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48db01dde3444b468140f0b0bdcad705', 'request_id': 'req-055385e5-92b1-4610-a9e7-877063bf30c0'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:42.377204 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-055385e5-92b1-4610-a9e7-877063bf30c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48db01dde3444b468140f0b0bdcad705', 'request_id': 'req-055385e5-92b1-4610-a9e7-877063bf30c0'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:42.388977 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-055385e5-92b1-4610-a9e7-877063bf30c0 admin admin] The token cache is being invalidate because project 48db01dde3444b468140f0b0bdcad705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:42.389322 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-055385e5-92b1-4610-a9e7-877063bf30c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:42.389998 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-055385e5-92b1-4610-a9e7-877063bf30c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:42.391815 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1311/2644] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:42 2022] DELETE /identity/v3/projects/48db01dde3444b468140f0b0bdcad705 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:42.396557 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f606758-f2d3-46b4-9382-50817fc26d6c None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:42.397080 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f606758-f2d3-46b4-9382-50817fc26d6c None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:42.397232 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f606758-f2d3-46b4-9382-50817fc26d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:42.414648 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-1f606758-f2d3-46b4-9382-50817fc26d6c None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:42.415836 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-1f606758-f2d3-46b4-9382-50817fc26d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:42.474280 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1334/2645] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:42.481826 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec757a6b-ed8c-4ada-ac76-afa0352d55fd None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:42.482143 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec757a6b-ed8c-4ada-ac76-afa0352d55fd None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:42.482404 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec757a6b-ed8c-4ada-ac76-afa0352d55fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:42.503725 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-ec757a6b-ed8c-4ada-ac76-afa0352d55fd None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:42.504986 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-ec757a6b-ed8c-4ada-ac76-afa0352d55fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:42.515044 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1312/2646] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:42.519331 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f606758-f2d3-46b4-9382-50817fc26d6c None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:42.530468 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f606758-f2d3-46b4-9382-50817fc26d6c None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:42.535098 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c6a2b-41b1-4285-bdd6-112f148c55d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:42.535752 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c6a2b-41b1-4285-bdd6-112f148c55d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:42.536035 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c6a2b-41b1-4285-bdd6-112f148c55d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:42.536309 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c6a2b-41b1-4285-bdd6-112f148c55d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:42.537096 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c6a2b-41b1-4285-bdd6-112f148c55d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:53:42.537406 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c6a2b-41b1-4285-bdd6-112f148c55d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:42.538997 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c6a2b-41b1-4285-bdd6-112f148c55d3 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:42.550876 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1335/2647] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:53:42.555142 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec757a6b-ed8c-4ada-ac76-afa0352d55fd None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:42.565271 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec757a6b-ed8c-4ada-ac76-afa0352d55fd None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:42.570021 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdef521-4389-4f3a-99a8-5659e852b639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:42.570672 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdef521-4389-4f3a-99a8-5659e852b639 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:42.570952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdef521-4389-4f3a-99a8-5659e852b639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:42.571222 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdef521-4389-4f3a-99a8-5659e852b639 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:42.572035 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdef521-4389-4f3a-99a8-5659e852b639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:42.574120 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdef521-4389-4f3a-99a8-5659e852b639 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:42.697941 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1313/2648] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:42 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:42.702346 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c6a2b-41b1-4285-bdd6-112f148c55d3 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:42.716908 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c6a2b-41b1-4285-bdd6-112f148c55d3 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:42.768815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece75556-ae92-40f8-a0fa-15a2f3cba9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:42.769513 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece75556-ae92-40f8-a0fa-15a2f3cba9c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:42.769797 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece75556-ae92-40f8-a0fa-15a2f3cba9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:42.770073 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece75556-ae92-40f8-a0fa-15a2f3cba9c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:42.770800 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece75556-ae92-40f8-a0fa-15a2f3cba9c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:42.772817 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece75556-ae92-40f8-a0fa-15a2f3cba9c3 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:43.217273 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1336/2649] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:42 2022] POST /identity/v3/users => generated 288 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:43.237304 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdef521-4389-4f3a-99a8-5659e852b639 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:43.237304 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdef521-4389-4f3a-99a8-5659e852b639 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:43.238683 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97942342-d9c1-483f-b352-66e6aca3c242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:43.239336 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97942342-d9c1-483f-b352-66e6aca3c242 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:43.239617 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97942342-d9c1-483f-b352-66e6aca3c242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:43.239889 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97942342-d9c1-483f-b352-66e6aca3c242 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:43.240607 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97942342-d9c1-483f-b352-66e6aca3c242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:43.242224 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97942342-d9c1-483f-b352-66e6aca3c242 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:43.252990 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1314/2650] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:43.256773 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece75556-ae92-40f8-a0fa-15a2f3cba9c3 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:43.267339 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece75556-ae92-40f8-a0fa-15a2f3cba9c3 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:43.271769 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e24023-57e5-4511-a26c-e676e08e5b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:43.272414 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e24023-57e5-4511-a26c-e676e08e5b24 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:43.272728 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e24023-57e5-4511-a26c-e676e08e5b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:43.273007 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e24023-57e5-4511-a26c-e676e08e5b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:43.273727 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e24023-57e5-4511-a26c-e676e08e5b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:43.275308 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e24023-57e5-4511-a26c-e676e08e5b24 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:43.285664 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1337/2651] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:43.289450 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97942342-d9c1-483f-b352-66e6aca3c242 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:43.300741 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97942342-d9c1-483f-b352-66e6aca3c242 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:43.305272 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f49d0-1c5b-4566-ac5a-086a0bc35a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:43.306209 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f49d0-1c5b-4566-ac5a-086a0bc35a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:43.306488 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f49d0-1c5b-4566-ac5a-086a0bc35a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:43.306787 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f49d0-1c5b-4566-ac5a-086a0bc35a8f admin admin] PATH_INFO: `/v3/projects/850d49b59494496e8939e26fce8a28d8/users/d420d06c85c14614a7dff4596dd9078b/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:43.321243 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f49d0-1c5b-4566-ac5a-086a0bc35a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=850d49b59494496e8939e26fce8a28d8, user_id=d420d06c85c14614a7dff4596dd9078b, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:43.323948 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f49d0-1c5b-4566-ac5a-086a0bc35a8f admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:43.410889 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1315/2652] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:43 2022] PUT /identity/v3/projects/850d49b59494496e8939e26fce8a28d8/users/d420d06c85c14614a7dff4596dd9078b/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:43.422105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8273847-f220-4e23-bf07-85b7818a2383 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:43.422554 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8273847-f220-4e23-bf07-85b7818a2383 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:43.422661 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8273847-f220-4e23-bf07-85b7818a2383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:43.449675 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-a8273847-f220-4e23-bf07-85b7818a2383 None None] MFA Rules not processed for user `d420d06c85c14614a7dff4596dd9078b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:43.450996 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a8273847-f220-4e23-bf07-85b7818a2383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:43.516265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1338/2653] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:43.532213 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f49d0-1c5b-4566-ac5a-086a0bc35a8f admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:43.596494 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f49d0-1c5b-4566-ac5a-086a0bc35a8f admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:43.601026 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399da5f3-8440-4161-a8fc-02ff9d6bfad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:43.601671 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399da5f3-8440-4161-a8fc-02ff9d6bfad3 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:43.601953 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399da5f3-8440-4161-a8fc-02ff9d6bfad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:43.602230 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399da5f3-8440-4161-a8fc-02ff9d6bfad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:43.602899 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399da5f3-8440-4161-a8fc-02ff9d6bfad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:43.604815 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399da5f3-8440-4161-a8fc-02ff9d6bfad3 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:43.713474 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1316/2654] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:43 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:43.717430 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8273847-f220-4e23-bf07-85b7818a2383 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:43.728847 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8273847-f220-4e23-bf07-85b7818a2383 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:43.785951 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e9688-cf01-4240-8fdb-66f6fc057109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:43.786545 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e9688-cf01-4240-8fdb-66f6fc057109 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:43.786828 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e9688-cf01-4240-8fdb-66f6fc057109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:43.787106 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e9688-cf01-4240-8fdb-66f6fc057109 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:43.787813 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e9688-cf01-4240-8fdb-66f6fc057109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:43.789781 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e9688-cf01-4240-8fdb-66f6fc057109 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:43.930449 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1339/2655] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:43 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:43.934849 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399da5f3-8440-4161-a8fc-02ff9d6bfad3 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:43.950935 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399da5f3-8440-4161-a8fc-02ff9d6bfad3 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:43.950935 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e289eb3-ddfa-4822-915a-55dfc7cac433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:43.951739 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e289eb3-ddfa-4822-915a-55dfc7cac433 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:43.952074 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e289eb3-ddfa-4822-915a-55dfc7cac433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:43.952354 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e289eb3-ddfa-4822-915a-55dfc7cac433 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:43.953124 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e289eb3-ddfa-4822-915a-55dfc7cac433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:43.954715 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e289eb3-ddfa-4822-915a-55dfc7cac433 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:43.965194 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1317/2656] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:43.969290 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e9688-cf01-4240-8fdb-66f6fc057109 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:43.979304 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e9688-cf01-4240-8fdb-66f6fc057109 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:43.984098 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56518619-f37f-490d-9a47-1b2535294fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:43.984994 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56518619-f37f-490d-9a47-1b2535294fac admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:43.985272 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56518619-f37f-490d-9a47-1b2535294fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:43.985539 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56518619-f37f-490d-9a47-1b2535294fac admin admin] PATH_INFO: `/v3/projects/99b7dd749fcd4b6593cb0764790182a1/users/3199ca9d34364abf8576809cf65475c1/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:44.000573 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56518619-f37f-490d-9a47-1b2535294fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b7dd749fcd4b6593cb0764790182a1, user_id=3199ca9d34364abf8576809cf65475c1, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:44.003246 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56518619-f37f-490d-9a47-1b2535294fac admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:44.084344 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1340/2657] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:43 2022] PUT /identity/v3/projects/99b7dd749fcd4b6593cb0764790182a1/users/3199ca9d34364abf8576809cf65475c1/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:44.088237 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e289eb3-ddfa-4822-915a-55dfc7cac433 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:44.098156 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e289eb3-ddfa-4822-915a-55dfc7cac433 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:44.152685 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76234004-1beb-4791-9291-aac12ae88aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:44.153850 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76234004-1beb-4791-9291-aac12ae88aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:44.154133 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76234004-1beb-4791-9291-aac12ae88aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:44.154409 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76234004-1beb-4791-9291-aac12ae88aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:44.155128 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76234004-1beb-4791-9291-aac12ae88aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:44.156741 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76234004-1beb-4791-9291-aac12ae88aa2 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:44.166241 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1318/2658] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:44.170281 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56518619-f37f-490d-9a47-1b2535294fac admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:44.180343 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56518619-f37f-490d-9a47-1b2535294fac admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:44.185294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac0336-e7b9-4906-8514-f4dd78bfbbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:44.186176 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac0336-e7b9-4906-8514-f4dd78bfbbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:44.186456 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac0336-e7b9-4906-8514-f4dd78bfbbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:44.186729 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac0336-e7b9-4906-8514-f4dd78bfbbfb admin admin] PATH_INFO: `/v3/projects/99b7dd749fcd4b6593cb0764790182a1/users/3199ca9d34364abf8576809cf65475c1/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:44.188752 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac0336-e7b9-4906-8514-f4dd78bfbbfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b7dd749fcd4b6593cb0764790182a1, user_id=3199ca9d34364abf8576809cf65475c1, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:44.191381 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac0336-e7b9-4906-8514-f4dd78bfbbfb admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:44.202265 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1341/2659] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:44 2022] PUT /identity/v3/projects/99b7dd749fcd4b6593cb0764790182a1/users/3199ca9d34364abf8576809cf65475c1/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:44.212328 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30809283-79b2-4758-b41f-9e7b579f877a None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:44.212644 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30809283-79b2-4758-b41f-9e7b579f877a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:44.212947 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30809283-79b2-4758-b41f-9e7b579f877a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:44.239706 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-30809283-79b2-4758-b41f-9e7b579f877a None None] MFA Rules not processed for user `3199ca9d34364abf8576809cf65475c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:44.240938 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-30809283-79b2-4758-b41f-9e7b579f877a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:44.306688 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1319/2660] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:44.317644 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac0336-e7b9-4906-8514-f4dd78bfbbfb admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:44.322939 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-2cac0336-e7b9-4906-8514-f4dd78bfbbfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:44.386355 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac0336-e7b9-4906-8514-f4dd78bfbbfb admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:44.396321 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdbe8e-8eed-4da4-9488-9652930d7d2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:44.397014 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdbe8e-8eed-4da4-9488-9652930d7d2e service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:44.397341 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdbe8e-8eed-4da4-9488-9652930d7d2e service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:44.397616 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdbe8e-8eed-4da4-9488-9652930d7d2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:44.456550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdbe8e-8eed-4da4-9488-9652930d7d2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:44.458043 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdbe8e-8eed-4da4-9488-9652930d7d2e service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:44.467158 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1342/2661] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:47.778660 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30809283-79b2-4758-b41f-9e7b579f877a None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:47.837431 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30809283-79b2-4758-b41f-9e7b579f877a None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:47.842610 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b95188-88a1-42c2-adb3-44d9b15847c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:47.847529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b95188-88a1-42c2-adb3-44d9b15847c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:47.847529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b95188-88a1-42c2-adb3-44d9b15847c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:47.847529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b95188-88a1-42c2-adb3-44d9b15847c5 admin admin] PATH_INFO: `/v3/users/d420d06c85c14614a7dff4596dd9078b` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:47.847529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b95188-88a1-42c2-adb3-44d9b15847c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d420d06c85c14614a7dff4596dd9078b)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:47.847529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b95188-88a1-42c2-adb3-44d9b15847c5 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:48.069462 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-40b95188-88a1-42c2-adb3-44d9b15847c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd420d06c85c14614a7dff4596dd9078b'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:48.081400 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-40b95188-88a1-42c2-adb3-44d9b15847c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd420d06c85c14614a7dff4596dd9078b'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:48.082074 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-40b95188-88a1-42c2-adb3-44d9b15847c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd420d06c85c14614a7dff4596dd9078b'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:48.170863 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-40b95188-88a1-42c2-adb3-44d9b15847c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd420d06c85c14614a7dff4596dd9078b'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:48.171579 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-40b95188-88a1-42c2-adb3-44d9b15847c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd420d06c85c14614a7dff4596dd9078b'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:48.186718 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1320/2662] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:47 2022] DELETE /identity/v3/users/d420d06c85c14614a7dff4596dd9078b => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:48.190357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144c735-2cf4-4865-9c16-2a86075745cb None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:48.190870 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144c735-2cf4-4865-9c16-2a86075745cb None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:48.191003 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144c735-2cf4-4865-9c16-2a86075745cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:48.209376 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-a144c735-2cf4-4865-9c16-2a86075745cb None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:48.210703 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a144c735-2cf4-4865-9c16-2a86075745cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:48.281354 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1343/2663] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:48.290985 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b95188-88a1-42c2-adb3-44d9b15847c5 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:48.292539 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-40b95188-88a1-42c2-adb3-44d9b15847c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:48.351659 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b95188-88a1-42c2-adb3-44d9b15847c5 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:48.355520 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a0f79-af86-4925-885b-bd69dd0f0f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:48.356407 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a0f79-af86-4925-885b-bd69dd0f0f20 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:48.356789 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a0f79-af86-4925-885b-bd69dd0f0f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:48.357134 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a0f79-af86-4925-885b-bd69dd0f0f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:48.366695 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a0f79-af86-4925-885b-bd69dd0f0f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:48.376650 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a0f79-af86-4925-885b-bd69dd0f0f20 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:48.378506 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1321/2664] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:48.841427 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144c735-2cf4-4865-9c16-2a86075745cb None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:48.842876 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a144c735-2cf4-4865-9c16-2a86075745cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:48.856187 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144c735-2cf4-4865-9c16-2a86075745cb None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:48.860949 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a9e00-b22a-4df6-968f-0bfcabbb1074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:48.861883 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a9e00-b22a-4df6-968f-0bfcabbb1074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:48.862083 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a9e00-b22a-4df6-968f-0bfcabbb1074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:48.862354 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a9e00-b22a-4df6-968f-0bfcabbb1074 admin admin] PATH_INFO: `/v3/projects/850d49b59494496e8939e26fce8a28d8` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:48.863707 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a9e00-b22a-4df6-968f-0bfcabbb1074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=850d49b59494496e8939e26fce8a28d8)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:48.865664 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a9e00-b22a-4df6-968f-0bfcabbb1074 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:48.959245 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d14a9e00-b22a-4df6-968f-0bfcabbb1074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '850d49b59494496e8939e26fce8a28d8', 'request_id': 'req-d14a9e00-b22a-4df6-968f-0bfcabbb1074'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:48.965185 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d14a9e00-b22a-4df6-968f-0bfcabbb1074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '850d49b59494496e8939e26fce8a28d8', 'request_id': 'req-d14a9e00-b22a-4df6-968f-0bfcabbb1074'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:48.971495 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d14a9e00-b22a-4df6-968f-0bfcabbb1074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '850d49b59494496e8939e26fce8a28d8', 'request_id': 'req-d14a9e00-b22a-4df6-968f-0bfcabbb1074'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:49.061618 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d14a9e00-b22a-4df6-968f-0bfcabbb1074 admin admin] The token cache is being invalidate because project 850d49b59494496e8939e26fce8a28d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:49.061828 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d14a9e00-b22a-4df6-968f-0bfcabbb1074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:49.062439 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-d14a9e00-b22a-4df6-968f-0bfcabbb1074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:49.063967 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1344/2665] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:48 2022] DELETE /identity/v3/projects/850d49b59494496e8939e26fce8a28d8 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:49.067924 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a0f79-af86-4925-885b-bd69dd0f0f20 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:49.078054 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a0f79-af86-4925-885b-bd69dd0f0f20 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:49.140153 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35161247-a7c8-4a2d-bb6d-1daf604fd80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:49.141078 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35161247-a7c8-4a2d-bb6d-1daf604fd80c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:49.141362 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35161247-a7c8-4a2d-bb6d-1daf604fd80c admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:49.141641 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35161247-a7c8-4a2d-bb6d-1daf604fd80c admin admin] PATH_INFO: `/v3/users/3199ca9d34364abf8576809cf65475c1` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:49.142820 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35161247-a7c8-4a2d-bb6d-1daf604fd80c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3199ca9d34364abf8576809cf65475c1)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:49.144764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35161247-a7c8-4a2d-bb6d-1daf604fd80c admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:49.361781 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-35161247-a7c8-4a2d-bb6d-1daf604fd80c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3199ca9d34364abf8576809cf65475c1'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:49.374369 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-35161247-a7c8-4a2d-bb6d-1daf604fd80c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3199ca9d34364abf8576809cf65475c1'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:49.375047 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-35161247-a7c8-4a2d-bb6d-1daf604fd80c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3199ca9d34364abf8576809cf65475c1'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:49.438706 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-35161247-a7c8-4a2d-bb6d-1daf604fd80c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3199ca9d34364abf8576809cf65475c1'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:49.439332 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-35161247-a7c8-4a2d-bb6d-1daf604fd80c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3199ca9d34364abf8576809cf65475c1'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:49.451767 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1322/2666] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:49 2022] DELETE /identity/v3/users/3199ca9d34364abf8576809cf65475c1 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:49.880560 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a9e00-b22a-4df6-968f-0bfcabbb1074 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:49.882100 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-d14a9e00-b22a-4df6-968f-0bfcabbb1074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:49.897379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a9e00-b22a-4df6-968f-0bfcabbb1074 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:49.953230 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80c4be-ee62-4861-b287-dd14de7f1e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:49.954120 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80c4be-ee62-4861-b287-dd14de7f1e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:49.954406 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80c4be-ee62-4861-b287-dd14de7f1e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:49.954683 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80c4be-ee62-4861-b287-dd14de7f1e90 admin admin] PATH_INFO: `/v3/projects/99b7dd749fcd4b6593cb0764790182a1` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:49.955911 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80c4be-ee62-4861-b287-dd14de7f1e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b7dd749fcd4b6593cb0764790182a1)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:49.957907 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80c4be-ee62-4861-b287-dd14de7f1e90 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:50.090905 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-bc80c4be-ee62-4861-b287-dd14de7f1e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b7dd749fcd4b6593cb0764790182a1', 'request_id': 'req-bc80c4be-ee62-4861-b287-dd14de7f1e90'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:50.096842 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-bc80c4be-ee62-4861-b287-dd14de7f1e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b7dd749fcd4b6593cb0764790182a1', 'request_id': 'req-bc80c4be-ee62-4861-b287-dd14de7f1e90'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:50.103079 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-bc80c4be-ee62-4861-b287-dd14de7f1e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b7dd749fcd4b6593cb0764790182a1', 'request_id': 'req-bc80c4be-ee62-4861-b287-dd14de7f1e90'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:50.206577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-bc80c4be-ee62-4861-b287-dd14de7f1e90 admin admin] The token cache is being invalidate because project 99b7dd749fcd4b6593cb0764790182a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:50.206868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-bc80c4be-ee62-4861-b287-dd14de7f1e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:50.208368 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-bc80c4be-ee62-4861-b287-dd14de7f1e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:50.209576 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1345/2667] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:49 2022] DELETE /identity/v3/projects/99b7dd749fcd4b6593cb0764790182a1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:56.133219 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35161247-a7c8-4a2d-bb6d-1daf604fd80c admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:56.134675 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-35161247-a7c8-4a2d-bb6d-1daf604fd80c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:56.192243 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35161247-a7c8-4a2d-bb6d-1daf604fd80c admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:56.239596 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d275e-a91c-4e77-a3b5-c2de7d3e0be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:56.240238 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d275e-a91c-4e77-a3b5-c2de7d3e0be7 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:56.240521 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d275e-a91c-4e77-a3b5-c2de7d3e0be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:56.240833 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d275e-a91c-4e77-a3b5-c2de7d3e0be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:56.242600 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-546d275e-a91c-4e77-a3b5-c2de7d3e0be7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:56.303041 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d275e-a91c-4e77-a3b5-c2de7d3e0be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:56.304484 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d275e-a91c-4e77-a3b5-c2de7d3e0be7 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:56.314191 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1323/2668] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:57.005199 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80c4be-ee62-4861-b287-dd14de7f1e90 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:57.005845 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-bc80c4be-ee62-4861-b287-dd14de7f1e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:57.018857 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80c4be-ee62-4861-b287-dd14de7f1e90 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:57.023378 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd61627-c7bc-4901-baa5-7d39a0c10b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:57.024246 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd61627-c7bc-4901-baa5-7d39a0c10b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:57.024523 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd61627-c7bc-4901-baa5-7d39a0c10b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:57.024836 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd61627-c7bc-4901-baa5-7d39a0c10b0f admin admin] PATH_INFO: `/v3/users/5f1befc68f5a43c492efef77b1ec480a` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:57.026039 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd61627-c7bc-4901-baa5-7d39a0c10b0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f1befc68f5a43c492efef77b1ec480a)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:57.028287 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd61627-c7bc-4901-baa5-7d39a0c10b0f admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:57.217835 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dfd61627-c7bc-4901-baa5-7d39a0c10b0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f1befc68f5a43c492efef77b1ec480a'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:57.230466 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dfd61627-c7bc-4901-baa5-7d39a0c10b0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f1befc68f5a43c492efef77b1ec480a'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:57.231138 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dfd61627-c7bc-4901-baa5-7d39a0c10b0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f1befc68f5a43c492efef77b1ec480a'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:57.231750 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dfd61627-c7bc-4901-baa5-7d39a0c10b0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f1befc68f5a43c492efef77b1ec480a'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:57.238475 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-dfd61627-c7bc-4901-baa5-7d39a0c10b0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f1befc68f5a43c492efef77b1ec480a'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:57.329096 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1346/2669] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:57 2022] DELETE /identity/v3/users/5f1befc68f5a43c492efef77b1ec480a => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:57.584451 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d275e-a91c-4e77-a3b5-c2de7d3e0be7 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:57.593211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d275e-a91c-4e77-a3b5-c2de7d3e0be7 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:57.648151 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e825d-1606-4e20-ac49-b735b92e7f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:57.649086 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e825d-1606-4e20-ac49-b735b92e7f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:57.649315 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e825d-1606-4e20-ac49-b735b92e7f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:57.649588 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e825d-1606-4e20-ac49-b735b92e7f78 admin admin] PATH_INFO: `/v3/projects/79b5b498a60248d3aedb25d879c5c923` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:57.650770 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e825d-1606-4e20-ac49-b735b92e7f78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79b5b498a60248d3aedb25d879c5c923)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:57.652727 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e825d-1606-4e20-ac49-b735b92e7f78 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:57.765362 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-cf7e825d-1606-4e20-ac49-b735b92e7f78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79b5b498a60248d3aedb25d879c5c923', 'request_id': 'req-cf7e825d-1606-4e20-ac49-b735b92e7f78'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:57.878478 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-cf7e825d-1606-4e20-ac49-b735b92e7f78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79b5b498a60248d3aedb25d879c5c923', 'request_id': 'req-cf7e825d-1606-4e20-ac49-b735b92e7f78'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:57.884197 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-cf7e825d-1606-4e20-ac49-b735b92e7f78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79b5b498a60248d3aedb25d879c5c923', 'request_id': 'req-cf7e825d-1606-4e20-ac49-b735b92e7f78'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:57.895324 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-cf7e825d-1606-4e20-ac49-b735b92e7f78 admin admin] The token cache is being invalidate because project 79b5b498a60248d3aedb25d879c5c923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:57.895632 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-cf7e825d-1606-4e20-ac49-b735b92e7f78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:57.896259 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-cf7e825d-1606-4e20-ac49-b735b92e7f78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:57.897853 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1324/2670] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:57 2022] DELETE /identity/v3/projects/79b5b498a60248d3aedb25d879c5c923 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:54:04.340320 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd61627-c7bc-4901-baa5-7d39a0c10b0f admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:04.342013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-dfd61627-c7bc-4901-baa5-7d39a0c10b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:04.398739 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd61627-c7bc-4901-baa5-7d39a0c10b0f admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:04.447510 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b9fef-8879-4c6a-8939-73376464f190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:04.448268 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b9fef-8879-4c6a-8939-73376464f190 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:04.448551 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b9fef-8879-4c6a-8939-73376464f190 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:04.448853 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b9fef-8879-4c6a-8939-73376464f190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:04.450672 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-311b9fef-8879-4c6a-8939-73376464f190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:04.510254 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b9fef-8879-4c6a-8939-73376464f190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:04.512223 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b9fef-8879-4c6a-8939-73376464f190 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:04.522336 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1347/2671] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:54:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:54:38.988880 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e825d-1606-4e20-ac49-b735b92e7f78 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:38.990461 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-cf7e825d-1606-4e20-ac49-b735b92e7f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:39.013887 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e825d-1606-4e20-ac49-b735b92e7f78 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:39.018312 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a29eeb-6413-4d81-82ea-a2e83ea71d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:39.019417 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a29eeb-6413-4d81-82ea-a2e83ea71d89 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:39.019910 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a29eeb-6413-4d81-82ea-a2e83ea71d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:39.020387 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a29eeb-6413-4d81-82ea-a2e83ea71d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:39.023685 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-e9a29eeb-6413-4d81-82ea-a2e83ea71d89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:39.125960 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a29eeb-6413-4d81-82ea-a2e83ea71d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:39.125960 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a29eeb-6413-4d81-82ea-a2e83ea71d89 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:39.141824 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1325/2672] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:54:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:55:14.308588 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b9fef-8879-4c6a-8939-73376464f190 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:14.310307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-311b9fef-8879-4c6a-8939-73376464f190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:14.334775 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b9fef-8879-4c6a-8939-73376464f190 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:14.338964 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00dcd1-4130-4656-89e5-ff3e64805d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:14.345254 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00dcd1-4130-4656-89e5-ff3e64805d9c service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:14.345254 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00dcd1-4130-4656-89e5-ff3e64805d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:14.345254 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00dcd1-4130-4656-89e5-ff3e64805d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:14.345254 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-fd00dcd1-4130-4656-89e5-ff3e64805d9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:14.357221 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00dcd1-4130-4656-89e5-ff3e64805d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:14.358785 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00dcd1-4130-4656-89e5-ff3e64805d9c service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:14.367509 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1348/2673] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:55:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:55:20.903688 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deabc28-c14d-46ad-8337-154b430765a9 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:20.904160 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deabc28-c14d-46ad-8337-154b430765a9 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:20.904271 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deabc28-c14d-46ad-8337-154b430765a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:20.921580 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-0deabc28-c14d-46ad-8337-154b430765a9 None None] MFA Rules not processed for user `556058de7b9f48b8a10188ec64496e72`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:20.922791 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-0deabc28-c14d-46ad-8337-154b430765a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:20.975996 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1326/2674] 10.222.0.52 () {58 vars in 967 bytes} [Tue Mar 8 13:55:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:55:21.015637 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00dcd1-4130-4656-89e5-ff3e64805d9c service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:21.017084 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-fd00dcd1-4130-4656-89e5-ff3e64805d9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:21.085270 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00dcd1-4130-4656-89e5-ff3e64805d9c service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:21.090804 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464e6c0-bd41-4e7b-bcfa-b2fc54671d62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f375d86747d248fa95f487b073d92d83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:21.091445 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464e6c0-bd41-4e7b-bcfa-b2fc54671d62 service swift] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:21.091982 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464e6c0-bd41-4e7b-bcfa-b2fc54671d62 service swift] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:21.092255 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464e6c0-bd41-4e7b-bcfa-b2fc54671d62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:21.099986 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464e6c0-bd41-4e7b-bcfa-b2fc54671d62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:21.101631 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464e6c0-bd41-4e7b-bcfa-b2fc54671d62 service swift] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:21.111227 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1349/2675] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 13:55:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:55:30.299802 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deabc28-c14d-46ad-8337-154b430765a9 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:30.301984 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-0deabc28-c14d-46ad-8337-154b430765a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:30.370590 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deabc28-c14d-46ad-8337-154b430765a9 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:30.375138 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023db119-44e7-407a-baff-ce1ce75044a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:30.376001 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023db119-44e7-407a-baff-ce1ce75044a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:30.376278 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023db119-44e7-407a-baff-ce1ce75044a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:30.376546 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023db119-44e7-407a-baff-ce1ce75044a3 admin admin] PATH_INFO: `/v3/users/f88b139b7ac7488c9b48216350775c71` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:30.377765 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023db119-44e7-407a-baff-ce1ce75044a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f88b139b7ac7488c9b48216350775c71)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:30.379685 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023db119-44e7-407a-baff-ce1ce75044a3 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:30.705679 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-023db119-44e7-407a-baff-ce1ce75044a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f88b139b7ac7488c9b48216350775c71'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:30.717487 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-023db119-44e7-407a-baff-ce1ce75044a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f88b139b7ac7488c9b48216350775c71'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:30.718150 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-023db119-44e7-407a-baff-ce1ce75044a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f88b139b7ac7488c9b48216350775c71'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:30.817428 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-023db119-44e7-407a-baff-ce1ce75044a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f88b139b7ac7488c9b48216350775c71'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:30.818009 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-023db119-44e7-407a-baff-ce1ce75044a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f88b139b7ac7488c9b48216350775c71'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:30.831391 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1327/2676] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:55:30 2022] DELETE /identity/v3/users/f88b139b7ac7488c9b48216350775c71 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:31.088328 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464e6c0-bd41-4e7b-bcfa-b2fc54671d62 service swift] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:31.099240 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464e6c0-bd41-4e7b-bcfa-b2fc54671d62 service swift] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:31.155319 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7f6f8-b51a-4847-ba9f-58b23b5e5632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:31.156182 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7f6f8-b51a-4847-ba9f-58b23b5e5632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:31.156464 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7f6f8-b51a-4847-ba9f-58b23b5e5632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:31.156780 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7f6f8-b51a-4847-ba9f-58b23b5e5632 admin admin] PATH_INFO: `/v3/projects/eab8d126a4574df48a127b8c3a03b20d` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:31.157958 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7f6f8-b51a-4847-ba9f-58b23b5e5632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eab8d126a4574df48a127b8c3a03b20d)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:31.159862 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7f6f8-b51a-4847-ba9f-58b23b5e5632 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:31.297905 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-87e7f6f8-b51a-4847-ba9f-58b23b5e5632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eab8d126a4574df48a127b8c3a03b20d', 'request_id': 'req-87e7f6f8-b51a-4847-ba9f-58b23b5e5632'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:31.303619 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-87e7f6f8-b51a-4847-ba9f-58b23b5e5632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eab8d126a4574df48a127b8c3a03b20d', 'request_id': 'req-87e7f6f8-b51a-4847-ba9f-58b23b5e5632'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:31.310328 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-87e7f6f8-b51a-4847-ba9f-58b23b5e5632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eab8d126a4574df48a127b8c3a03b20d', 'request_id': 'req-87e7f6f8-b51a-4847-ba9f-58b23b5e5632'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:31.406883 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-87e7f6f8-b51a-4847-ba9f-58b23b5e5632 admin admin] The token cache is being invalidate because project eab8d126a4574df48a127b8c3a03b20d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:55:31.407176 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-87e7f6f8-b51a-4847-ba9f-58b23b5e5632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:31.407800 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-87e7f6f8-b51a-4847-ba9f-58b23b5e5632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:31.409452 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1350/2677] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:55:31 2022] DELETE /identity/v3/projects/eab8d126a4574df48a127b8c3a03b20d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:31.413923 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023db119-44e7-407a-baff-ce1ce75044a3 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:31.418330 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-023db119-44e7-407a-baff-ce1ce75044a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:31.428154 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023db119-44e7-407a-baff-ce1ce75044a3 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:31.482663 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab64fde-5b6f-4a0b-99e4-4fc9b87abff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:31.483520 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab64fde-5b6f-4a0b-99e4-4fc9b87abff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:31.483802 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab64fde-5b6f-4a0b-99e4-4fc9b87abff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:31.484072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab64fde-5b6f-4a0b-99e4-4fc9b87abff4 admin admin] PATH_INFO: `/v3/users/067cf24e92ad4d88988cb9814c404384` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:31.485259 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab64fde-5b6f-4a0b-99e4-4fc9b87abff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=067cf24e92ad4d88988cb9814c404384)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:31.487175 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab64fde-5b6f-4a0b-99e4-4fc9b87abff4 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:31.723199 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1ab64fde-5b6f-4a0b-99e4-4fc9b87abff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '067cf24e92ad4d88988cb9814c404384'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:31.735325 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1ab64fde-5b6f-4a0b-99e4-4fc9b87abff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '067cf24e92ad4d88988cb9814c404384'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:31.736000 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1ab64fde-5b6f-4a0b-99e4-4fc9b87abff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '067cf24e92ad4d88988cb9814c404384'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:31.847144 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1ab64fde-5b6f-4a0b-99e4-4fc9b87abff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '067cf24e92ad4d88988cb9814c404384'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:31.847748 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1ab64fde-5b6f-4a0b-99e4-4fc9b87abff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '067cf24e92ad4d88988cb9814c404384'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:31.860734 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1328/2678] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:55:31 2022] DELETE /identity/v3/users/067cf24e92ad4d88988cb9814c404384 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:32.145729 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7f6f8-b51a-4847-ba9f-58b23b5e5632 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:32.147268 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-87e7f6f8-b51a-4847-ba9f-58b23b5e5632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:32.160460 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7f6f8-b51a-4847-ba9f-58b23b5e5632 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:32.428002 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534fbe8-46e8-4828-bc8e-85cfcec3e8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:32.428002 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534fbe8-46e8-4828-bc8e-85cfcec3e8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:32.428002 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534fbe8-46e8-4828-bc8e-85cfcec3e8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:32.428002 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534fbe8-46e8-4828-bc8e-85cfcec3e8a2 admin admin] PATH_INFO: `/v3/projects/3a0ad0c63485438ea5c96440d54a16a4` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:32.429105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534fbe8-46e8-4828-bc8e-85cfcec3e8a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0ad0c63485438ea5c96440d54a16a4)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:32.429105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534fbe8-46e8-4828-bc8e-85cfcec3e8a2 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:32.429105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3534fbe8-46e8-4828-bc8e-85cfcec3e8a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0ad0c63485438ea5c96440d54a16a4', 'request_id': 'req-3534fbe8-46e8-4828-bc8e-85cfcec3e8a2'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:32.429105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3534fbe8-46e8-4828-bc8e-85cfcec3e8a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0ad0c63485438ea5c96440d54a16a4', 'request_id': 'req-3534fbe8-46e8-4828-bc8e-85cfcec3e8a2'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:32.429105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3534fbe8-46e8-4828-bc8e-85cfcec3e8a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0ad0c63485438ea5c96440d54a16a4', 'request_id': 'req-3534fbe8-46e8-4828-bc8e-85cfcec3e8a2'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:32.629713 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3534fbe8-46e8-4828-bc8e-85cfcec3e8a2 admin admin] The token cache is being invalidate because project 3a0ad0c63485438ea5c96440d54a16a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:55:32.630100 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3534fbe8-46e8-4828-bc8e-85cfcec3e8a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:32.631494 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3534fbe8-46e8-4828-bc8e-85cfcec3e8a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:32.633641 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1351/2679] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:55:32 2022] DELETE /identity/v3/projects/3a0ad0c63485438ea5c96440d54a16a4 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:37.697267 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab64fde-5b6f-4a0b-99e4-4fc9b87abff4 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:37.698670 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1ab64fde-5b6f-4a0b-99e4-4fc9b87abff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:37.753920 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab64fde-5b6f-4a0b-99e4-4fc9b87abff4 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:37.801275 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457840d2-c1e4-428a-b4c5-3b9d83ab8d28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:37.801974 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457840d2-c1e4-428a-b4c5-3b9d83ab8d28 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:37.802259 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457840d2-c1e4-428a-b4c5-3b9d83ab8d28 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:37.802541 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457840d2-c1e4-428a-b4c5-3b9d83ab8d28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:37.804385 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-457840d2-c1e4-428a-b4c5-3b9d83ab8d28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:37.874565 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457840d2-c1e4-428a-b4c5-3b9d83ab8d28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:37.876022 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457840d2-c1e4-428a-b4c5-3b9d83ab8d28 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:37.884889 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1329/2680] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:55:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:56:39.158075 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534fbe8-46e8-4828-bc8e-85cfcec3e8a2 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:39.159519 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-3534fbe8-46e8-4828-bc8e-85cfcec3e8a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:39.225644 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534fbe8-46e8-4828-bc8e-85cfcec3e8a2 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:39.229333 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564ac82-b8c4-4c25-87d7-84cc7a3e26fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:39.229974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564ac82-b8c4-4c25-87d7-84cc7a3e26fb service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:39.230250 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564ac82-b8c4-4c25-87d7-84cc7a3e26fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:39.230537 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564ac82-b8c4-4c25-87d7-84cc7a3e26fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:39.232339 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0564ac82-b8c4-4c25-87d7-84cc7a3e26fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:39.294865 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564ac82-b8c4-4c25-87d7-84cc7a3e26fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:39.296349 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564ac82-b8c4-4c25-87d7-84cc7a3e26fb service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:39.306171 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1352/2681] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:56:40.064546 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457840d2-c1e4-428a-b4c5-3b9d83ab8d28 service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:40.065990 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-457840d2-c1e4-428a-b4c5-3b9d83ab8d28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:40.077639 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457840d2-c1e4-428a-b4c5-3b9d83ab8d28 service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:40.081624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e50d6-fe91-4009-941c-256f23c07442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:40.082112 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e50d6-fe91-4009-941c-256f23c07442 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:40.082403 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e50d6-fe91-4009-941c-256f23c07442 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:40.082676 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e50d6-fe91-4009-941c-256f23c07442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:40.084809 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-0a7e50d6-fe91-4009-941c-256f23c07442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:40.096974 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e50d6-fe91-4009-941c-256f23c07442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:40.099169 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e50d6-fe91-4009-941c-256f23c07442 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:40.108920 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1330/2682] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:56:43.687937 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564ac82-b8c4-4c25-87d7-84cc7a3e26fb service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:43.689565 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0564ac82-b8c4-4c25-87d7-84cc7a3e26fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:43.703550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564ac82-b8c4-4c25-87d7-84cc7a3e26fb service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:43.711006 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2024ac-a070-4090-ac61-fca98dc09cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:43.711974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2024ac-a070-4090-ac61-fca98dc09cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:43.712341 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2024ac-a070-4090-ac61-fca98dc09cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:43.712841 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2024ac-a070-4090-ac61-fca98dc09cec admin admin] PATH_INFO: `/v3/users/ced48ea897124de6b874e797b6d74f3d` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:43.714329 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2024ac-a070-4090-ac61-fca98dc09cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ced48ea897124de6b874e797b6d74f3d)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:43.716412 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2024ac-a070-4090-ac61-fca98dc09cec admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:43.995275 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4b2024ac-a070-4090-ac61-fca98dc09cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ced48ea897124de6b874e797b6d74f3d'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:44.012874 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4b2024ac-a070-4090-ac61-fca98dc09cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ced48ea897124de6b874e797b6d74f3d'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:44.013626 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4b2024ac-a070-4090-ac61-fca98dc09cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ced48ea897124de6b874e797b6d74f3d'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:44.014239 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4b2024ac-a070-4090-ac61-fca98dc09cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ced48ea897124de6b874e797b6d74f3d'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:44.021628 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-4b2024ac-a070-4090-ac61-fca98dc09cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ced48ea897124de6b874e797b6d74f3d'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:44.121045 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e50d6-fe91-4009-941c-256f23c07442 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:44.123706 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-0a7e50d6-fe91-4009-941c-256f23c07442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:44.139292 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e50d6-fe91-4009-941c-256f23c07442 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:44.144613 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e7fd7-6242-4275-8020-1844debe311f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:44.146109 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e7fd7-6242-4275-8020-1844debe311f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:44.146392 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e7fd7-6242-4275-8020-1844debe311f admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:44.146668 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e7fd7-6242-4275-8020-1844debe311f admin admin] PATH_INFO: `/v3/users/728607c7138540d69532b0b806b9ccaf` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:44.159289 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1353/2683] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:56:43 2022] DELETE /identity/v3/users/ced48ea897124de6b874e797b6d74f3d => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:44.161662 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e7fd7-6242-4275-8020-1844debe311f admin admin] RBAC: Authorizing `identity:delete_user(user_id=728607c7138540d69532b0b806b9ccaf)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:44.163746 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e7fd7-6242-4275-8020-1844debe311f admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:44.399291 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-c26e7fd7-6242-4275-8020-1844debe311f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728607c7138540d69532b0b806b9ccaf'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:44.401980 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-c26e7fd7-6242-4275-8020-1844debe311f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728607c7138540d69532b0b806b9ccaf'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:44.402666 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-c26e7fd7-6242-4275-8020-1844debe311f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728607c7138540d69532b0b806b9ccaf'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:44.440560 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2024ac-a070-4090-ac61-fca98dc09cec admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:44.442031 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-4b2024ac-a070-4090-ac61-fca98dc09cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:44.502029 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-c26e7fd7-6242-4275-8020-1844debe311f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728607c7138540d69532b0b806b9ccaf'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:44.502676 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-c26e7fd7-6242-4275-8020-1844debe311f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728607c7138540d69532b0b806b9ccaf'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:44.509681 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2024ac-a070-4090-ac61-fca98dc09cec admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:44.514343 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441aced1-224c-4fef-b242-dde37ad1b714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:44.515206 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441aced1-224c-4fef-b242-dde37ad1b714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:44.515487 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441aced1-224c-4fef-b242-dde37ad1b714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:44.515775 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441aced1-224c-4fef-b242-dde37ad1b714 admin admin] PATH_INFO: `/v3/projects/500118b8b6da4bba959c36961a149a19` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:44.517013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441aced1-224c-4fef-b242-dde37ad1b714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=500118b8b6da4bba959c36961a149a19)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:44.517396 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1331/2684] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:56:44 2022] DELETE /identity/v3/users/728607c7138540d69532b0b806b9ccaf => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:44.519078 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441aced1-224c-4fef-b242-dde37ad1b714 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:44.628246 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-441aced1-224c-4fef-b242-dde37ad1b714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '500118b8b6da4bba959c36961a149a19', 'request_id': 'req-441aced1-224c-4fef-b242-dde37ad1b714'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:44.634278 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-441aced1-224c-4fef-b242-dde37ad1b714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '500118b8b6da4bba959c36961a149a19', 'request_id': 'req-441aced1-224c-4fef-b242-dde37ad1b714'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:44.640624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-441aced1-224c-4fef-b242-dde37ad1b714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '500118b8b6da4bba959c36961a149a19', 'request_id': 'req-441aced1-224c-4fef-b242-dde37ad1b714'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:44.735960 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-441aced1-224c-4fef-b242-dde37ad1b714 admin admin] The token cache is being invalidate because project 500118b8b6da4bba959c36961a149a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:56:44.736621 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-441aced1-224c-4fef-b242-dde37ad1b714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:44.736886 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-441aced1-224c-4fef-b242-dde37ad1b714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:44.738473 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1354/2685] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:56:44 2022] DELETE /identity/v3/projects/500118b8b6da4bba959c36961a149a19 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:56:44.744468 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0e59f-de58-4b62-9b53-8f2b6f154842 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:44.744709 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0e59f-de58-4b62-9b53-8f2b6f154842 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:44.744992 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0e59f-de58-4b62-9b53-8f2b6f154842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:44.762621 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-21d0e59f-de58-4b62-9b53-8f2b6f154842 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:44.763815 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-21d0e59f-de58-4b62-9b53-8f2b6f154842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:44.784369 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441aced1-224c-4fef-b242-dde37ad1b714 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:44.786196 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-441aced1-224c-4fef-b242-dde37ad1b714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:44.828200 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1332/2686] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:44.838494 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d63701-6d43-4888-9406-b9549db3c78a None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:44.838785 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d63701-6d43-4888-9406-b9549db3c78a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:44.839315 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d63701-6d43-4888-9406-b9549db3c78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:44.858955 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-68d63701-6d43-4888-9406-b9549db3c78a None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:44.865971 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441aced1-224c-4fef-b242-dde37ad1b714 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:44.866093 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-68d63701-6d43-4888-9406-b9549db3c78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:44.866179 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207972c-e920-4e65-b272-496d11b0a0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:44.866179 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207972c-e920-4e65-b272-496d11b0a0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:44.866179 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207972c-e920-4e65-b272-496d11b0a0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:44.866441 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207972c-e920-4e65-b272-496d11b0a0cc admin admin] PATH_INFO: `/v3/projects/754e7f374dfc4e1f9067b86fdc0cb279` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:44.867551 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207972c-e920-4e65-b272-496d11b0a0cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=754e7f374dfc4e1f9067b86fdc0cb279)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:44.868898 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1333/2687] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:56:44.869515 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207972c-e920-4e65-b272-496d11b0a0cc admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:44.874055 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d63701-6d43-4888-9406-b9549db3c78a None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:44.886918 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d63701-6d43-4888-9406-b9549db3c78a None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:44.892868 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f6bc1-400d-4ed8-aa62-b7603c6d9c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:44.893690 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f6bc1-400d-4ed8-aa62-b7603c6d9c87 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:44.894036 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f6bc1-400d-4ed8-aa62-b7603c6d9c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:44.894335 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f6bc1-400d-4ed8-aa62-b7603c6d9c87 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:44.895591 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f6bc1-400d-4ed8-aa62-b7603c6d9c87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:56:44.896008 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f6bc1-400d-4ed8-aa62-b7603c6d9c87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:44.898177 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f6bc1-400d-4ed8-aa62-b7603c6d9c87 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:44.913318 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1334/2688] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:56:44.917498 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f6bc1-400d-4ed8-aa62-b7603c6d9c87 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:44.928546 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f6bc1-400d-4ed8-aa62-b7603c6d9c87 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:44.933263 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407bdf9-b9db-4efa-b8ff-a96fe22f1bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:44.933916 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407bdf9-b9db-4efa-b8ff-a96fe22f1bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:44.934200 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407bdf9-b9db-4efa-b8ff-a96fe22f1bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:44.934480 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407bdf9-b9db-4efa-b8ff-a96fe22f1bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:44.935166 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407bdf9-b9db-4efa-b8ff-a96fe22f1bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:44.937139 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407bdf9-b9db-4efa-b8ff-a96fe22f1bc1 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:44.990386 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3207972c-e920-4e65-b272-496d11b0a0cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '754e7f374dfc4e1f9067b86fdc0cb279', 'request_id': 'req-3207972c-e920-4e65-b272-496d11b0a0cc'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:44.996046 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3207972c-e920-4e65-b272-496d11b0a0cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '754e7f374dfc4e1f9067b86fdc0cb279', 'request_id': 'req-3207972c-e920-4e65-b272-496d11b0a0cc'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:45.002195 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3207972c-e920-4e65-b272-496d11b0a0cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '754e7f374dfc4e1f9067b86fdc0cb279', 'request_id': 'req-3207972c-e920-4e65-b272-496d11b0a0cc'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:45.040579 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1335/2689] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:56:44 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:56:45.044625 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407bdf9-b9db-4efa-b8ff-a96fe22f1bc1 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:45.104093 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407bdf9-b9db-4efa-b8ff-a96fe22f1bc1 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:45.108835 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c883307-e460-404c-ac2f-f4e2440bb62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:45.109497 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c883307-e460-404c-ac2f-f4e2440bb62a admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:45.109781 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c883307-e460-404c-ac2f-f4e2440bb62a admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:45.110054 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c883307-e460-404c-ac2f-f4e2440bb62a admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:45.110741 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c883307-e460-404c-ac2f-f4e2440bb62a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:45.112677 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c883307-e460-404c-ac2f-f4e2440bb62a admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:45.113146 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3207972c-e920-4e65-b272-496d11b0a0cc admin admin] The token cache is being invalidate because project 754e7f374dfc4e1f9067b86fdc0cb279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:56:45.114834 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3207972c-e920-4e65-b272-496d11b0a0cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:45.115488 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-3207972c-e920-4e65-b272-496d11b0a0cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:45.117123 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1355/2690] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:56:44 2022] DELETE /identity/v3/projects/754e7f374dfc4e1f9067b86fdc0cb279 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:45.122676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8b921-ff02-4cdf-9631-39c4bf2b0f71 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:45.122974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8b921-ff02-4cdf-9631-39c4bf2b0f71 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:45.123251 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8b921-ff02-4cdf-9631-39c4bf2b0f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:45.144526 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-bfa8b921-ff02-4cdf-9631-39c4bf2b0f71 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:45.147313 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-bfa8b921-ff02-4cdf-9631-39c4bf2b0f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:45.155326 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1356/2691] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:56:45.172608 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570af851-23f5-46dd-bb66-2f97204e4b7b None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:45.173320 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570af851-23f5-46dd-bb66-2f97204e4b7b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:45.173881 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570af851-23f5-46dd-bb66-2f97204e4b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:45.199573 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-570af851-23f5-46dd-bb66-2f97204e4b7b None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:45.201625 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-570af851-23f5-46dd-bb66-2f97204e4b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:45.212029 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1357/2692] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:56:45.216447 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570af851-23f5-46dd-bb66-2f97204e4b7b None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:45.222267 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1336/2693] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:56:45 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:56:45.226094 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570af851-23f5-46dd-bb66-2f97204e4b7b None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:45.231018 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba8638-0bc1-4b5a-a5cd-cb9861358318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:45.231754 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba8638-0bc1-4b5a-a5cd-cb9861358318 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:45.231850 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c883307-e460-404c-ac2f-f4e2440bb62a admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:45.232037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba8638-0bc1-4b5a-a5cd-cb9861358318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:45.232312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba8638-0bc1-4b5a-a5cd-cb9861358318 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:45.233075 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba8638-0bc1-4b5a-a5cd-cb9861358318 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:56:45.233379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba8638-0bc1-4b5a-a5cd-cb9861358318 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:45.233478 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-0c883307-e460-404c-ac2f-f4e2440bb62a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:45.234995 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba8638-0bc1-4b5a-a5cd-cb9861358318 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:45.245841 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c883307-e460-404c-ac2f-f4e2440bb62a admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:45.247378 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1358/2694] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:56:45.251729 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba8638-0bc1-4b5a-a5cd-cb9861358318 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:45.253912 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c54050-6c45-41a2-b690-075ad2e09b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:45.255323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c54050-6c45-41a2-b690-075ad2e09b2d admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:45.257967 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c54050-6c45-41a2-b690-075ad2e09b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:45.257967 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c54050-6c45-41a2-b690-075ad2e09b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:45.257967 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c54050-6c45-41a2-b690-075ad2e09b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:45.258370 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c54050-6c45-41a2-b690-075ad2e09b2d admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:45.262551 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba8638-0bc1-4b5a-a5cd-cb9861358318 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:45.267651 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d8af1-67a5-4054-ae1e-ecc357cb64f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:45.268291 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d8af1-67a5-4054-ae1e-ecc357cb64f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:45.268600 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d8af1-67a5-4054-ae1e-ecc357cb64f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:45.268920 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d8af1-67a5-4054-ae1e-ecc357cb64f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:45.269725 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d8af1-67a5-4054-ae1e-ecc357cb64f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:45.272087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d8af1-67a5-4054-ae1e-ecc357cb64f0 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:45.272499 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1337/2695] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:56:45.273242 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c54050-6c45-41a2-b690-075ad2e09b2d admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:45.282873 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c54050-6c45-41a2-b690-075ad2e09b2d admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:45.287806 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a397df8-94ad-4115-93e5-f94bf35346c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:45.288414 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a397df8-94ad-4115-93e5-f94bf35346c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:45.288724 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a397df8-94ad-4115-93e5-f94bf35346c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:45.289048 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a397df8-94ad-4115-93e5-f94bf35346c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:45.289769 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a397df8-94ad-4115-93e5-f94bf35346c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:45.291417 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a397df8-94ad-4115-93e5-f94bf35346c2 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:45.301321 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1338/2696] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:56:45.305514 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a397df8-94ad-4115-93e5-f94bf35346c2 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:45.314783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a397df8-94ad-4115-93e5-f94bf35346c2 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:45.320102 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684de33-5eb8-4f1f-9cfa-b1d49c8f6dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:45.321042 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684de33-5eb8-4f1f-9cfa-b1d49c8f6dba admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:45.321325 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684de33-5eb8-4f1f-9cfa-b1d49c8f6dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:45.321600 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684de33-5eb8-4f1f-9cfa-b1d49c8f6dba admin admin] PATH_INFO: `/v3/projects/cbb4eab171284cc0adc3af531cb48c7d/users/01d34f11504f4ac99ac7487bb4156d2c/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:45.336926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684de33-5eb8-4f1f-9cfa-b1d49c8f6dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb4eab171284cc0adc3af531cb48c7d, user_id=01d34f11504f4ac99ac7487bb4156d2c, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:45.339934 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684de33-5eb8-4f1f-9cfa-b1d49c8f6dba admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:45.394874 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1359/2697] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:56:45 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:56:45.399315 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d8af1-67a5-4054-ae1e-ecc357cb64f0 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:45.428371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1339/2698] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:56:45 2022] PUT /identity/v3/projects/cbb4eab171284cc0adc3af531cb48c7d/users/01d34f11504f4ac99ac7487bb4156d2c/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:56:45.433370 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32713782-01bb-4501-b5ef-df3859924236 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:45.433657 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32713782-01bb-4501-b5ef-df3859924236 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:45.433931 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32713782-01bb-4501-b5ef-df3859924236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:45.450538 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-32713782-01bb-4501-b5ef-df3859924236 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:45.451746 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-32713782-01bb-4501-b5ef-df3859924236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:45.464535 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d8af1-67a5-4054-ae1e-ecc357cb64f0 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:45.514468 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1340/2699] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:45.521111 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438e76b-9298-41da-b39e-a854c136b9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:45.521787 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438e76b-9298-41da-b39e-a854c136b9fb admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:45.522070 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438e76b-9298-41da-b39e-a854c136b9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:45.522346 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438e76b-9298-41da-b39e-a854c136b9fb admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:45.523040 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438e76b-9298-41da-b39e-a854c136b9fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:45.524342 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32713782-01bb-4501-b5ef-df3859924236 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:45.524994 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438e76b-9298-41da-b39e-a854c136b9fb admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:45.525875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-32713782-01bb-4501-b5ef-df3859924236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:45.580946 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32713782-01bb-4501-b5ef-df3859924236 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:45.585211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4b481-2a7d-48c9-90cf-44ff4dd2a2af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:45.585848 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4b481-2a7d-48c9-90cf-44ff4dd2a2af service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:45.586130 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4b481-2a7d-48c9-90cf-44ff4dd2a2af service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:45.586405 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4b481-2a7d-48c9-90cf-44ff4dd2a2af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:45.597347 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4b481-2a7d-48c9-90cf-44ff4dd2a2af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:45.597347 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4b481-2a7d-48c9-90cf-44ff4dd2a2af service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:45.607281 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1341/2700] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:56:45.633171 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1360/2701] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:56:45 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:56:45.638445 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4b481-2a7d-48c9-90cf-44ff4dd2a2af service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:45.651219 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4b481-2a7d-48c9-90cf-44ff4dd2a2af service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:45.656131 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e1102-c9e9-4dc7-9315-0bfa0ff8a61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:45.656828 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e1102-c9e9-4dc7-9315-0bfa0ff8a61f admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:45.657115 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e1102-c9e9-4dc7-9315-0bfa0ff8a61f admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:45.657390 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e1102-c9e9-4dc7-9315-0bfa0ff8a61f admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:45.658107 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e1102-c9e9-4dc7-9315-0bfa0ff8a61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:45.659715 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e1102-c9e9-4dc7-9315-0bfa0ff8a61f admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:45.670869 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1342/2702] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:56:45.674943 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438e76b-9298-41da-b39e-a854c136b9fb admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:45.684851 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438e76b-9298-41da-b39e-a854c136b9fb admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:45.689545 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50008ea-fd53-4164-b86a-8aaf3b5df19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:45.690201 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50008ea-fd53-4164-b86a-8aaf3b5df19a admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:45.690482 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50008ea-fd53-4164-b86a-8aaf3b5df19a admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:45.690756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50008ea-fd53-4164-b86a-8aaf3b5df19a admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:45.691505 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50008ea-fd53-4164-b86a-8aaf3b5df19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:45.693114 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50008ea-fd53-4164-b86a-8aaf3b5df19a admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:45.702995 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1361/2703] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:56:45.707086 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e1102-c9e9-4dc7-9315-0bfa0ff8a61f admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:45.717916 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e1102-c9e9-4dc7-9315-0bfa0ff8a61f admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:45.722851 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ab82f-68b9-4ad9-8aa7-29578c9d1402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:45.724761 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ab82f-68b9-4ad9-8aa7-29578c9d1402 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:45.725053 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ab82f-68b9-4ad9-8aa7-29578c9d1402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:45.725334 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ab82f-68b9-4ad9-8aa7-29578c9d1402 admin admin] PATH_INFO: `/v3/projects/f1abcab3b51c4586b1c1e44c8d236673/users/0320c0b6825a4d0882e1aa831f977996/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:45.740608 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ab82f-68b9-4ad9-8aa7-29578c9d1402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1abcab3b51c4586b1c1e44c8d236673, user_id=0320c0b6825a4d0882e1aa831f977996, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:45.743335 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ab82f-68b9-4ad9-8aa7-29578c9d1402 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:45.870936 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1343/2704] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:56:45 2022] PUT /identity/v3/projects/f1abcab3b51c4586b1c1e44c8d236673/users/0320c0b6825a4d0882e1aa831f977996/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:45.884356 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bda99-8e91-421b-9579-c432e82dfd60 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:45.884903 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bda99-8e91-421b-9579-c432e82dfd60 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:45.885146 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bda99-8e91-421b-9579-c432e82dfd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:45.912415 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-3b6bda99-8e91-421b-9579-c432e82dfd60 None None] MFA Rules not processed for user `0320c0b6825a4d0882e1aa831f977996`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:45.913656 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-3b6bda99-8e91-421b-9579-c432e82dfd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:45.983065 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1362/2705] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:56:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:45.987652 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ab82f-68b9-4ad9-8aa7-29578c9d1402 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:46.047973 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ab82f-68b9-4ad9-8aa7-29578c9d1402 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:46.053348 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57d5e8-cb2b-4824-8840-1bc18993a7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:46.053995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57d5e8-cb2b-4824-8840-1bc18993a7cb admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:46.054279 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57d5e8-cb2b-4824-8840-1bc18993a7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:46.054554 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57d5e8-cb2b-4824-8840-1bc18993a7cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:46.055249 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57d5e8-cb2b-4824-8840-1bc18993a7cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:46.057232 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57d5e8-cb2b-4824-8840-1bc18993a7cb admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:46.195749 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1344/2706] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:56:45 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:56:46.197705 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bda99-8e91-421b-9579-c432e82dfd60 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:46.210363 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bda99-8e91-421b-9579-c432e82dfd60 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:46.266705 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbbbea-d315-4808-83c7-214e150f4741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:46.267312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbbbea-d315-4808-83c7-214e150f4741 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:46.267596 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbbbea-d315-4808-83c7-214e150f4741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:46.267872 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbbbea-d315-4808-83c7-214e150f4741 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:46.268582 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbbbea-d315-4808-83c7-214e150f4741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:46.271351 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbbbea-d315-4808-83c7-214e150f4741 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:46.371643 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1363/2707] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:56:46 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:56:46.375787 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57d5e8-cb2b-4824-8840-1bc18993a7cb admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:46.386939 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57d5e8-cb2b-4824-8840-1bc18993a7cb admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:46.391764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a16cf-3950-4da8-a3c1-97e53e60c327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:46.392371 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a16cf-3950-4da8-a3c1-97e53e60c327 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:46.392683 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a16cf-3950-4da8-a3c1-97e53e60c327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:46.392954 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a16cf-3950-4da8-a3c1-97e53e60c327 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:46.393680 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a16cf-3950-4da8-a3c1-97e53e60c327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:46.395305 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a16cf-3950-4da8-a3c1-97e53e60c327 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:46.405939 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1345/2708] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:56:46.410144 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbbbea-d315-4808-83c7-214e150f4741 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:46.420016 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbbbea-d315-4808-83c7-214e150f4741 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:46.424633 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2169a-7899-41af-83b9-4f840cd519e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:46.425545 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2169a-7899-41af-83b9-4f840cd519e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:46.425824 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2169a-7899-41af-83b9-4f840cd519e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:46.426641 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2169a-7899-41af-83b9-4f840cd519e3 admin admin] PATH_INFO: `/v3/projects/ffc0eb3457344770bbb5c7b3049046e3/users/6f0e8eeea2a6401696e2368ae25bef53/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:46.441296 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2169a-7899-41af-83b9-4f840cd519e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc0eb3457344770bbb5c7b3049046e3, user_id=6f0e8eeea2a6401696e2368ae25bef53, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:46.444544 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2169a-7899-41af-83b9-4f840cd519e3 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:46.548008 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1364/2709] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:56:46 2022] PUT /identity/v3/projects/ffc0eb3457344770bbb5c7b3049046e3/users/6f0e8eeea2a6401696e2368ae25bef53/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:46.552759 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a16cf-3950-4da8-a3c1-97e53e60c327 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:46.562601 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a16cf-3950-4da8-a3c1-97e53e60c327 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:46.617932 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c6711-87ff-4a03-a4fc-a82dd13b5efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:46.618632 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c6711-87ff-4a03-a4fc-a82dd13b5efd admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:46.618917 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c6711-87ff-4a03-a4fc-a82dd13b5efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:46.619192 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c6711-87ff-4a03-a4fc-a82dd13b5efd admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:46.619979 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c6711-87ff-4a03-a4fc-a82dd13b5efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:46.621627 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c6711-87ff-4a03-a4fc-a82dd13b5efd admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:46.632117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1346/2710] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:56:46.636394 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2169a-7899-41af-83b9-4f840cd519e3 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:46.647303 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2169a-7899-41af-83b9-4f840cd519e3 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:46.652409 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f0064-6f92-498a-8516-18120b4c91fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:46.653339 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f0064-6f92-498a-8516-18120b4c91fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:46.653619 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f0064-6f92-498a-8516-18120b4c91fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:46.653897 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f0064-6f92-498a-8516-18120b4c91fd admin admin] PATH_INFO: `/v3/projects/ffc0eb3457344770bbb5c7b3049046e3/users/6f0e8eeea2a6401696e2368ae25bef53/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:46.656170 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f0064-6f92-498a-8516-18120b4c91fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc0eb3457344770bbb5c7b3049046e3, user_id=6f0e8eeea2a6401696e2368ae25bef53, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:46.658875 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f0064-6f92-498a-8516-18120b4c91fd admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:46.669911 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1365/2711] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:56:46 2022] PUT /identity/v3/projects/ffc0eb3457344770bbb5c7b3049046e3/users/6f0e8eeea2a6401696e2368ae25bef53/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:46.681759 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57fa75-5c4c-4f87-aaa2-65ee1444479f None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:46.682051 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57fa75-5c4c-4f87-aaa2-65ee1444479f None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:46.682499 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57fa75-5c4c-4f87-aaa2-65ee1444479f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:46.709860 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-5b57fa75-5c4c-4f87-aaa2-65ee1444479f None None] MFA Rules not processed for user `6f0e8eeea2a6401696e2368ae25bef53`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:46.716997 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-5b57fa75-5c4c-4f87-aaa2-65ee1444479f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:46.781642 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1347/2712] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:56:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:56:46.793667 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f0064-6f92-498a-8516-18120b4c91fd admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:46.795781 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b38f0064-6f92-498a-8516-18120b4c91fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:46.880551 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f0064-6f92-498a-8516-18120b4c91fd admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:46.885374 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd6fe8-6a46-4c31-9705-2778728f4c37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:46.886283 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd6fe8-6a46-4c31-9705-2778728f4c37 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:46.886696 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd6fe8-6a46-4c31-9705-2778728f4c37 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:46.887019 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd6fe8-6a46-4c31-9705-2778728f4c37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:46.898966 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd6fe8-6a46-4c31-9705-2778728f4c37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:46.900819 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd6fe8-6a46-4c31-9705-2778728f4c37 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:46.913966 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1366/2713] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:56:46.983968 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57fa75-5c4c-4f87-aaa2-65ee1444479f None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:47.055685 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57fa75-5c4c-4f87-aaa2-65ee1444479f None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:47.060225 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d611c-8b28-4f93-92cf-19771c03ab01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:47.061156 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d611c-8b28-4f93-92cf-19771c03ab01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:47.061438 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d611c-8b28-4f93-92cf-19771c03ab01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:47.062567 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d611c-8b28-4f93-92cf-19771c03ab01 admin admin] PATH_INFO: `/v3/users/0320c0b6825a4d0882e1aa831f977996` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:47.062954 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d611c-8b28-4f93-92cf-19771c03ab01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0320c0b6825a4d0882e1aa831f977996)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:47.064925 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d611c-8b28-4f93-92cf-19771c03ab01 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:47.277359 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ed3d611c-8b28-4f93-92cf-19771c03ab01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0320c0b6825a4d0882e1aa831f977996'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:47.290998 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ed3d611c-8b28-4f93-92cf-19771c03ab01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0320c0b6825a4d0882e1aa831f977996'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:47.291725 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ed3d611c-8b28-4f93-92cf-19771c03ab01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0320c0b6825a4d0882e1aa831f977996'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:47.399122 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ed3d611c-8b28-4f93-92cf-19771c03ab01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0320c0b6825a4d0882e1aa831f977996'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:47.400125 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ed3d611c-8b28-4f93-92cf-19771c03ab01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0320c0b6825a4d0882e1aa831f977996'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:47.414192 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1348/2714] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:56:46 2022] DELETE /identity/v3/users/0320c0b6825a4d0882e1aa831f977996 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:47.418937 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf9501-4916-40bd-a2fc-3e28a974f650 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:47.419306 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf9501-4916-40bd-a2fc-3e28a974f650 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:47.419644 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf9501-4916-40bd-a2fc-3e28a974f650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:47.437648 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-7eaf9501-4916-40bd-a2fc-3e28a974f650 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:47.442770 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-7eaf9501-4916-40bd-a2fc-3e28a974f650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:47.498690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1367/2715] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:47.509004 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d611c-8b28-4f93-92cf-19771c03ab01 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:47.512450 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-ed3d611c-8b28-4f93-92cf-19771c03ab01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:47.570833 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d611c-8b28-4f93-92cf-19771c03ab01 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:47.574911 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbae59-9782-4ed6-a94f-52f542eccf4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:47.575694 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbae59-9782-4ed6-a94f-52f542eccf4e service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:47.576040 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbae59-9782-4ed6-a94f-52f542eccf4e service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:47.576379 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbae59-9782-4ed6-a94f-52f542eccf4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:47.592833 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbae59-9782-4ed6-a94f-52f542eccf4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:47.594304 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbae59-9782-4ed6-a94f-52f542eccf4e service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:47.605488 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1349/2716] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:56:48.269493 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf9501-4916-40bd-a2fc-3e28a974f650 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:48.271705 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-7eaf9501-4916-40bd-a2fc-3e28a974f650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:48.296121 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf9501-4916-40bd-a2fc-3e28a974f650 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:48.310633 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc8923-5783-4a70-8e8f-cd7fb8c234ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:48.311526 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc8923-5783-4a70-8e8f-cd7fb8c234ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:48.311807 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc8923-5783-4a70-8e8f-cd7fb8c234ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:48.312083 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc8923-5783-4a70-8e8f-cd7fb8c234ed admin admin] PATH_INFO: `/v3/projects/f1abcab3b51c4586b1c1e44c8d236673` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:48.313741 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc8923-5783-4a70-8e8f-cd7fb8c234ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1abcab3b51c4586b1c1e44c8d236673)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:48.315360 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc8923-5783-4a70-8e8f-cd7fb8c234ed admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:48.456161 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1bcc8923-5783-4a70-8e8f-cd7fb8c234ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1abcab3b51c4586b1c1e44c8d236673', 'request_id': 'req-1bcc8923-5783-4a70-8e8f-cd7fb8c234ed'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:48.461880 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1bcc8923-5783-4a70-8e8f-cd7fb8c234ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1abcab3b51c4586b1c1e44c8d236673', 'request_id': 'req-1bcc8923-5783-4a70-8e8f-cd7fb8c234ed'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:48.468173 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1bcc8923-5783-4a70-8e8f-cd7fb8c234ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1abcab3b51c4586b1c1e44c8d236673', 'request_id': 'req-1bcc8923-5783-4a70-8e8f-cd7fb8c234ed'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:48.565217 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1bcc8923-5783-4a70-8e8f-cd7fb8c234ed admin admin] The token cache is being invalidate because project f1abcab3b51c4586b1c1e44c8d236673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:56:48.565704 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1bcc8923-5783-4a70-8e8f-cd7fb8c234ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:48.566993 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-1bcc8923-5783-4a70-8e8f-cd7fb8c234ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:48.568599 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1368/2717] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:56:48 2022] DELETE /identity/v3/projects/f1abcab3b51c4586b1c1e44c8d236673 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:56:48.572775 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbae59-9782-4ed6-a94f-52f542eccf4e service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:48.583549 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbae59-9782-4ed6-a94f-52f542eccf4e service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:48.656292 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b43e5-5105-4641-a9db-6280654d5733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:48.657213 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b43e5-5105-4641-a9db-6280654d5733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:48.657490 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b43e5-5105-4641-a9db-6280654d5733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:48.657773 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b43e5-5105-4641-a9db-6280654d5733 admin admin] PATH_INFO: `/v3/users/6f0e8eeea2a6401696e2368ae25bef53` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:48.658987 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b43e5-5105-4641-a9db-6280654d5733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f0e8eeea2a6401696e2368ae25bef53)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:48.661731 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b43e5-5105-4641-a9db-6280654d5733 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:48.889886 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-020b43e5-5105-4641-a9db-6280654d5733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f0e8eeea2a6401696e2368ae25bef53'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:48.905127 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-020b43e5-5105-4641-a9db-6280654d5733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f0e8eeea2a6401696e2368ae25bef53'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:48.905908 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-020b43e5-5105-4641-a9db-6280654d5733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f0e8eeea2a6401696e2368ae25bef53'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:48.965511 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-020b43e5-5105-4641-a9db-6280654d5733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f0e8eeea2a6401696e2368ae25bef53'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:48.966238 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-020b43e5-5105-4641-a9db-6280654d5733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f0e8eeea2a6401696e2368ae25bef53'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:48.981219 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1350/2718] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:56:48 2022] DELETE /identity/v3/users/6f0e8eeea2a6401696e2368ae25bef53 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:49.560087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc8923-5783-4a70-8e8f-cd7fb8c234ed admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:49.564547 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-1bcc8923-5783-4a70-8e8f-cd7fb8c234ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:49.581692 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc8923-5783-4a70-8e8f-cd7fb8c234ed admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:49.662268 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a98ea-019d-4ed6-ac0e-bab8233f617e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:49.663461 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a98ea-019d-4ed6-ac0e-bab8233f617e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:49.663881 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a98ea-019d-4ed6-ac0e-bab8233f617e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:49.664283 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a98ea-019d-4ed6-ac0e-bab8233f617e admin admin] PATH_INFO: `/v3/projects/ffc0eb3457344770bbb5c7b3049046e3` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:49.673174 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a98ea-019d-4ed6-ac0e-bab8233f617e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc0eb3457344770bbb5c7b3049046e3)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:49.673174 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a98ea-019d-4ed6-ac0e-bab8233f617e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:49.822175 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a56a98ea-019d-4ed6-ac0e-bab8233f617e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc0eb3457344770bbb5c7b3049046e3', 'request_id': 'req-a56a98ea-019d-4ed6-ac0e-bab8233f617e'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:49.827935 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a56a98ea-019d-4ed6-ac0e-bab8233f617e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc0eb3457344770bbb5c7b3049046e3', 'request_id': 'req-a56a98ea-019d-4ed6-ac0e-bab8233f617e'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:49.835844 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a56a98ea-019d-4ed6-ac0e-bab8233f617e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc0eb3457344770bbb5c7b3049046e3', 'request_id': 'req-a56a98ea-019d-4ed6-ac0e-bab8233f617e'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:49.965000 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a56a98ea-019d-4ed6-ac0e-bab8233f617e admin admin] The token cache is being invalidate because project ffc0eb3457344770bbb5c7b3049046e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:56:49.966318 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a56a98ea-019d-4ed6-ac0e-bab8233f617e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:49.966522 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a56a98ea-019d-4ed6-ac0e-bab8233f617e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:49.969501 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1369/2719] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:56:49 2022] DELETE /identity/v3/projects/ffc0eb3457344770bbb5c7b3049046e3 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:49.978551 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4efda-e124-4083-a6b4-cdea626b3841 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:49.979031 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4efda-e124-4083-a6b4-cdea626b3841 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:49.979506 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4efda-e124-4083-a6b4-cdea626b3841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:50.009027 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-d8b4efda-e124-4083-a6b4-cdea626b3841 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:50.011642 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-d8b4efda-e124-4083-a6b4-cdea626b3841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:50.087208 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1351/2720] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:50.099198 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9c411-1f9d-4ab6-a23f-a1a13dfbc905 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:50.099507 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9c411-1f9d-4ab6-a23f-a1a13dfbc905 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:50.099783 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9c411-1f9d-4ab6-a23f-a1a13dfbc905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:50.120148 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-5bc9c411-1f9d-4ab6-a23f-a1a13dfbc905 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:50.121479 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-5bc9c411-1f9d-4ab6-a23f-a1a13dfbc905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:50.130669 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1370/2721] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:50.135387 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4efda-e124-4083-a6b4-cdea626b3841 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:50.145697 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4efda-e124-4083-a6b4-cdea626b3841 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:50.150607 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bc35f-e364-4c68-946a-1bb244af8dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:50.151268 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bc35f-e364-4c68-946a-1bb244af8dad admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:50.151552 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bc35f-e364-4c68-946a-1bb244af8dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:50.151829 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bc35f-e364-4c68-946a-1bb244af8dad admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:50.152551 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bc35f-e364-4c68-946a-1bb244af8dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:56:50.153048 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bc35f-e364-4c68-946a-1bb244af8dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:50.154659 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bc35f-e364-4c68-946a-1bb244af8dad admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:50.166521 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1352/2722] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:56:50.171095 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9c411-1f9d-4ab6-a23f-a1a13dfbc905 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:50.181131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9c411-1f9d-4ab6-a23f-a1a13dfbc905 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:50.186212 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516da09-8854-49bb-8b20-ba17a9b5c2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:50.187001 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516da09-8854-49bb-8b20-ba17a9b5c2af admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:50.187434 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516da09-8854-49bb-8b20-ba17a9b5c2af admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:50.188255 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516da09-8854-49bb-8b20-ba17a9b5c2af admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:50.188561 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516da09-8854-49bb-8b20-ba17a9b5c2af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:50.190504 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516da09-8854-49bb-8b20-ba17a9b5c2af admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:50.304139 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1371/2723] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:56:50 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:56:50.308473 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bc35f-e364-4c68-946a-1bb244af8dad admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:50.323102 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bc35f-e364-4c68-946a-1bb244af8dad admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:50.391433 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b478a0-ec57-44a4-ae96-714d51b3978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:50.392250 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b478a0-ec57-44a4-ae96-714d51b3978e admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:50.392499 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b478a0-ec57-44a4-ae96-714d51b3978e admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:50.393042 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b478a0-ec57-44a4-ae96-714d51b3978e admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:50.394111 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b478a0-ec57-44a4-ae96-714d51b3978e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:50.398409 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b478a0-ec57-44a4-ae96-714d51b3978e admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:50.503358 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1353/2724] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:56:50 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:56:50.508577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516da09-8854-49bb-8b20-ba17a9b5c2af admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:50.521731 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516da09-8854-49bb-8b20-ba17a9b5c2af admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:50.528083 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befffb70-89ab-434f-a7e3-0e98646436e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:50.529350 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befffb70-89ab-434f-a7e3-0e98646436e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:50.529350 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befffb70-89ab-434f-a7e3-0e98646436e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:50.529350 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befffb70-89ab-434f-a7e3-0e98646436e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:50.530069 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befffb70-89ab-434f-a7e3-0e98646436e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:50.533007 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befffb70-89ab-434f-a7e3-0e98646436e3 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:50.551801 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1372/2725] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:56:50.555813 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b478a0-ec57-44a4-ae96-714d51b3978e admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:50.567827 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b478a0-ec57-44a4-ae96-714d51b3978e admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:50.573128 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a01f5-3492-47c5-9827-2afbf2e6fceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:50.574107 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a01f5-3492-47c5-9827-2afbf2e6fceb admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:50.574489 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a01f5-3492-47c5-9827-2afbf2e6fceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:50.574843 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a01f5-3492-47c5-9827-2afbf2e6fceb admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:50.575727 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a01f5-3492-47c5-9827-2afbf2e6fceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:50.577497 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a01f5-3492-47c5-9827-2afbf2e6fceb admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:50.590303 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1354/2726] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:56:50.595260 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befffb70-89ab-434f-a7e3-0e98646436e3 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:50.607219 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befffb70-89ab-434f-a7e3-0e98646436e3 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:50.613805 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b2d32-bf21-47be-b865-b16466569a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:50.614912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b2d32-bf21-47be-b865-b16466569a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:50.615179 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b2d32-bf21-47be-b865-b16466569a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:50.615580 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b2d32-bf21-47be-b865-b16466569a49 admin admin] PATH_INFO: `/v3/projects/5d67f362564a477491c4b08aa218bde2/users/2f709656d18f4711955d729086047243/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:50.632684 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b2d32-bf21-47be-b865-b16466569a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d67f362564a477491c4b08aa218bde2, user_id=2f709656d18f4711955d729086047243, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:50.635449 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b2d32-bf21-47be-b865-b16466569a49 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:50.788814 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1373/2727] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:56:50 2022] PUT /identity/v3/projects/5d67f362564a477491c4b08aa218bde2/users/2f709656d18f4711955d729086047243/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:50.789754 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc4f50-fd5a-47b3-beba-390a0bc4b538 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:50.790117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc4f50-fd5a-47b3-beba-390a0bc4b538 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:50.791139 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc4f50-fd5a-47b3-beba-390a0bc4b538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:50.822098 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-a0fc4f50-fd5a-47b3-beba-390a0bc4b538 None None] MFA Rules not processed for user `2f709656d18f4711955d729086047243`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:50.823355 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-a0fc4f50-fd5a-47b3-beba-390a0bc4b538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:50.891345 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1355/2728] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:56:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:56:50.896320 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b2d32-bf21-47be-b865-b16466569a49 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:50.981025 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b2d32-bf21-47be-b865-b16466569a49 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:50.987271 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b98bd-4410-4af3-802e-178824f4bc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:50.987908 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b98bd-4410-4af3-802e-178824f4bc82 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:50.988461 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b98bd-4410-4af3-802e-178824f4bc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:50.989013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b98bd-4410-4af3-802e-178824f4bc82 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:50.989820 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b98bd-4410-4af3-802e-178824f4bc82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:50.993033 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b98bd-4410-4af3-802e-178824f4bc82 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:51.121104 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1374/2729] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:56:50 2022] POST /identity/v3/projects => generated 387 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:56:51.126422 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc4f50-fd5a-47b3-beba-390a0bc4b538 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:51.135198 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc4f50-fd5a-47b3-beba-390a0bc4b538 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:51.227587 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844b333-7e09-43b3-acbf-52b6feed22ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:51.228281 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844b333-7e09-43b3-acbf-52b6feed22ea admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:51.228596 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844b333-7e09-43b3-acbf-52b6feed22ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:51.228896 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844b333-7e09-43b3-acbf-52b6feed22ea admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:51.229600 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844b333-7e09-43b3-acbf-52b6feed22ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:51.231578 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844b333-7e09-43b3-acbf-52b6feed22ea admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:51.395402 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1356/2730] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:56:51 2022] POST /identity/v3/users => generated 300 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:56:51.399379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b98bd-4410-4af3-802e-178824f4bc82 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:51.436693 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b98bd-4410-4af3-802e-178824f4bc82 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:51.442405 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee773c4-c0b4-4f84-b053-35aaf03ef0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:51.443408 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee773c4-c0b4-4f84-b053-35aaf03ef0cf admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:51.444624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee773c4-c0b4-4f84-b053-35aaf03ef0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:51.445093 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee773c4-c0b4-4f84-b053-35aaf03ef0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:51.446478 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee773c4-c0b4-4f84-b053-35aaf03ef0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:51.449534 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee773c4-c0b4-4f84-b053-35aaf03ef0cf admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:51.478339 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1375/2731] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:56:51.482353 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844b333-7e09-43b3-acbf-52b6feed22ea admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:51.499656 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844b333-7e09-43b3-acbf-52b6feed22ea admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:51.515844 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51aa08-421d-4a21-8f91-8ac958e8bbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:51.516863 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51aa08-421d-4a21-8f91-8ac958e8bbcd admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:51.517148 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51aa08-421d-4a21-8f91-8ac958e8bbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:51.517522 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51aa08-421d-4a21-8f91-8ac958e8bbcd admin admin] PATH_INFO: `/v3/projects/04709c9f7b8146e1bf55f26e03ebd839/users/6328ec8d1f3c4547a442e5ba0c9721d1/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:51.543055 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51aa08-421d-4a21-8f91-8ac958e8bbcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=04709c9f7b8146e1bf55f26e03ebd839, user_id=6328ec8d1f3c4547a442e5ba0c9721d1, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:51.545835 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51aa08-421d-4a21-8f91-8ac958e8bbcd admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:51.657608 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1357/2732] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:56:51 2022] PUT /identity/v3/projects/04709c9f7b8146e1bf55f26e03ebd839/users/6328ec8d1f3c4547a442e5ba0c9721d1/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:56:51.661710 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee773c4-c0b4-4f84-b053-35aaf03ef0cf admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:51.683386 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495c5be-4c9a-4c87-afe1-d35cc7c6997d None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:51.683675 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495c5be-4c9a-4c87-afe1-d35cc7c6997d None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:51.683952 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495c5be-4c9a-4c87-afe1-d35cc7c6997d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:51.684549 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee773c4-c0b4-4f84-b053-35aaf03ef0cf admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:51.715821 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-f495c5be-4c9a-4c87-afe1-d35cc7c6997d None None] MFA Rules not processed for user `01d34f11504f4ac99ac7487bb4156d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:51.717076 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f495c5be-4c9a-4c87-afe1-d35cc7c6997d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:51.751603 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2b625-2f50-4f02-887d-6a5ef6025ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:51.752379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2b625-2f50-4f02-887d-6a5ef6025ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:51.752760 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2b625-2f50-4f02-887d-6a5ef6025ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:51.753118 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2b625-2f50-4f02-887d-6a5ef6025ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:51.754507 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2b625-2f50-4f02-887d-6a5ef6025ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:51.756468 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2b625-2f50-4f02-887d-6a5ef6025ff6 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:51.766950 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1376/2733] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:56:51.771562 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2b625-2f50-4f02-887d-6a5ef6025ff6 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:51.782212 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2b625-2f50-4f02-887d-6a5ef6025ff6 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:51.787708 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa23c87-a0c7-426b-9736-3b3993e8918d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:51.788494 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa23c87-a0c7-426b-9736-3b3993e8918d admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:51.788868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa23c87-a0c7-426b-9736-3b3993e8918d admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:51.789081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa23c87-a0c7-426b-9736-3b3993e8918d admin admin] PATH_INFO: `/v3/projects/04709c9f7b8146e1bf55f26e03ebd839/users/6328ec8d1f3c4547a442e5ba0c9721d1/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:51.791200 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa23c87-a0c7-426b-9736-3b3993e8918d admin admin] RBAC: Authorizing `identity:create_grant(project_id=04709c9f7b8146e1bf55f26e03ebd839, user_id=6328ec8d1f3c4547a442e5ba0c9721d1, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:51.792233 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1358/2734] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:56:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:56:51.794446 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa23c87-a0c7-426b-9736-3b3993e8918d admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:51.804285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495c5be-4c9a-4c87-afe1-d35cc7c6997d None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:51.805718 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f495c5be-4c9a-4c87-afe1-d35cc7c6997d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:51.807163 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1377/2735] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:56:51 2022] PUT /identity/v3/projects/04709c9f7b8146e1bf55f26e03ebd839/users/6328ec8d1f3c4547a442e5ba0c9721d1/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:56:51.818026 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5263f-fd5c-4603-8491-d0ec2fdaac78 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:51.819004 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5263f-fd5c-4603-8491-d0ec2fdaac78 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:51.819295 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5263f-fd5c-4603-8491-d0ec2fdaac78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:51.852511 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-14d5263f-fd5c-4603-8491-d0ec2fdaac78 None None] MFA Rules not processed for user `6328ec8d1f3c4547a442e5ba0c9721d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:51.854024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-14d5263f-fd5c-4603-8491-d0ec2fdaac78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:51.888258 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495c5be-4c9a-4c87-afe1-d35cc7c6997d None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:51.932323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1378/2736] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:56:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:56:51.944409 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5263f-fd5c-4603-8491-d0ec2fdaac78 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:51.946346 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-14d5263f-fd5c-4603-8491-d0ec2fdaac78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:51.959739 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa799eab-87f5-45d5-aa94-9b43b47c0209 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:51.960496 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa799eab-87f5-45d5-aa94-9b43b47c0209 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:51.960889 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa799eab-87f5-45d5-aa94-9b43b47c0209 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:51.961242 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa799eab-87f5-45d5-aa94-9b43b47c0209 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:52.010269 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5263f-fd5c-4603-8491-d0ec2fdaac78 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:52.014596 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4836c8-75af-4e1e-962f-79797bb1801a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:52.015463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4836c8-75af-4e1e-962f-79797bb1801a service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:52.015896 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4836c8-75af-4e1e-962f-79797bb1801a service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:52.016322 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4836c8-75af-4e1e-962f-79797bb1801a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:52.022044 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa799eab-87f5-45d5-aa94-9b43b47c0209 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:52.023744 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa799eab-87f5-45d5-aa94-9b43b47c0209 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:52.027063 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4836c8-75af-4e1e-962f-79797bb1801a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:52.028519 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4836c8-75af-4e1e-962f-79797bb1801a service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:52.033320 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1359/2737] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:56:52.040817 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1379/2738] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:56:52.182023 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa799eab-87f5-45d5-aa94-9b43b47c0209 service nova] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:52.256987 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa799eab-87f5-45d5-aa94-9b43b47c0209 service nova] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:52.259084 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb0edb-b862-44f9-9eea-5a5d59e499b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:52.259942 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb0edb-b862-44f9-9eea-5a5d59e499b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:52.260225 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb0edb-b862-44f9-9eea-5a5d59e499b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:52.260496 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb0edb-b862-44f9-9eea-5a5d59e499b0 admin admin] PATH_INFO: `/v3/users/2f709656d18f4711955d729086047243` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:52.261738 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb0edb-b862-44f9-9eea-5a5d59e499b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f709656d18f4711955d729086047243)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:52.263674 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb0edb-b862-44f9-9eea-5a5d59e499b0 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:52.476836 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7ecb0edb-b862-44f9-9eea-5a5d59e499b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f709656d18f4711955d729086047243'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:52.490128 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7ecb0edb-b862-44f9-9eea-5a5d59e499b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f709656d18f4711955d729086047243'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:52.490864 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7ecb0edb-b862-44f9-9eea-5a5d59e499b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f709656d18f4711955d729086047243'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:52.576340 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7ecb0edb-b862-44f9-9eea-5a5d59e499b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f709656d18f4711955d729086047243'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:52.577115 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-7ecb0edb-b862-44f9-9eea-5a5d59e499b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f709656d18f4711955d729086047243'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:52.591241 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1360/2739] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:56:52 2022] DELETE /identity/v3/users/2f709656d18f4711955d729086047243 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:56:52.595832 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525b7e0-322b-46e5-b16e-9edb9b0b7a3c None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:52.596128 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525b7e0-322b-46e5-b16e-9edb9b0b7a3c None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:52.596410 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525b7e0-322b-46e5-b16e-9edb9b0b7a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:52.614271 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-1525b7e0-322b-46e5-b16e-9edb9b0b7a3c None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:52.615516 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-1525b7e0-322b-46e5-b16e-9edb9b0b7a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:52.682517 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1380/2740] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:52.692209 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb0edb-b862-44f9-9eea-5a5d59e499b0 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:52.693743 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7ecb0edb-b862-44f9-9eea-5a5d59e499b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:52.752113 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb0edb-b862-44f9-9eea-5a5d59e499b0 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:52.757420 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee4a95-e8bf-4ae7-8217-48d7082c4ac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:52.758156 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee4a95-e8bf-4ae7-8217-48d7082c4ac7 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:52.758530 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee4a95-e8bf-4ae7-8217-48d7082c4ac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:52.758838 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee4a95-e8bf-4ae7-8217-48d7082c4ac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:52.772801 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee4a95-e8bf-4ae7-8217-48d7082c4ac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:52.774266 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee4a95-e8bf-4ae7-8217-48d7082c4ac7 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:52.785833 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1361/2741] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:56:53.246945 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525b7e0-322b-46e5-b16e-9edb9b0b7a3c None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:53.248501 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-1525b7e0-322b-46e5-b16e-9edb9b0b7a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:53.262751 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525b7e0-322b-46e5-b16e-9edb9b0b7a3c None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:53.268444 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323a3a1-1e94-4ca3-ad48-1e204e880628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:53.270391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323a3a1-1e94-4ca3-ad48-1e204e880628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:53.270391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323a3a1-1e94-4ca3-ad48-1e204e880628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:53.270391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323a3a1-1e94-4ca3-ad48-1e204e880628 admin admin] PATH_INFO: `/v3/projects/5d67f362564a477491c4b08aa218bde2` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:53.281468 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323a3a1-1e94-4ca3-ad48-1e204e880628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d67f362564a477491c4b08aa218bde2)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:53.283609 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323a3a1-1e94-4ca3-ad48-1e204e880628 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:53.448622 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f323a3a1-1e94-4ca3-ad48-1e204e880628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d67f362564a477491c4b08aa218bde2', 'request_id': 'req-f323a3a1-1e94-4ca3-ad48-1e204e880628'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:53.455630 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f323a3a1-1e94-4ca3-ad48-1e204e880628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d67f362564a477491c4b08aa218bde2', 'request_id': 'req-f323a3a1-1e94-4ca3-ad48-1e204e880628'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:53.466326 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f323a3a1-1e94-4ca3-ad48-1e204e880628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d67f362564a477491c4b08aa218bde2', 'request_id': 'req-f323a3a1-1e94-4ca3-ad48-1e204e880628'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:53.567844 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f323a3a1-1e94-4ca3-ad48-1e204e880628 admin admin] The token cache is being invalidate because project 5d67f362564a477491c4b08aa218bde2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:56:53.568140 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f323a3a1-1e94-4ca3-ad48-1e204e880628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:53.568863 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f323a3a1-1e94-4ca3-ad48-1e204e880628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:53.571325 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1381/2742] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:56:53 2022] DELETE /identity/v3/projects/5d67f362564a477491c4b08aa218bde2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:53.574977 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee4a95-e8bf-4ae7-8217-48d7082c4ac7 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:53.585187 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee4a95-e8bf-4ae7-8217-48d7082c4ac7 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:53.642969 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf29e84-ff81-4604-8dda-d65b0bf5af7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:53.643839 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf29e84-ff81-4604-8dda-d65b0bf5af7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:53.644143 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf29e84-ff81-4604-8dda-d65b0bf5af7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:53.644478 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf29e84-ff81-4604-8dda-d65b0bf5af7c admin admin] PATH_INFO: `/v3/users/6328ec8d1f3c4547a442e5ba0c9721d1` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:53.645709 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf29e84-ff81-4604-8dda-d65b0bf5af7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6328ec8d1f3c4547a442e5ba0c9721d1)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:53.647686 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf29e84-ff81-4604-8dda-d65b0bf5af7c admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:53.903104 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-dbf29e84-ff81-4604-8dda-d65b0bf5af7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6328ec8d1f3c4547a442e5ba0c9721d1'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:53.921356 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-dbf29e84-ff81-4604-8dda-d65b0bf5af7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6328ec8d1f3c4547a442e5ba0c9721d1'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:53.922486 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-dbf29e84-ff81-4604-8dda-d65b0bf5af7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6328ec8d1f3c4547a442e5ba0c9721d1'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:53.998488 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-dbf29e84-ff81-4604-8dda-d65b0bf5af7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6328ec8d1f3c4547a442e5ba0c9721d1'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:53.999155 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-dbf29e84-ff81-4604-8dda-d65b0bf5af7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6328ec8d1f3c4547a442e5ba0c9721d1'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:54.012230 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1362/2743] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:56:53 2022] DELETE /identity/v3/users/6328ec8d1f3c4547a442e5ba0c9721d1 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:54.569615 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323a3a1-1e94-4ca3-ad48-1e204e880628 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:54.575346 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f323a3a1-1e94-4ca3-ad48-1e204e880628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:54.611724 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323a3a1-1e94-4ca3-ad48-1e204e880628 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:54.709824 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794c6e7-c8c3-44fc-b276-976aebe0a905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:54.710967 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794c6e7-c8c3-44fc-b276-976aebe0a905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:54.711436 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794c6e7-c8c3-44fc-b276-976aebe0a905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:54.711872 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794c6e7-c8c3-44fc-b276-976aebe0a905 admin admin] PATH_INFO: `/v3/projects/04709c9f7b8146e1bf55f26e03ebd839` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:54.713618 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794c6e7-c8c3-44fc-b276-976aebe0a905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04709c9f7b8146e1bf55f26e03ebd839)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:54.716209 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794c6e7-c8c3-44fc-b276-976aebe0a905 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:54.912120 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-0794c6e7-c8c3-44fc-b276-976aebe0a905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04709c9f7b8146e1bf55f26e03ebd839', 'request_id': 'req-0794c6e7-c8c3-44fc-b276-976aebe0a905'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:54.918074 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-0794c6e7-c8c3-44fc-b276-976aebe0a905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04709c9f7b8146e1bf55f26e03ebd839', 'request_id': 'req-0794c6e7-c8c3-44fc-b276-976aebe0a905'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:54.936556 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-0794c6e7-c8c3-44fc-b276-976aebe0a905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04709c9f7b8146e1bf55f26e03ebd839', 'request_id': 'req-0794c6e7-c8c3-44fc-b276-976aebe0a905'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:55.070525 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-0794c6e7-c8c3-44fc-b276-976aebe0a905 admin admin] The token cache is being invalidate because project 04709c9f7b8146e1bf55f26e03ebd839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:56:55.070869 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-0794c6e7-c8c3-44fc-b276-976aebe0a905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:55.079693 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-0794c6e7-c8c3-44fc-b276-976aebe0a905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:55.079693 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1382/2744] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:56:54 2022] DELETE /identity/v3/projects/04709c9f7b8146e1bf55f26e03ebd839 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:55.079895 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d1e1e-c86a-4dee-8ed7-34debb90359a None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:55.079895 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d1e1e-c86a-4dee-8ed7-34debb90359a None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:55.079895 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d1e1e-c86a-4dee-8ed7-34debb90359a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:55.098418 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-271d1e1e-c86a-4dee-8ed7-34debb90359a None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:55.099655 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-271d1e1e-c86a-4dee-8ed7-34debb90359a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:55.122655 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab4ed6-0d47-494e-9b1b-71b726af90f1 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:55.122948 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab4ed6-0d47-494e-9b1b-71b726af90f1 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:55.123287 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab4ed6-0d47-494e-9b1b-71b726af90f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:55.143200 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-87ab4ed6-0d47-494e-9b1b-71b726af90f1 None None] MFA Rules not processed for user `01d34f11504f4ac99ac7487bb4156d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:55.145133 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-87ab4ed6-0d47-494e-9b1b-71b726af90f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:55.173843 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1363/2745] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:56:55.182098 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1595c-7905-4093-8a98-6c16da6ec380 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:55.182597 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1595c-7905-4093-8a98-6c16da6ec380 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:55.182882 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1595c-7905-4093-8a98-6c16da6ec380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:55.206381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-38e1595c-7905-4093-8a98-6c16da6ec380 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:55.208224 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-38e1595c-7905-4093-8a98-6c16da6ec380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:55.220771 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1364/2746] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:56:55.225577 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1595c-7905-4093-8a98-6c16da6ec380 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:55.232453 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1383/2747] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:56:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:55.243334 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1595c-7905-4093-8a98-6c16da6ec380 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:55.248032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5177a8f-1c93-48c1-ac4a-fee986a75086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:55.248736 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5177a8f-1c93-48c1-ac4a-fee986a75086 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:55.249028 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5177a8f-1c93-48c1-ac4a-fee986a75086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:55.249302 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5177a8f-1c93-48c1-ac4a-fee986a75086 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:55.250043 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5177a8f-1c93-48c1-ac4a-fee986a75086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:56:55.250539 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5177a8f-1c93-48c1-ac4a-fee986a75086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:55.252259 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5177a8f-1c93-48c1-ac4a-fee986a75086 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:55.266411 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1365/2748] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:56:55.271590 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab4ed6-0d47-494e-9b1b-71b726af90f1 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:55.289478 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab4ed6-0d47-494e-9b1b-71b726af90f1 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:55.298535 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0291076-f17e-4d45-ad65-28475e33da4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:55.299127 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0291076-f17e-4d45-ad65-28475e33da4c admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:55.299411 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0291076-f17e-4d45-ad65-28475e33da4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:55.299800 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0291076-f17e-4d45-ad65-28475e33da4c admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:55.300803 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0291076-f17e-4d45-ad65-28475e33da4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:55.303200 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0291076-f17e-4d45-ad65-28475e33da4c admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:55.446618 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1384/2749] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:56:55 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:56:55.450475 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5177a8f-1c93-48c1-ac4a-fee986a75086 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:55.461498 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5177a8f-1c93-48c1-ac4a-fee986a75086 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:55.533819 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85a03d-b4b3-4d72-99c2-97d3820ef365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:55.534554 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85a03d-b4b3-4d72-99c2-97d3820ef365 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:55.535364 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85a03d-b4b3-4d72-99c2-97d3820ef365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:55.535805 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85a03d-b4b3-4d72-99c2-97d3820ef365 admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:55.536582 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85a03d-b4b3-4d72-99c2-97d3820ef365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:55.538630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85a03d-b4b3-4d72-99c2-97d3820ef365 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:55.591464 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0291076-f17e-4d45-ad65-28475e33da4c admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:55.593362 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-d0291076-f17e-4d45-ad65-28475e33da4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:55.650346 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1366/2750] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:56:55 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:56:55.656820 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85a03d-b4b3-4d72-99c2-97d3820ef365 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:55.658751 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0291076-f17e-4d45-ad65-28475e33da4c admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:55.662381 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de43d1-86ed-4daa-b0c8-4189018b432f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:55.662980 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de43d1-86ed-4daa-b0c8-4189018b432f service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:55.663935 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de43d1-86ed-4daa-b0c8-4189018b432f service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:55.663935 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de43d1-86ed-4daa-b0c8-4189018b432f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:55.665464 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a7de43d1-86ed-4daa-b0c8-4189018b432f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:55.667418 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85a03d-b4b3-4d72-99c2-97d3820ef365 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:55.672521 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef33b7-de65-41f5-9073-ca4f398f7a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:55.673223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef33b7-de65-41f5-9073-ca4f398f7a7e admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:55.673504 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef33b7-de65-41f5-9073-ca4f398f7a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:55.673807 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef33b7-de65-41f5-9073-ca4f398f7a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:55.674674 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef33b7-de65-41f5-9073-ca4f398f7a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:55.676852 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef33b7-de65-41f5-9073-ca4f398f7a7e admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:55.677348 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de43d1-86ed-4daa-b0c8-4189018b432f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:55.678835 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de43d1-86ed-4daa-b0c8-4189018b432f service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:55.687512 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1385/2751] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:56:55.692451 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1367/2752] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:56:55.693710 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de43d1-86ed-4daa-b0c8-4189018b432f service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:55.705579 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de43d1-86ed-4daa-b0c8-4189018b432f service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:55.711317 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a4873-2828-4763-a20d-ead3e9290b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:55.712082 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a4873-2828-4763-a20d-ead3e9290b69 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:55.712442 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a4873-2828-4763-a20d-ead3e9290b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:55.712839 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a4873-2828-4763-a20d-ead3e9290b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:55.713878 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a4873-2828-4763-a20d-ead3e9290b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:55.715643 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a4873-2828-4763-a20d-ead3e9290b69 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:55.726852 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1386/2753] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:56:55.731479 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef33b7-de65-41f5-9073-ca4f398f7a7e admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:55.743038 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef33b7-de65-41f5-9073-ca4f398f7a7e admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:55.747913 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e45d1-16e8-4a9d-acb6-1bfc73e313e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:55.748871 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e45d1-16e8-4a9d-acb6-1bfc73e313e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:55.749156 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e45d1-16e8-4a9d-acb6-1bfc73e313e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:55.749571 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e45d1-16e8-4a9d-acb6-1bfc73e313e0 admin admin] PATH_INFO: `/v3/projects/527b07f50da44bdbac62ca715294e713/users/95b302556f2645a89541949795feeba5/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:55.764243 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e45d1-16e8-4a9d-acb6-1bfc73e313e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=527b07f50da44bdbac62ca715294e713, user_id=95b302556f2645a89541949795feeba5, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:55.767025 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e45d1-16e8-4a9d-acb6-1bfc73e313e0 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:55.845075 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1368/2754] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:56:55 2022] PUT /identity/v3/projects/527b07f50da44bdbac62ca715294e713/users/95b302556f2645a89541949795feeba5/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:55.904094 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32473d-9a46-4b1a-a4a3-8e9768d8d904 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:55.904644 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32473d-9a46-4b1a-a4a3-8e9768d8d904 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:55.905034 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32473d-9a46-4b1a-a4a3-8e9768d8d904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:55.931890 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-cf32473d-9a46-4b1a-a4a3-8e9768d8d904 None None] MFA Rules not processed for user `95b302556f2645a89541949795feeba5`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:55.933258 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-cf32473d-9a46-4b1a-a4a3-8e9768d8d904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:56.002762 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1387/2755] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:56:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:56.013879 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e45d1-16e8-4a9d-acb6-1bfc73e313e0 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:56.015512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-299e45d1-16e8-4a9d-acb6-1bfc73e313e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:56.070668 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e45d1-16e8-4a9d-acb6-1bfc73e313e0 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:56.074188 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe154b72-f9a7-4778-8dfd-5bc594330a77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:56.074824 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe154b72-f9a7-4778-8dfd-5bc594330a77 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:56.075103 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe154b72-f9a7-4778-8dfd-5bc594330a77 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:56.075376 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe154b72-f9a7-4778-8dfd-5bc594330a77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:56.084865 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe154b72-f9a7-4778-8dfd-5bc594330a77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:56.087008 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe154b72-f9a7-4778-8dfd-5bc594330a77 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:56.099913 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1369/2756] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:56:56.131827 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32473d-9a46-4b1a-a4a3-8e9768d8d904 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:56.134373 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-cf32473d-9a46-4b1a-a4a3-8e9768d8d904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:56.138512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe154b72-f9a7-4778-8dfd-5bc594330a77 service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:56.139999 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-fe154b72-f9a7-4778-8dfd-5bc594330a77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:56.196720 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32473d-9a46-4b1a-a4a3-8e9768d8d904 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:56.200395 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12264cf7-250e-432b-a6de-21a888f17f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:56.201093 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12264cf7-250e-432b-a6de-21a888f17f43 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:56.201373 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12264cf7-250e-432b-a6de-21a888f17f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:56.201647 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12264cf7-250e-432b-a6de-21a888f17f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:56.203766 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-12264cf7-250e-432b-a6de-21a888f17f43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:56.217426 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe154b72-f9a7-4778-8dfd-5bc594330a77 service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:56.224920 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4faccf1-65db-40ff-a165-5470b62698f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b917ce4f7f34b289218f7d36a43983e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:56.225789 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faccf1-65db-40ff-a165-5470b62698f3 service placement] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:56.226073 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faccf1-65db-40ff-a165-5470b62698f3 service placement] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:56.226347 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faccf1-65db-40ff-a165-5470b62698f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:56.228271 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-a4faccf1-65db-40ff-a165-5470b62698f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:56.241398 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4faccf1-65db-40ff-a165-5470b62698f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:56.243026 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4faccf1-65db-40ff-a165-5470b62698f3 service placement] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:56.253160 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1370/2757] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:56:56.277297 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12264cf7-250e-432b-a6de-21a888f17f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:56.278742 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12264cf7-250e-432b-a6de-21a888f17f43 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:56.295157 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1388/2758] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:57:00.862591 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4faccf1-65db-40ff-a165-5470b62698f3 service placement] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:00.953228 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4faccf1-65db-40ff-a165-5470b62698f3 service placement] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:00.957748 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055c263-eae0-46ef-b81a-40d1ba57fa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:00.959299 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055c263-eae0-46ef-b81a-40d1ba57fa18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:00.959579 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055c263-eae0-46ef-b81a-40d1ba57fa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:00.959852 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055c263-eae0-46ef-b81a-40d1ba57fa18 admin admin] PATH_INFO: `/v3/users/95b302556f2645a89541949795feeba5` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:00.961068 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055c263-eae0-46ef-b81a-40d1ba57fa18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95b302556f2645a89541949795feeba5)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:00.963003 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055c263-eae0-46ef-b81a-40d1ba57fa18 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:01.198212 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f055c263-eae0-46ef-b81a-40d1ba57fa18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95b302556f2645a89541949795feeba5'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:01.218166 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f055c263-eae0-46ef-b81a-40d1ba57fa18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95b302556f2645a89541949795feeba5'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:01.219194 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f055c263-eae0-46ef-b81a-40d1ba57fa18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95b302556f2645a89541949795feeba5'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:01.307063 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f055c263-eae0-46ef-b81a-40d1ba57fa18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95b302556f2645a89541949795feeba5'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:01.307817 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f055c263-eae0-46ef-b81a-40d1ba57fa18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95b302556f2645a89541949795feeba5'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:01.323734 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1371/2759] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:57:00 2022] DELETE /identity/v3/users/95b302556f2645a89541949795feeba5 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:57:01.328266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cd65c-1913-49e0-aa02-890ec48efab6 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:01.328751 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cd65c-1913-49e0-aa02-890ec48efab6 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:01.328847 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cd65c-1913-49e0-aa02-890ec48efab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:01.347189 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-b75cd65c-1913-49e0-aa02-890ec48efab6 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:57:01.348427 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b75cd65c-1913-49e0-aa02-890ec48efab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:01.411806 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1389/2760] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:57:01.418264 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055c263-eae0-46ef-b81a-40d1ba57fa18 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:01.420761 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f055c263-eae0-46ef-b81a-40d1ba57fa18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:01.481273 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055c263-eae0-46ef-b81a-40d1ba57fa18 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:01.485028 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20f61f-e67f-43e1-bc7b-bc864ba7a496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:01.485675 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20f61f-e67f-43e1-bc7b-bc864ba7a496 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:01.485958 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20f61f-e67f-43e1-bc7b-bc864ba7a496 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:01.486237 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20f61f-e67f-43e1-bc7b-bc864ba7a496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:01.496843 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20f61f-e67f-43e1-bc7b-bc864ba7a496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:01.498426 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20f61f-e67f-43e1-bc7b-bc864ba7a496 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:01.509644 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1372/2761] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:57:02.101738 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cd65c-1913-49e0-aa02-890ec48efab6 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:02.103201 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b75cd65c-1913-49e0-aa02-890ec48efab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:02.116198 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cd65c-1913-49e0-aa02-890ec48efab6 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:02.122626 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b46e48-94dd-4a76-be9c-87fe37993203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:02.123815 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b46e48-94dd-4a76-be9c-87fe37993203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:02.124195 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b46e48-94dd-4a76-be9c-87fe37993203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:02.124532 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b46e48-94dd-4a76-be9c-87fe37993203 admin admin] PATH_INFO: `/v3/projects/527b07f50da44bdbac62ca715294e713` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:02.125813 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b46e48-94dd-4a76-be9c-87fe37993203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=527b07f50da44bdbac62ca715294e713)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:02.127768 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b46e48-94dd-4a76-be9c-87fe37993203 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:02.261043 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-29b46e48-94dd-4a76-be9c-87fe37993203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527b07f50da44bdbac62ca715294e713', 'request_id': 'req-29b46e48-94dd-4a76-be9c-87fe37993203'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:02.266371 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-29b46e48-94dd-4a76-be9c-87fe37993203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527b07f50da44bdbac62ca715294e713', 'request_id': 'req-29b46e48-94dd-4a76-be9c-87fe37993203'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:02.273083 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-29b46e48-94dd-4a76-be9c-87fe37993203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527b07f50da44bdbac62ca715294e713', 'request_id': 'req-29b46e48-94dd-4a76-be9c-87fe37993203'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:02.375210 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-29b46e48-94dd-4a76-be9c-87fe37993203 admin admin] The token cache is being invalidate because project 527b07f50da44bdbac62ca715294e713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:57:02.375853 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-29b46e48-94dd-4a76-be9c-87fe37993203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:02.376277 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-29b46e48-94dd-4a76-be9c-87fe37993203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:02.377896 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1390/2762] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:57:02 2022] DELETE /identity/v3/projects/527b07f50da44bdbac62ca715294e713 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:57:02.383221 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9afa2-3335-4915-a911-47ac2af57c78 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:02.383661 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9afa2-3335-4915-a911-47ac2af57c78 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:02.383772 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9afa2-3335-4915-a911-47ac2af57c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:02.401988 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-eae9afa2-3335-4915-a911-47ac2af57c78 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:57:02.403190 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-eae9afa2-3335-4915-a911-47ac2af57c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:02.459849 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1373/2763] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:57:02.467690 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c98e4-dd7c-49ba-b1b1-a77f24913a72 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:02.468070 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c98e4-dd7c-49ba-b1b1-a77f24913a72 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:02.468348 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c98e4-dd7c-49ba-b1b1-a77f24913a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:02.486323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-2f8c98e4-dd7c-49ba-b1b1-a77f24913a72 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:57:02.487550 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-2f8c98e4-dd7c-49ba-b1b1-a77f24913a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:02.496044 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1391/2764] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:57:02.500199 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9afa2-3335-4915-a911-47ac2af57c78 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:02.510539 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9afa2-3335-4915-a911-47ac2af57c78 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:02.515089 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc693777-28d4-4fd9-a475-819b78a6dfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:02.515667 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc693777-28d4-4fd9-a475-819b78a6dfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:02.515947 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc693777-28d4-4fd9-a475-819b78a6dfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:02.516220 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc693777-28d4-4fd9-a475-819b78a6dfa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:02.516967 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc693777-28d4-4fd9-a475-819b78a6dfa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:57:02.517271 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc693777-28d4-4fd9-a475-819b78a6dfa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:02.518857 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc693777-28d4-4fd9-a475-819b78a6dfa1 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:02.530463 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1374/2765] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:57:02.534534 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c98e4-dd7c-49ba-b1b1-a77f24913a72 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:02.544900 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c98e4-dd7c-49ba-b1b1-a77f24913a72 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:02.552970 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de6ef8-d540-4b57-8b8c-ba962c803799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:02.564419 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de6ef8-d540-4b57-8b8c-ba962c803799 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:02.564419 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de6ef8-d540-4b57-8b8c-ba962c803799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:02.564419 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de6ef8-d540-4b57-8b8c-ba962c803799 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:02.564419 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de6ef8-d540-4b57-8b8c-ba962c803799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:02.564419 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de6ef8-d540-4b57-8b8c-ba962c803799 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:02.714205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1392/2766] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:57:02 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:57:02.718395 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc693777-28d4-4fd9-a475-819b78a6dfa1 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:02.728355 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc693777-28d4-4fd9-a475-819b78a6dfa1 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:02.782463 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00461e-f19f-4bdd-9d48-ced1f259df4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:02.783044 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00461e-f19f-4bdd-9d48-ced1f259df4b admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:02.783335 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00461e-f19f-4bdd-9d48-ced1f259df4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:02.783613 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00461e-f19f-4bdd-9d48-ced1f259df4b admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:02.784294 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00461e-f19f-4bdd-9d48-ced1f259df4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:02.786468 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00461e-f19f-4bdd-9d48-ced1f259df4b admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:02.901301 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1375/2767] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:57:02 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:57:02.905819 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de6ef8-d540-4b57-8b8c-ba962c803799 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:02.917061 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de6ef8-d540-4b57-8b8c-ba962c803799 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:02.922941 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1340f56-7d5f-4cce-88e1-900c8d3bd85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:02.923751 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1340f56-7d5f-4cce-88e1-900c8d3bd85d admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:02.927301 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1340f56-7d5f-4cce-88e1-900c8d3bd85d admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:02.927301 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1340f56-7d5f-4cce-88e1-900c8d3bd85d admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:02.927301 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1340f56-7d5f-4cce-88e1-900c8d3bd85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:02.927743 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1340f56-7d5f-4cce-88e1-900c8d3bd85d admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:02.938671 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1393/2768] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:57:02.942744 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00461e-f19f-4bdd-9d48-ced1f259df4b admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:02.952449 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00461e-f19f-4bdd-9d48-ced1f259df4b admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:02.957015 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0728d-9c9b-482e-bb6e-cda0be343a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:02.957657 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0728d-9c9b-482e-bb6e-cda0be343a03 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:02.958066 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0728d-9c9b-482e-bb6e-cda0be343a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:02.958350 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0728d-9c9b-482e-bb6e-cda0be343a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:02.959068 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0728d-9c9b-482e-bb6e-cda0be343a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:02.960675 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0728d-9c9b-482e-bb6e-cda0be343a03 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:02.970451 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1376/2769] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:57:02.975114 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1340f56-7d5f-4cce-88e1-900c8d3bd85d admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:02.984809 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1340f56-7d5f-4cce-88e1-900c8d3bd85d admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:02.990214 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85704d1-4cc2-4ccd-89f8-138a120214c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:02.991077 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85704d1-4cc2-4ccd-89f8-138a120214c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:02.991360 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85704d1-4cc2-4ccd-89f8-138a120214c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:02.991637 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85704d1-4cc2-4ccd-89f8-138a120214c6 admin admin] PATH_INFO: `/v3/projects/afd7ccffce1542baabe90573edef2b05/users/98d2c5f0b27f43268e47299ce7bbdf3a/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:03.006116 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85704d1-4cc2-4ccd-89f8-138a120214c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd7ccffce1542baabe90573edef2b05, user_id=98d2c5f0b27f43268e47299ce7bbdf3a, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:03.008834 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85704d1-4cc2-4ccd-89f8-138a120214c6 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:03.096290 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1394/2770] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:57:02 2022] PUT /identity/v3/projects/afd7ccffce1542baabe90573edef2b05/users/98d2c5f0b27f43268e47299ce7bbdf3a/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:57:03.107325 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227028c-93c4-4dc3-aea6-f075c4ae186e None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:03.107616 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227028c-93c4-4dc3-aea6-f075c4ae186e None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:03.107890 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227028c-93c4-4dc3-aea6-f075c4ae186e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:03.135582 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-c227028c-93c4-4dc3-aea6-f075c4ae186e None None] MFA Rules not processed for user `98d2c5f0b27f43268e47299ce7bbdf3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:57:03.136856 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c227028c-93c4-4dc3-aea6-f075c4ae186e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:03.205307 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1377/2771] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:57:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:57:03.217056 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85704d1-4cc2-4ccd-89f8-138a120214c6 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:03.218785 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b85704d1-4cc2-4ccd-89f8-138a120214c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:03.276844 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85704d1-4cc2-4ccd-89f8-138a120214c6 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:03.280383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd1876-0a31-4fd9-b4b2-8d0ae5e6c072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:03.281048 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd1876-0a31-4fd9-b4b2-8d0ae5e6c072 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:03.281325 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd1876-0a31-4fd9-b4b2-8d0ae5e6c072 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:03.281626 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd1876-0a31-4fd9-b4b2-8d0ae5e6c072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:03.290323 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd1876-0a31-4fd9-b4b2-8d0ae5e6c072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:03.291741 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd1876-0a31-4fd9-b4b2-8d0ae5e6c072 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:03.300326 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1395/2772] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:57:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:57:06.539908 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227028c-93c4-4dc3-aea6-f075c4ae186e None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:06.599570 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227028c-93c4-4dc3-aea6-f075c4ae186e None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:06.603927 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fd880-2295-4bb9-9ac0-3c5665be4616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:06.604812 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fd880-2295-4bb9-9ac0-3c5665be4616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:06.605095 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fd880-2295-4bb9-9ac0-3c5665be4616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:06.605367 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fd880-2295-4bb9-9ac0-3c5665be4616 admin admin] PATH_INFO: `/v3/users/98d2c5f0b27f43268e47299ce7bbdf3a` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:06.606536 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fd880-2295-4bb9-9ac0-3c5665be4616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d2c5f0b27f43268e47299ce7bbdf3a)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:06.608460 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fd880-2295-4bb9-9ac0-3c5665be4616 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:06.829538 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-051fd880-2295-4bb9-9ac0-3c5665be4616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d2c5f0b27f43268e47299ce7bbdf3a'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:06.841778 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-051fd880-2295-4bb9-9ac0-3c5665be4616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d2c5f0b27f43268e47299ce7bbdf3a'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:06.842525 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-051fd880-2295-4bb9-9ac0-3c5665be4616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d2c5f0b27f43268e47299ce7bbdf3a'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:06.924441 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-051fd880-2295-4bb9-9ac0-3c5665be4616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d2c5f0b27f43268e47299ce7bbdf3a'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:06.925092 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-051fd880-2295-4bb9-9ac0-3c5665be4616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d2c5f0b27f43268e47299ce7bbdf3a'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:06.937826 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1378/2773] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:57:06 2022] DELETE /identity/v3/users/98d2c5f0b27f43268e47299ce7bbdf3a => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:57:06.942905 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d7ed5-18ef-4509-8d63-271093e2be7a None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:06.943439 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d7ed5-18ef-4509-8d63-271093e2be7a None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:06.943439 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d7ed5-18ef-4509-8d63-271093e2be7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:06.960967 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-759d7ed5-18ef-4509-8d63-271093e2be7a None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:57:06.962186 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-759d7ed5-18ef-4509-8d63-271093e2be7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:07.007657 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fd880-2295-4bb9-9ac0-3c5665be4616 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:07.009327 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-051fd880-2295-4bb9-9ac0-3c5665be4616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:07.023827 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1396/2774] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:57:07.033619 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d7ed5-18ef-4509-8d63-271093e2be7a None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:07.035114 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-759d7ed5-18ef-4509-8d63-271093e2be7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:07.085647 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fd880-2295-4bb9-9ac0-3c5665be4616 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:07.091064 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d7ed5-18ef-4509-8d63-271093e2be7a None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:07.091263 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fa7c2-9c80-49c5-a2b0-db32ed90af14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:07.091909 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fa7c2-9c80-49c5-a2b0-db32ed90af14 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:07.092189 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fa7c2-9c80-49c5-a2b0-db32ed90af14 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:07.092468 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fa7c2-9c80-49c5-a2b0-db32ed90af14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:07.094415 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-264fa7c2-9c80-49c5-a2b0-db32ed90af14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:07.098024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc40b2-178c-4a2e-808e-d3a791693fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:07.098024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc40b2-178c-4a2e-808e-d3a791693fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:07.098024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc40b2-178c-4a2e-808e-d3a791693fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:07.098024 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc40b2-178c-4a2e-808e-d3a791693fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:07.106019 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc40b2-178c-4a2e-808e-d3a791693fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:07.106959 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fa7c2-9c80-49c5-a2b0-db32ed90af14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:07.107504 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc40b2-178c-4a2e-808e-d3a791693fa0 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:07.108844 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fa7c2-9c80-49c5-a2b0-db32ed90af14 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:07.118043 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1397/2775] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:57:07.124853 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1379/2776] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:57:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:57:07.600091 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc40b2-178c-4a2e-808e-d3a791693fa0 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:07.601563 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-32cc40b2-178c-4a2e-808e-d3a791693fa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:07.617087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc40b2-178c-4a2e-808e-d3a791693fa0 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:07.624066 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af418d06-fa7f-4421-9ab8-72efbf9925e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:07.633067 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af418d06-fa7f-4421-9ab8-72efbf9925e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:07.633067 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af418d06-fa7f-4421-9ab8-72efbf9925e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:07.633067 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af418d06-fa7f-4421-9ab8-72efbf9925e4 admin admin] PATH_INFO: `/v3/projects/afd7ccffce1542baabe90573edef2b05` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:07.633067 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af418d06-fa7f-4421-9ab8-72efbf9925e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afd7ccffce1542baabe90573edef2b05)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:07.633067 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af418d06-fa7f-4421-9ab8-72efbf9925e4 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:07.769072 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-af418d06-fa7f-4421-9ab8-72efbf9925e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afd7ccffce1542baabe90573edef2b05', 'request_id': 'req-af418d06-fa7f-4421-9ab8-72efbf9925e4'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:07.774926 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-af418d06-fa7f-4421-9ab8-72efbf9925e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afd7ccffce1542baabe90573edef2b05', 'request_id': 'req-af418d06-fa7f-4421-9ab8-72efbf9925e4'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:07.780915 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-af418d06-fa7f-4421-9ab8-72efbf9925e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afd7ccffce1542baabe90573edef2b05', 'request_id': 'req-af418d06-fa7f-4421-9ab8-72efbf9925e4'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:07.872264 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-af418d06-fa7f-4421-9ab8-72efbf9925e4 admin admin] The token cache is being invalidate because project afd7ccffce1542baabe90573edef2b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:57:07.872579 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-af418d06-fa7f-4421-9ab8-72efbf9925e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:07.873201 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-af418d06-fa7f-4421-9ab8-72efbf9925e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:07.874802 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1398/2777] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:57:07 2022] DELETE /identity/v3/projects/afd7ccffce1542baabe90573edef2b05 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:57:07.880212 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a21b43-4b9f-40d6-8a89-3a36ec5b63a1 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:07.880749 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a21b43-4b9f-40d6-8a89-3a36ec5b63a1 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:07.880857 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a21b43-4b9f-40d6-8a89-3a36ec5b63a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:07.899103 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-19a21b43-4b9f-40d6-8a89-3a36ec5b63a1 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:57:07.900439 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-19a21b43-4b9f-40d6-8a89-3a36ec5b63a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:07.960690 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1380/2778] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:57:07.969502 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b54a6b-428e-4502-b733-1b918a3fbeb5 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:07.969991 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b54a6b-428e-4502-b733-1b918a3fbeb5 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:07.970093 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b54a6b-428e-4502-b733-1b918a3fbeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:07.989263 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-98b54a6b-428e-4502-b733-1b918a3fbeb5 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:57:07.990475 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-98b54a6b-428e-4502-b733-1b918a3fbeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:07.998274 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1399/2779] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:57:08.002475 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a21b43-4b9f-40d6-8a89-3a36ec5b63a1 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:08.012260 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a21b43-4b9f-40d6-8a89-3a36ec5b63a1 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:08.016857 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd4dd8-5d03-4351-8270-4bbed60d94c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:08.017500 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd4dd8-5d03-4351-8270-4bbed60d94c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:08.017785 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd4dd8-5d03-4351-8270-4bbed60d94c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:08.018056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd4dd8-5d03-4351-8270-4bbed60d94c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:08.018861 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd4dd8-5d03-4351-8270-4bbed60d94c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:57:08.019221 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd4dd8-5d03-4351-8270-4bbed60d94c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:08.021365 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd4dd8-5d03-4351-8270-4bbed60d94c7 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:08.032727 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1381/2780] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:57:08.037566 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b54a6b-428e-4502-b733-1b918a3fbeb5 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:08.046520 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b54a6b-428e-4502-b733-1b918a3fbeb5 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:08.051027 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac9f52-dcdf-4e9f-880a-0679c1c07f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:08.051686 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac9f52-dcdf-4e9f-880a-0679c1c07f89 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:08.051969 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac9f52-dcdf-4e9f-880a-0679c1c07f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:08.052248 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac9f52-dcdf-4e9f-880a-0679c1c07f89 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:08.053053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac9f52-dcdf-4e9f-880a-0679c1c07f89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:08.054952 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac9f52-dcdf-4e9f-880a-0679c1c07f89 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:08.165272 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1400/2781] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:57:08 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:57:08.169531 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd4dd8-5d03-4351-8270-4bbed60d94c7 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:08.179700 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd4dd8-5d03-4351-8270-4bbed60d94c7 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:08.234426 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab81004-cc3f-4d65-bed4-b48ce58dd34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:08.235081 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab81004-cc3f-4d65-bed4-b48ce58dd34a admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:08.235365 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab81004-cc3f-4d65-bed4-b48ce58dd34a admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:08.235641 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab81004-cc3f-4d65-bed4-b48ce58dd34a admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:08.236316 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab81004-cc3f-4d65-bed4-b48ce58dd34a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:08.238256 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab81004-cc3f-4d65-bed4-b48ce58dd34a admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:08.347069 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1382/2782] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:57:08 2022] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:57:08.351242 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac9f52-dcdf-4e9f-880a-0679c1c07f89 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:08.361619 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac9f52-dcdf-4e9f-880a-0679c1c07f89 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:08.366422 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae1c80-9c9d-484a-b3cc-818300d45d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:08.367076 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae1c80-9c9d-484a-b3cc-818300d45d48 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:08.367357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae1c80-9c9d-484a-b3cc-818300d45d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:08.367633 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae1c80-9c9d-484a-b3cc-818300d45d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:08.368355 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae1c80-9c9d-484a-b3cc-818300d45d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:08.369993 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae1c80-9c9d-484a-b3cc-818300d45d48 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:08.380982 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1401/2783] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:57:08.385033 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab81004-cc3f-4d65-bed4-b48ce58dd34a admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:08.396184 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab81004-cc3f-4d65-bed4-b48ce58dd34a admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:08.400770 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda8d9f-5a8c-4e33-8da2-a85b65f2f01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:08.401439 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda8d9f-5a8c-4e33-8da2-a85b65f2f01a admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:08.401698 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda8d9f-5a8c-4e33-8da2-a85b65f2f01a admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:08.401969 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda8d9f-5a8c-4e33-8da2-a85b65f2f01a admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:08.402824 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda8d9f-5a8c-4e33-8da2-a85b65f2f01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:08.404407 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda8d9f-5a8c-4e33-8da2-a85b65f2f01a admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:08.414381 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1383/2784] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:57:08.418468 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae1c80-9c9d-484a-b3cc-818300d45d48 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:08.428875 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae1c80-9c9d-484a-b3cc-818300d45d48 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:08.433486 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fcc98-6a39-44e3-a4e8-eac25477a690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:08.434353 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fcc98-6a39-44e3-a4e8-eac25477a690 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:08.434638 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fcc98-6a39-44e3-a4e8-eac25477a690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:08.434921 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fcc98-6a39-44e3-a4e8-eac25477a690 admin admin] PATH_INFO: `/v3/projects/2e52a8286b82411aabe81f87acc417ae/users/1e51987f18584b1eb5995418b84c6a91/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:08.450314 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fcc98-6a39-44e3-a4e8-eac25477a690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e52a8286b82411aabe81f87acc417ae, user_id=1e51987f18584b1eb5995418b84c6a91, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:08.453012 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fcc98-6a39-44e3-a4e8-eac25477a690 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:08.547608 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1402/2785] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:57:08 2022] PUT /identity/v3/projects/2e52a8286b82411aabe81f87acc417ae/users/1e51987f18584b1eb5995418b84c6a91/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:57:08.559244 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ec111-5e01-4275-a30f-6704eb4451e2 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:08.559532 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ec111-5e01-4275-a30f-6704eb4451e2 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:08.559813 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ec111-5e01-4275-a30f-6704eb4451e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:08.586637 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-7f6ec111-5e01-4275-a30f-6704eb4451e2 None None] MFA Rules not processed for user `1e51987f18584b1eb5995418b84c6a91`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:57:08.587866 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7f6ec111-5e01-4275-a30f-6704eb4451e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:08.650806 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1384/2786] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:57:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:57:08.661761 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fcc98-6a39-44e3-a4e8-eac25477a690 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:08.663451 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-892fcc98-6a39-44e3-a4e8-eac25477a690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:08.720901 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fcc98-6a39-44e3-a4e8-eac25477a690 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:08.724739 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875c84b-fc46-49a5-a80e-ceaad2c6e5f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:08.725383 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875c84b-fc46-49a5-a80e-ceaad2c6e5f6 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:08.725670 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875c84b-fc46-49a5-a80e-ceaad2c6e5f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:08.725948 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875c84b-fc46-49a5-a80e-ceaad2c6e5f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:08.734209 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875c84b-fc46-49a5-a80e-ceaad2c6e5f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:08.735645 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875c84b-fc46-49a5-a80e-ceaad2c6e5f6 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:08.746239 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1403/2787] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:57:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:57:54.473323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ec111-5e01-4275-a30f-6704eb4451e2 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:54.532565 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ec111-5e01-4275-a30f-6704eb4451e2 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:54.537644 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d352f-c6c4-402c-8640-8d2e4857450a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:54.538506 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d352f-c6c4-402c-8640-8d2e4857450a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:54.538792 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d352f-c6c4-402c-8640-8d2e4857450a admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:54.539070 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d352f-c6c4-402c-8640-8d2e4857450a admin admin] PATH_INFO: `/v3/users/1e51987f18584b1eb5995418b84c6a91` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:54.540250 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d352f-c6c4-402c-8640-8d2e4857450a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e51987f18584b1eb5995418b84c6a91)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:54.542220 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d352f-c6c4-402c-8640-8d2e4857450a admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:54.770618 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1f9d352f-c6c4-402c-8640-8d2e4857450a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e51987f18584b1eb5995418b84c6a91'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:54.783326 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1f9d352f-c6c4-402c-8640-8d2e4857450a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e51987f18584b1eb5995418b84c6a91'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:54.784131 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1f9d352f-c6c4-402c-8640-8d2e4857450a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e51987f18584b1eb5995418b84c6a91'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:54.865403 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1f9d352f-c6c4-402c-8640-8d2e4857450a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e51987f18584b1eb5995418b84c6a91'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:54.866039 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-1f9d352f-c6c4-402c-8640-8d2e4857450a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e51987f18584b1eb5995418b84c6a91'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:54.878969 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1385/2788] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:57:54 2022] DELETE /identity/v3/users/1e51987f18584b1eb5995418b84c6a91 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:57:54.883439 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c64b3-6573-4775-b200-50895385873d None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:54.884018 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c64b3-6573-4775-b200-50895385873d None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:54.884154 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c64b3-6573-4775-b200-50895385873d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:54.901641 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-c56c64b3-6573-4775-b200-50895385873d None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:57:54.902831 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-c56c64b3-6573-4775-b200-50895385873d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:54.960856 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1404/2789] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:57:54.970725 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d352f-c6c4-402c-8640-8d2e4857450a admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:54.972273 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1f9d352f-c6c4-402c-8640-8d2e4857450a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:55.027548 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d352f-c6c4-402c-8640-8d2e4857450a admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:55.031029 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149e324-5931-4182-b498-85616ad12242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:55.031664 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149e324-5931-4182-b498-85616ad12242 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:55.031946 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149e324-5931-4182-b498-85616ad12242 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:55.032221 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149e324-5931-4182-b498-85616ad12242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:55.041030 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149e324-5931-4182-b498-85616ad12242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:55.042454 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149e324-5931-4182-b498-85616ad12242 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:55.052130 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1386/2790] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:57:55.529447 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c64b3-6573-4775-b200-50895385873d None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:55.532475 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-c56c64b3-6573-4775-b200-50895385873d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:55.543016 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c64b3-6573-4775-b200-50895385873d None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:55.547861 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77ebcc-55ba-4659-8678-a7fc34220ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:55.548751 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77ebcc-55ba-4659-8678-a7fc34220ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:55.549153 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77ebcc-55ba-4659-8678-a7fc34220ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:55.549441 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77ebcc-55ba-4659-8678-a7fc34220ddd admin admin] PATH_INFO: `/v3/projects/2e52a8286b82411aabe81f87acc417ae` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:55.550572 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77ebcc-55ba-4659-8678-a7fc34220ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e52a8286b82411aabe81f87acc417ae)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:55.553187 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77ebcc-55ba-4659-8678-a7fc34220ddd admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:55.669909 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ad77ebcc-55ba-4659-8678-a7fc34220ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e52a8286b82411aabe81f87acc417ae', 'request_id': 'req-ad77ebcc-55ba-4659-8678-a7fc34220ddd'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:55.675545 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ad77ebcc-55ba-4659-8678-a7fc34220ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e52a8286b82411aabe81f87acc417ae', 'request_id': 'req-ad77ebcc-55ba-4659-8678-a7fc34220ddd'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:55.681463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ad77ebcc-55ba-4659-8678-a7fc34220ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e52a8286b82411aabe81f87acc417ae', 'request_id': 'req-ad77ebcc-55ba-4659-8678-a7fc34220ddd'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:55.790911 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ad77ebcc-55ba-4659-8678-a7fc34220ddd admin admin] The token cache is being invalidate because project 2e52a8286b82411aabe81f87acc417ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:57:55.791185 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ad77ebcc-55ba-4659-8678-a7fc34220ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:55.791801 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ad77ebcc-55ba-4659-8678-a7fc34220ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:55.793355 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1405/2791] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:57:55 2022] DELETE /identity/v3/projects/2e52a8286b82411aabe81f87acc417ae => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:57:55.798551 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142c56f-ef89-4f2b-a8ba-9fb7eb133b20 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:55.799030 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142c56f-ef89-4f2b-a8ba-9fb7eb133b20 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:55.799127 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142c56f-ef89-4f2b-a8ba-9fb7eb133b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:55.818616 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-9142c56f-ef89-4f2b-a8ba-9fb7eb133b20 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:57:55.819820 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-9142c56f-ef89-4f2b-a8ba-9fb7eb133b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:55.878407 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1387/2792] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:57:55.887510 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c1217-709c-4491-9486-3d0e6e8d4275 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:55.888083 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c1217-709c-4491-9486-3d0e6e8d4275 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:55.888083 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c1217-709c-4491-9486-3d0e6e8d4275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:55.906928 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-d01c1217-709c-4491-9486-3d0e6e8d4275 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:57:55.908130 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-d01c1217-709c-4491-9486-3d0e6e8d4275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:55.916127 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1406/2793] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:57:55.920312 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142c56f-ef89-4f2b-a8ba-9fb7eb133b20 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:55.931419 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142c56f-ef89-4f2b-a8ba-9fb7eb133b20 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:55.935971 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961e2c6-0c45-4c9a-8016-94df09082fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:55.936616 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961e2c6-0c45-4c9a-8016-94df09082fab admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:55.936930 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961e2c6-0c45-4c9a-8016-94df09082fab admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:55.937207 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961e2c6-0c45-4c9a-8016-94df09082fab admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:55.937927 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961e2c6-0c45-4c9a-8016-94df09082fab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:57:55.938235 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961e2c6-0c45-4c9a-8016-94df09082fab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:55.939831 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961e2c6-0c45-4c9a-8016-94df09082fab admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:55.951608 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1388/2794] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 13:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:57:55.955801 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c1217-709c-4491-9486-3d0e6e8d4275 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:55.965105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c1217-709c-4491-9486-3d0e6e8d4275 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:55.969666 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2909b-32db-4ba2-9208-524a224b5aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:55.970298 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2909b-32db-4ba2-9208-524a224b5aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:55.970576 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2909b-32db-4ba2-9208-524a224b5aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:55.970846 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2909b-32db-4ba2-9208-524a224b5aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:55.971561 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2909b-32db-4ba2-9208-524a224b5aa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:55.973484 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2909b-32db-4ba2-9208-524a224b5aa8 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:56.084893 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1407/2795] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 13:57:55 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:57:56.089440 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961e2c6-0c45-4c9a-8016-94df09082fab admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:56.100409 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961e2c6-0c45-4c9a-8016-94df09082fab admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:56.154634 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4645e5-7507-4e63-9e20-77b90971e034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:56.157389 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4645e5-7507-4e63-9e20-77b90971e034 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:56.157389 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4645e5-7507-4e63-9e20-77b90971e034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:56.157389 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4645e5-7507-4e63-9e20-77b90971e034 admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:56.157389 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4645e5-7507-4e63-9e20-77b90971e034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:56.158572 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4645e5-7507-4e63-9e20-77b90971e034 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:56.294221 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1389/2796] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 13:57:56 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:57:56.303860 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2909b-32db-4ba2-9208-524a224b5aa8 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:56.314117 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2909b-32db-4ba2-9208-524a224b5aa8 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:56.318964 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f1a4f-b2c5-483d-9322-4782b3b0ad9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:56.319655 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f1a4f-b2c5-483d-9322-4782b3b0ad9b admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:56.319934 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f1a4f-b2c5-483d-9322-4782b3b0ad9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:56.320206 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f1a4f-b2c5-483d-9322-4782b3b0ad9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:56.321141 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f1a4f-b2c5-483d-9322-4782b3b0ad9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:56.328000 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f1a4f-b2c5-483d-9322-4782b3b0ad9b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:56.333414 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1408/2797] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:57:56.337635 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4645e5-7507-4e63-9e20-77b90971e034 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:56.348217 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4645e5-7507-4e63-9e20-77b90971e034 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:56.352996 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2f327-97a4-424a-a843-f90436041090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:56.356758 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2f327-97a4-424a-a843-f90436041090 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:56.356758 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2f327-97a4-424a-a843-f90436041090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:56.356758 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2f327-97a4-424a-a843-f90436041090 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:56.356758 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2f327-97a4-424a-a843-f90436041090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:56.356758 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2f327-97a4-424a-a843-f90436041090 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:56.367446 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1390/2798] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 13:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:57:56.371577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f1a4f-b2c5-483d-9322-4782b3b0ad9b admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:56.381466 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f1a4f-b2c5-483d-9322-4782b3b0ad9b admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:56.386904 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd824c-5eef-423f-8950-1b0f59596496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:56.386904 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd824c-5eef-423f-8950-1b0f59596496 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:56.387110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd824c-5eef-423f-8950-1b0f59596496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:56.387340 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd824c-5eef-423f-8950-1b0f59596496 admin admin] PATH_INFO: `/v3/projects/14245c62e5c4448fb505c6d35f133740/users/5982bf393a6b4628acadf5dc2722d5b6/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:56.402158 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd824c-5eef-423f-8950-1b0f59596496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14245c62e5c4448fb505c6d35f133740, user_id=5982bf393a6b4628acadf5dc2722d5b6, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:56.404914 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd824c-5eef-423f-8950-1b0f59596496 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:56.505725 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1409/2799] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 13:57:56 2022] PUT /identity/v3/projects/14245c62e5c4448fb505c6d35f133740/users/5982bf393a6b4628acadf5dc2722d5b6/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:57:56.515939 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cffb1-9409-4cc5-90ef-b86ef8e0eded None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:56.516226 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cffb1-9409-4cc5-90ef-b86ef8e0eded None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:56.516510 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cffb1-9409-4cc5-90ef-b86ef8e0eded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:56.543364 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-975cffb1-9409-4cc5-90ef-b86ef8e0eded None None] MFA Rules not processed for user `5982bf393a6b4628acadf5dc2722d5b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:57:56.544565 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-975cffb1-9409-4cc5-90ef-b86ef8e0eded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:56.610178 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1391/2800] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:57:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:57:56.620900 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd824c-5eef-423f-8950-1b0f59596496 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:56.622573 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-46dd824c-5eef-423f-8950-1b0f59596496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:56.677196 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd824c-5eef-423f-8950-1b0f59596496 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:56.680796 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c01b3a-77f0-4b18-9d1f-9a82c2c646be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:56.681434 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c01b3a-77f0-4b18-9d1f-9a82c2c646be service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:56.681714 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c01b3a-77f0-4b18-9d1f-9a82c2c646be service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:56.681988 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c01b3a-77f0-4b18-9d1f-9a82c2c646be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:56.690010 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c01b3a-77f0-4b18-9d1f-9a82c2c646be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:56.692055 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c01b3a-77f0-4b18-9d1f-9a82c2c646be service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:56.700611 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1410/2801] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:57:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:08.198157 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cffb1-9409-4cc5-90ef-b86ef8e0eded None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:08.258558 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cffb1-9409-4cc5-90ef-b86ef8e0eded None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:08.262994 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f02d9b-082e-4e0c-b1da-5f0f5d04347c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:08.268932 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f02d9b-082e-4e0c-b1da-5f0f5d04347c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:08.268932 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f02d9b-082e-4e0c-b1da-5f0f5d04347c admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:08.268932 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f02d9b-082e-4e0c-b1da-5f0f5d04347c admin admin] PATH_INFO: `/v3/users/5982bf393a6b4628acadf5dc2722d5b6` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:08.268932 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f02d9b-082e-4e0c-b1da-5f0f5d04347c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5982bf393a6b4628acadf5dc2722d5b6)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:08.268932 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f02d9b-082e-4e0c-b1da-5f0f5d04347c admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:08.511802 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-90f02d9b-082e-4e0c-b1da-5f0f5d04347c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5982bf393a6b4628acadf5dc2722d5b6'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:08.523553 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-90f02d9b-082e-4e0c-b1da-5f0f5d04347c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5982bf393a6b4628acadf5dc2722d5b6'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:08.524201 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-90f02d9b-082e-4e0c-b1da-5f0f5d04347c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5982bf393a6b4628acadf5dc2722d5b6'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:08.613137 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-90f02d9b-082e-4e0c-b1da-5f0f5d04347c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5982bf393a6b4628acadf5dc2722d5b6'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:08.613746 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-90f02d9b-082e-4e0c-b1da-5f0f5d04347c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5982bf393a6b4628acadf5dc2722d5b6'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:08.625656 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1392/2802] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 13:58:08 2022] DELETE /identity/v3/users/5982bf393a6b4628acadf5dc2722d5b6 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:08.630278 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f31af-954d-4ebf-80da-9dc4531cddbb None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:08.630747 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f31af-954d-4ebf-80da-9dc4531cddbb None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:08.630841 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f31af-954d-4ebf-80da-9dc4531cddbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:08.648037 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-941f31af-954d-4ebf-80da-9dc4531cddbb None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:08.649257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-941f31af-954d-4ebf-80da-9dc4531cddbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:08.706736 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1411/2803] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:08.716713 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f02d9b-082e-4e0c-b1da-5f0f5d04347c admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:08.718090 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-90f02d9b-082e-4e0c-b1da-5f0f5d04347c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:08.774817 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f02d9b-082e-4e0c-b1da-5f0f5d04347c admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:08.778322 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b24ad-3545-40aa-8dcd-9ab71f2790db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:08.778964 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b24ad-3545-40aa-8dcd-9ab71f2790db service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:08.779244 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b24ad-3545-40aa-8dcd-9ab71f2790db service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:08.779517 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b24ad-3545-40aa-8dcd-9ab71f2790db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:08.789398 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b24ad-3545-40aa-8dcd-9ab71f2790db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:08.790859 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b24ad-3545-40aa-8dcd-9ab71f2790db service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:08.800832 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1393/2804] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:09.232107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f31af-954d-4ebf-80da-9dc4531cddbb None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:09.233595 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-941f31af-954d-4ebf-80da-9dc4531cddbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:09.246429 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f31af-954d-4ebf-80da-9dc4531cddbb None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:09.251065 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996683a-943e-450d-8879-57464f5bf363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:09.251929 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996683a-943e-450d-8879-57464f5bf363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:09.252211 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996683a-943e-450d-8879-57464f5bf363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:09.252492 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996683a-943e-450d-8879-57464f5bf363 admin admin] PATH_INFO: `/v3/projects/14245c62e5c4448fb505c6d35f133740` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:09.254341 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996683a-943e-450d-8879-57464f5bf363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14245c62e5c4448fb505c6d35f133740)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:09.256272 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996683a-943e-450d-8879-57464f5bf363 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:09.368295 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f996683a-943e-450d-8879-57464f5bf363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14245c62e5c4448fb505c6d35f133740', 'request_id': 'req-f996683a-943e-450d-8879-57464f5bf363'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:09.373820 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f996683a-943e-450d-8879-57464f5bf363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14245c62e5c4448fb505c6d35f133740', 'request_id': 'req-f996683a-943e-450d-8879-57464f5bf363'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:09.380827 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f996683a-943e-450d-8879-57464f5bf363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14245c62e5c4448fb505c6d35f133740', 'request_id': 'req-f996683a-943e-450d-8879-57464f5bf363'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:09.481261 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f996683a-943e-450d-8879-57464f5bf363 admin admin] The token cache is being invalidate because project 14245c62e5c4448fb505c6d35f133740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:58:09.481543 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f996683a-943e-450d-8879-57464f5bf363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:09.482211 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-f996683a-943e-450d-8879-57464f5bf363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:09.483749 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1412/2805] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 13:58:09 2022] DELETE /identity/v3/projects/14245c62e5c4448fb505c6d35f133740 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:22.364928 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b24ad-3545-40aa-8dcd-9ab71f2790db service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:22.366368 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-4f4b24ad-3545-40aa-8dcd-9ab71f2790db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:22.437285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b24ad-3545-40aa-8dcd-9ab71f2790db service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:22.495768 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f786bd-9c9d-4cc3-9fe1-841e8d5ec1e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b917ce4f7f34b289218f7d36a43983e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:22.496403 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f786bd-9c9d-4cc3-9fe1-841e8d5ec1e0 service placement] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:22.496703 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f786bd-9c9d-4cc3-9fe1-841e8d5ec1e0 service placement] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:22.496978 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f786bd-9c9d-4cc3-9fe1-841e8d5ec1e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:22.498737 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b3f786bd-9c9d-4cc3-9fe1-841e8d5ec1e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:22.509730 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f786bd-9c9d-4cc3-9fe1-841e8d5ec1e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:22.511323 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f786bd-9c9d-4cc3-9fe1-841e8d5ec1e0 service placement] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:22.521214 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1394/2806] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:38.991506 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996683a-943e-450d-8879-57464f5bf363 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:38.993131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-f996683a-943e-450d-8879-57464f5bf363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:39.080043 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996683a-943e-450d-8879-57464f5bf363 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:39.085736 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ee495-1f54-4268-bdfd-1ab52ddce9fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:39.086624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ee495-1f54-4268-bdfd-1ab52ddce9fd service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:39.086968 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ee495-1f54-4268-bdfd-1ab52ddce9fd service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:39.087356 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ee495-1f54-4268-bdfd-1ab52ddce9fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:39.090207 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-612ee495-1f54-4268-bdfd-1ab52ddce9fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:39.108109 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ee495-1f54-4268-bdfd-1ab52ddce9fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:39.110642 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ee495-1f54-4268-bdfd-1ab52ddce9fd service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:39.123036 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1413/2807] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:39.711377 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f786bd-9c9d-4cc3-9fe1-841e8d5ec1e0 service placement] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:39.712967 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b3f786bd-9c9d-4cc3-9fe1-841e8d5ec1e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:39.790176 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f786bd-9c9d-4cc3-9fe1-841e8d5ec1e0 service placement] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:39.794455 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f4f21-0a50-4f33-ace8-944fc3ed8e2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:39.795110 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f4f21-0a50-4f33-ace8-944fc3ed8e2e service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:39.795396 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f4f21-0a50-4f33-ace8-944fc3ed8e2e service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:39.795676 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f4f21-0a50-4f33-ace8-944fc3ed8e2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:39.798036 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f17f4f21-0a50-4f33-ace8-944fc3ed8e2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:39.813453 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f4f21-0a50-4f33-ace8-944fc3ed8e2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:39.815201 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f4f21-0a50-4f33-ace8-944fc3ed8e2e service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:39.826734 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1395/2808] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:44.718337 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42265c49-579e-4b32-b7e6-3c4d4ac3e532 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:44.722434 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42265c49-579e-4b32-b7e6-3c4d4ac3e532 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:44.722434 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42265c49-579e-4b32-b7e6-3c4d4ac3e532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:44.738517 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-42265c49-579e-4b32-b7e6-3c4d4ac3e532 None None] MFA Rules not processed for user `01d34f11504f4ac99ac7487bb4156d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:44.739834 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-42265c49-579e-4b32-b7e6-3c4d4ac3e532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:44.793310 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1414/2809] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 13:59:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:00:21.113625 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f4f21-0a50-4f33-ace8-944fc3ed8e2e service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:21.115061 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f17f4f21-0a50-4f33-ace8-944fc3ed8e2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:21.125554 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f4f21-0a50-4f33-ace8-944fc3ed8e2e service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:21.129120 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f36c4-1250-4f66-a60a-e2bfbc70f793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:21.129753 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f36c4-1250-4f66-a60a-e2bfbc70f793 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:21.130034 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f36c4-1250-4f66-a60a-e2bfbc70f793 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:21.130314 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f36c4-1250-4f66-a60a-e2bfbc70f793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:21.132635 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-935f36c4-1250-4f66-a60a-e2bfbc70f793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:21.142870 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f36c4-1250-4f66-a60a-e2bfbc70f793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:21.144310 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f36c4-1250-4f66-a60a-e2bfbc70f793 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:21.153695 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1396/2810] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:00:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:01:10.540215 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42265c49-579e-4b32-b7e6-3c4d4ac3e532 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:10.548497 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-42265c49-579e-4b32-b7e6-3c4d4ac3e532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:10.606790 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42265c49-579e-4b32-b7e6-3c4d4ac3e532 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:10.612132 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08957d8a-7550-4158-8cd8-b51a0fef9d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:10.613022 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08957d8a-7550-4158-8cd8-b51a0fef9d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:10.613304 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08957d8a-7550-4158-8cd8-b51a0fef9d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:10.613577 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08957d8a-7550-4158-8cd8-b51a0fef9d9b admin admin] PATH_INFO: `/v3/users/01d34f11504f4ac99ac7487bb4156d2c` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:10.614748 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08957d8a-7550-4158-8cd8-b51a0fef9d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=01d34f11504f4ac99ac7487bb4156d2c)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:10.616666 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08957d8a-7550-4158-8cd8-b51a0fef9d9b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:10.862203 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-08957d8a-7550-4158-8cd8-b51a0fef9d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01d34f11504f4ac99ac7487bb4156d2c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:10.873809 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-08957d8a-7550-4158-8cd8-b51a0fef9d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01d34f11504f4ac99ac7487bb4156d2c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:10.874559 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-08957d8a-7550-4158-8cd8-b51a0fef9d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01d34f11504f4ac99ac7487bb4156d2c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:10.875183 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-08957d8a-7550-4158-8cd8-b51a0fef9d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01d34f11504f4ac99ac7487bb4156d2c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:10.884428 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-08957d8a-7550-4158-8cd8-b51a0fef9d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01d34f11504f4ac99ac7487bb4156d2c'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:10.979711 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1415/2811] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 14:01:10 2022] DELETE /identity/v3/users/01d34f11504f4ac99ac7487bb4156d2c => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:11.243933 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f36c4-1250-4f66-a60a-e2bfbc70f793 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:11.255754 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f36c4-1250-4f66-a60a-e2bfbc70f793 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:11.313899 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e1d29-757e-447d-aee1-bf27ccba0145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:11.314745 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e1d29-757e-447d-aee1-bf27ccba0145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:11.315023 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e1d29-757e-447d-aee1-bf27ccba0145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:11.315295 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e1d29-757e-447d-aee1-bf27ccba0145 admin admin] PATH_INFO: `/v3/projects/cbb4eab171284cc0adc3af531cb48c7d` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:11.316483 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e1d29-757e-447d-aee1-bf27ccba0145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbb4eab171284cc0adc3af531cb48c7d)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:11.318517 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e1d29-757e-447d-aee1-bf27ccba0145 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:11.448960 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-039e1d29-757e-447d-aee1-bf27ccba0145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbb4eab171284cc0adc3af531cb48c7d', 'request_id': 'req-039e1d29-757e-447d-aee1-bf27ccba0145'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:11.665519 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-039e1d29-757e-447d-aee1-bf27ccba0145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbb4eab171284cc0adc3af531cb48c7d', 'request_id': 'req-039e1d29-757e-447d-aee1-bf27ccba0145'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:11.672367 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-039e1d29-757e-447d-aee1-bf27ccba0145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbb4eab171284cc0adc3af531cb48c7d', 'request_id': 'req-039e1d29-757e-447d-aee1-bf27ccba0145'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:11.683426 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-039e1d29-757e-447d-aee1-bf27ccba0145 admin admin] The token cache is being invalidate because project cbb4eab171284cc0adc3af531cb48c7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:01:11.683711 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-039e1d29-757e-447d-aee1-bf27ccba0145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:11.684346 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-039e1d29-757e-447d-aee1-bf27ccba0145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:11.685891 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1397/2812] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 14:01:11 2022] DELETE /identity/v3/projects/cbb4eab171284cc0adc3af531cb48c7d => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:11.696459 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139246b7-9f33-432b-b642-4801602feee1 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:11.696982 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139246b7-9f33-432b-b642-4801602feee1 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:11.697079 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139246b7-9f33-432b-b642-4801602feee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:11.718490 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-139246b7-9f33-432b-b642-4801602feee1 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:11.719607 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-139246b7-9f33-432b-b642-4801602feee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:11.776505 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1416/2813] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:11.784534 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0206fcb-4d5d-4e14-8de1-c25d7a6d188d None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:11.784850 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0206fcb-4d5d-4e14-8de1-c25d7a6d188d None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:11.785129 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0206fcb-4d5d-4e14-8de1-c25d7a6d188d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:11.803732 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-f0206fcb-4d5d-4e14-8de1-c25d7a6d188d None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:11.804951 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-f0206fcb-4d5d-4e14-8de1-c25d7a6d188d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:11.813230 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1398/2814] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:11.821692 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139246b7-9f33-432b-b642-4801602feee1 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:11.831372 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139246b7-9f33-432b-b642-4801602feee1 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:11.835822 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41696393-5e5e-4cc5-ac65-6c2e228dd579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:11.836495 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41696393-5e5e-4cc5-ac65-6c2e228dd579 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:11.836801 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41696393-5e5e-4cc5-ac65-6c2e228dd579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:11.837074 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41696393-5e5e-4cc5-ac65-6c2e228dd579 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:11.837785 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41696393-5e5e-4cc5-ac65-6c2e228dd579 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:01:11.838086 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41696393-5e5e-4cc5-ac65-6c2e228dd579 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:11.839661 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41696393-5e5e-4cc5-ac65-6c2e228dd579 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:11.850830 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1417/2815] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 14:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:01:11.854917 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0206fcb-4d5d-4e14-8de1-c25d7a6d188d None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:11.864523 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0206fcb-4d5d-4e14-8de1-c25d7a6d188d None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:11.869165 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729a6c4-9dc9-43d8-b549-a4b9ff020610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:11.869804 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729a6c4-9dc9-43d8-b549-a4b9ff020610 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:11.870085 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729a6c4-9dc9-43d8-b549-a4b9ff020610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:11.870361 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729a6c4-9dc9-43d8-b549-a4b9ff020610 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:11.871046 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729a6c4-9dc9-43d8-b549-a4b9ff020610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:11.872988 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729a6c4-9dc9-43d8-b549-a4b9ff020610 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:12.050152 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1399/2816] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 14:01:11 2022] POST /identity/v3/projects => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:01:12.054208 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41696393-5e5e-4cc5-ac65-6c2e228dd579 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:12.064754 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41696393-5e5e-4cc5-ac65-6c2e228dd579 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:12.119977 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e307bd-aee5-4663-8946-0301046f598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:12.120634 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e307bd-aee5-4663-8946-0301046f598e admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:12.120949 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e307bd-aee5-4663-8946-0301046f598e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:12.121228 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e307bd-aee5-4663-8946-0301046f598e admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:12.121913 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e307bd-aee5-4663-8946-0301046f598e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:12.123827 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e307bd-aee5-4663-8946-0301046f598e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:12.213936 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1418/2817] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 14:01:12 2022] POST /identity/v3/users => generated 284 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:01:12.218657 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729a6c4-9dc9-43d8-b549-a4b9ff020610 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:12.228852 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729a6c4-9dc9-43d8-b549-a4b9ff020610 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:12.233395 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a194c-457a-4559-a459-4d00a0e5c516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:12.234691 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a194c-457a-4559-a459-4d00a0e5c516 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:12.234975 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a194c-457a-4559-a459-4d00a0e5c516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:12.235253 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a194c-457a-4559-a459-4d00a0e5c516 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:12.235971 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a194c-457a-4559-a459-4d00a0e5c516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:12.237624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a194c-457a-4559-a459-4d00a0e5c516 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:12.247978 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1400/2818] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 14:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:01:12.251774 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e307bd-aee5-4663-8946-0301046f598e admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:12.261463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e307bd-aee5-4663-8946-0301046f598e admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:12.265856 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9d2ea-c8d4-46ca-a056-a88fe0ac7ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:12.266497 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9d2ea-c8d4-46ca-a056-a88fe0ac7ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:12.266775 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9d2ea-c8d4-46ca-a056-a88fe0ac7ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:12.267046 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9d2ea-c8d4-46ca-a056-a88fe0ac7ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:12.267758 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9d2ea-c8d4-46ca-a056-a88fe0ac7ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:12.269376 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9d2ea-c8d4-46ca-a056-a88fe0ac7ea0 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:12.279291 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1419/2819] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 14:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:01:12.283781 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a194c-457a-4559-a459-4d00a0e5c516 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:12.293529 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a194c-457a-4559-a459-4d00a0e5c516 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:12.299285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c897b0-f6e6-4c78-b2b9-d5e3e6e61a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:12.300151 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c897b0-f6e6-4c78-b2b9-d5e3e6e61a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:12.300496 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c897b0-f6e6-4c78-b2b9-d5e3e6e61a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:12.300741 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c897b0-f6e6-4c78-b2b9-d5e3e6e61a23 admin admin] PATH_INFO: `/v3/projects/40152fd630c04804a6aec1869110f56a/users/e1396f9d401144999c86825abc3bfb76/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:12.314919 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c897b0-f6e6-4c78-b2b9-d5e3e6e61a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40152fd630c04804a6aec1869110f56a, user_id=e1396f9d401144999c86825abc3bfb76, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:12.317685 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c897b0-f6e6-4c78-b2b9-d5e3e6e61a23 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:12.391658 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1401/2820] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 14:01:12 2022] PUT /identity/v3/projects/40152fd630c04804a6aec1869110f56a/users/e1396f9d401144999c86825abc3bfb76/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:12.403782 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535bc7b-50a1-4d20-8d45-bded906a3261 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:12.409573 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535bc7b-50a1-4d20-8d45-bded906a3261 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:12.409573 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535bc7b-50a1-4d20-8d45-bded906a3261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:12.431504 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-1535bc7b-50a1-4d20-8d45-bded906a3261 None None] MFA Rules not processed for user `e1396f9d401144999c86825abc3bfb76`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:12.432819 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-1535bc7b-50a1-4d20-8d45-bded906a3261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:12.497749 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1420/2821] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:12.512193 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c897b0-f6e6-4c78-b2b9-d5e3e6e61a23 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:12.513879 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-50c897b0-f6e6-4c78-b2b9-d5e3e6e61a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:12.574705 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c897b0-f6e6-4c78-b2b9-d5e3e6e61a23 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:12.579369 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ea7c1-d117-43a3-94a1-9642796a8d8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:12.580010 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ea7c1-d117-43a3-94a1-9642796a8d8a service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:12.580549 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ea7c1-d117-43a3-94a1-9642796a8d8a service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:12.580856 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ea7c1-d117-43a3-94a1-9642796a8d8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:12.589001 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ea7c1-d117-43a3-94a1-9642796a8d8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:12.590445 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ea7c1-d117-43a3-94a1-9642796a8d8a service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:12.600563 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1402/2822] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:01:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:01:22.763809 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535bc7b-50a1-4d20-8d45-bded906a3261 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:22.830006 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535bc7b-50a1-4d20-8d45-bded906a3261 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:22.834417 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a7190-ec25-475f-8aa2-f84c8474b2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:22.835288 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a7190-ec25-475f-8aa2-f84c8474b2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:22.835567 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a7190-ec25-475f-8aa2-f84c8474b2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:22.835839 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a7190-ec25-475f-8aa2-f84c8474b2b5 admin admin] PATH_INFO: `/v3/users/e1396f9d401144999c86825abc3bfb76` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:22.837110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a7190-ec25-475f-8aa2-f84c8474b2b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1396f9d401144999c86825abc3bfb76)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:22.839028 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a7190-ec25-475f-8aa2-f84c8474b2b5 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:23.066724 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-410a7190-ec25-475f-8aa2-f84c8474b2b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1396f9d401144999c86825abc3bfb76'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:23.078621 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-410a7190-ec25-475f-8aa2-f84c8474b2b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1396f9d401144999c86825abc3bfb76'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:23.079287 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-410a7190-ec25-475f-8aa2-f84c8474b2b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1396f9d401144999c86825abc3bfb76'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:23.080135 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-410a7190-ec25-475f-8aa2-f84c8474b2b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1396f9d401144999c86825abc3bfb76'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:23.086856 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-410a7190-ec25-475f-8aa2-f84c8474b2b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1396f9d401144999c86825abc3bfb76'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:23.162406 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1421/2823] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 14:01:22 2022] DELETE /identity/v3/users/e1396f9d401144999c86825abc3bfb76 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:23.166859 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce365f-1fe3-4b3d-9d21-ae2f1b76bf2d None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:23.167334 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce365f-1fe3-4b3d-9d21-ae2f1b76bf2d None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:23.167513 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce365f-1fe3-4b3d-9d21-ae2f1b76bf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:23.183958 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-92ce365f-1fe3-4b3d-9d21-ae2f1b76bf2d None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:23.185188 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-92ce365f-1fe3-4b3d-9d21-ae2f1b76bf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:23.241934 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1403/2824] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:23.251558 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a7190-ec25-475f-8aa2-f84c8474b2b5 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:23.253076 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-410a7190-ec25-475f-8aa2-f84c8474b2b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:23.313087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a7190-ec25-475f-8aa2-f84c8474b2b5 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:23.316745 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a2c89-cb71-478c-8c44-5aabdd9e2f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:23.317391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a2c89-cb71-478c-8c44-5aabdd9e2f18 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:23.317668 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a2c89-cb71-478c-8c44-5aabdd9e2f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:23.317942 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a2c89-cb71-478c-8c44-5aabdd9e2f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:23.330240 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a2c89-cb71-478c-8c44-5aabdd9e2f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:23.331682 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a2c89-cb71-478c-8c44-5aabdd9e2f18 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:23.341013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1422/2825] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:01:23.764074 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce365f-1fe3-4b3d-9d21-ae2f1b76bf2d None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:23.765682 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-92ce365f-1fe3-4b3d-9d21-ae2f1b76bf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:23.777884 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce365f-1fe3-4b3d-9d21-ae2f1b76bf2d None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:23.782847 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28942c8-18e2-4a66-81f1-54313a7d0a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:23.783773 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28942c8-18e2-4a66-81f1-54313a7d0a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:23.784050 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28942c8-18e2-4a66-81f1-54313a7d0a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:23.784342 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28942c8-18e2-4a66-81f1-54313a7d0a88 admin admin] PATH_INFO: `/v3/projects/40152fd630c04804a6aec1869110f56a` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:23.785625 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28942c8-18e2-4a66-81f1-54313a7d0a88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40152fd630c04804a6aec1869110f56a)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:23.787603 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28942c8-18e2-4a66-81f1-54313a7d0a88 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:23.921518 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f28942c8-18e2-4a66-81f1-54313a7d0a88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40152fd630c04804a6aec1869110f56a', 'request_id': 'req-f28942c8-18e2-4a66-81f1-54313a7d0a88'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:24.002191 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f28942c8-18e2-4a66-81f1-54313a7d0a88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40152fd630c04804a6aec1869110f56a', 'request_id': 'req-f28942c8-18e2-4a66-81f1-54313a7d0a88'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:24.007928 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f28942c8-18e2-4a66-81f1-54313a7d0a88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40152fd630c04804a6aec1869110f56a', 'request_id': 'req-f28942c8-18e2-4a66-81f1-54313a7d0a88'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:24.018958 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f28942c8-18e2-4a66-81f1-54313a7d0a88 admin admin] The token cache is being invalidate because project 40152fd630c04804a6aec1869110f56a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:01:24.019244 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f28942c8-18e2-4a66-81f1-54313a7d0a88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:24.019865 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-f28942c8-18e2-4a66-81f1-54313a7d0a88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:24.022733 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1404/2826] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 14:01:23 2022] DELETE /identity/v3/projects/40152fd630c04804a6aec1869110f56a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:24.026335 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9242df-530b-4970-af38-d1666987b2f8 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:24.026814 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9242df-530b-4970-af38-d1666987b2f8 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:24.026912 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9242df-530b-4970-af38-d1666987b2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:24.045560 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-0a9242df-530b-4970-af38-d1666987b2f8 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:24.047948 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-0a9242df-530b-4970-af38-d1666987b2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:24.111819 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1423/2827] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:24.119888 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc09c8-d6da-4e8b-87d1-3c28bad68a95 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:24.120198 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc09c8-d6da-4e8b-87d1-3c28bad68a95 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:24.120472 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc09c8-d6da-4e8b-87d1-3c28bad68a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:24.138532 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-91fc09c8-d6da-4e8b-87d1-3c28bad68a95 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:24.139739 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-91fc09c8-d6da-4e8b-87d1-3c28bad68a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:24.147751 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1405/2828] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:24.151760 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9242df-530b-4970-af38-d1666987b2f8 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:24.161803 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9242df-530b-4970-af38-d1666987b2f8 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:24.166387 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c19fc3-0223-46ba-9bac-07c363271037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:24.167022 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c19fc3-0223-46ba-9bac-07c363271037 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:24.167301 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c19fc3-0223-46ba-9bac-07c363271037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:24.167568 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c19fc3-0223-46ba-9bac-07c363271037 admin admin] PATH_INFO: `/v3/domains` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:24.168279 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c19fc3-0223-46ba-9bac-07c363271037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:01:24.168585 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c19fc3-0223-46ba-9bac-07c363271037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:24.170227 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c19fc3-0223-46ba-9bac-07c363271037 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:24.183124 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1424/2829] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 14:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:01:24.187618 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc09c8-d6da-4e8b-87d1-3c28bad68a95 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:24.196762 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc09c8-d6da-4e8b-87d1-3c28bad68a95 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:24.201379 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59402939-6a97-4377-878b-4f36ee0ff0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:24.202011 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59402939-6a97-4377-878b-4f36ee0ff0f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:24.202346 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59402939-6a97-4377-878b-4f36ee0ff0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:24.202734 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59402939-6a97-4377-878b-4f36ee0ff0f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:24.203418 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59402939-6a97-4377-878b-4f36ee0ff0f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:24.205626 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59402939-6a97-4377-878b-4f36ee0ff0f4 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:24.306138 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1406/2830] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 14:01:24 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:01:24.310208 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c19fc3-0223-46ba-9bac-07c363271037 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:24.320357 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c19fc3-0223-46ba-9bac-07c363271037 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:24.376217 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca616a04-ccbd-45d0-8b06-47cfb863f986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:24.376920 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca616a04-ccbd-45d0-8b06-47cfb863f986 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:24.377206 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca616a04-ccbd-45d0-8b06-47cfb863f986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:24.377483 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca616a04-ccbd-45d0-8b06-47cfb863f986 admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:24.378186 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca616a04-ccbd-45d0-8b06-47cfb863f986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:24.380123 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca616a04-ccbd-45d0-8b06-47cfb863f986 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:24.476555 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1425/2831] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 14:01:24 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:01:24.480518 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59402939-6a97-4377-878b-4f36ee0ff0f4 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:24.490771 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59402939-6a97-4377-878b-4f36ee0ff0f4 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:24.510551 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aa05d-f58d-474a-bc2b-304224d9800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:24.510551 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aa05d-f58d-474a-bc2b-304224d9800e admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:24.510551 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aa05d-f58d-474a-bc2b-304224d9800e admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:24.510551 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aa05d-f58d-474a-bc2b-304224d9800e admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:24.511034 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3aa05d-f58d-474a-bc2b-304224d9800e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:24.511034 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3aa05d-f58d-474a-bc2b-304224d9800e admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:24.511034 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1407/2832] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 14:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:01:24.513195 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca616a04-ccbd-45d0-8b06-47cfb863f986 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:24.523778 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca616a04-ccbd-45d0-8b06-47cfb863f986 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:24.528362 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3a976-eb68-46ae-a3d9-5bc1f1e2459d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:24.529018 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3a976-eb68-46ae-a3d9-5bc1f1e2459d admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:24.529299 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3a976-eb68-46ae-a3d9-5bc1f1e2459d admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:24.529573 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3a976-eb68-46ae-a3d9-5bc1f1e2459d admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:24.530356 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3a976-eb68-46ae-a3d9-5bc1f1e2459d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:24.532607 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3a976-eb68-46ae-a3d9-5bc1f1e2459d admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:24.542294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1426/2833] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 14:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:01:24.546318 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aa05d-f58d-474a-bc2b-304224d9800e admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:24.556109 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aa05d-f58d-474a-bc2b-304224d9800e admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:24.560720 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c1d6f-bc4e-4903-bd45-1e3ad594e3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:24.561598 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c1d6f-bc4e-4903-bd45-1e3ad594e3f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:24.561976 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c1d6f-bc4e-4903-bd45-1e3ad594e3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:24.562295 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c1d6f-bc4e-4903-bd45-1e3ad594e3f5 admin admin] PATH_INFO: `/v3/projects/abd806dcce0640b48d9621ace36dc212/users/af9119ba1b8c4e12983d03aa1f68efaa/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:24.576033 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c1d6f-bc4e-4903-bd45-1e3ad594e3f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd806dcce0640b48d9621ace36dc212, user_id=af9119ba1b8c4e12983d03aa1f68efaa, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:24.579347 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c1d6f-bc4e-4903-bd45-1e3ad594e3f5 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:24.654022 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1408/2834] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 14:01:24 2022] PUT /identity/v3/projects/abd806dcce0640b48d9621ace36dc212/users/af9119ba1b8c4e12983d03aa1f68efaa/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:24.665082 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a2226-5343-4ea5-bc1e-2797a59068d1 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:24.665378 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a2226-5343-4ea5-bc1e-2797a59068d1 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:24.665664 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a2226-5343-4ea5-bc1e-2797a59068d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:24.692092 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-329a2226-5343-4ea5-bc1e-2797a59068d1 None None] MFA Rules not processed for user `af9119ba1b8c4e12983d03aa1f68efaa`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:24.693396 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-329a2226-5343-4ea5-bc1e-2797a59068d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:24.759542 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1427/2835] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:24.763904 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c1d6f-bc4e-4903-bd45-1e3ad594e3f5 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:24.826097 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c1d6f-bc4e-4903-bd45-1e3ad594e3f5 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:24.831639 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0239b-0b31-4fcf-8fff-032d3928d151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:24.832284 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0239b-0b31-4fcf-8fff-032d3928d151 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:24.832564 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0239b-0b31-4fcf-8fff-032d3928d151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:24.832868 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0239b-0b31-4fcf-8fff-032d3928d151 admin admin] PATH_INFO: `/v3/projects` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:24.833558 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0239b-0b31-4fcf-8fff-032d3928d151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:24.836408 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0239b-0b31-4fcf-8fff-032d3928d151 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:24.974525 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1409/2836] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 14:01:24 2022] POST /identity/v3/projects => generated 381 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:01:24.978586 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a2226-5343-4ea5-bc1e-2797a59068d1 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:24.989337 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a2226-5343-4ea5-bc1e-2797a59068d1 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:25.044040 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2231b2-e4f4-4a15-867d-baa44855c7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:25.044722 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2231b2-e4f4-4a15-867d-baa44855c7ec admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:25.045004 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2231b2-e4f4-4a15-867d-baa44855c7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:25.045278 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2231b2-e4f4-4a15-867d-baa44855c7ec admin admin] PATH_INFO: `/v3/users` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:25.045999 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2231b2-e4f4-4a15-867d-baa44855c7ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:25.047902 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2231b2-e4f4-4a15-867d-baa44855c7ec admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:25.185388 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1428/2837] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 14:01:24 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:01:25.190070 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0239b-0b31-4fcf-8fff-032d3928d151 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:25.200307 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0239b-0b31-4fcf-8fff-032d3928d151 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:25.205201 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baef89-16aa-4285-b88d-1f62ed5f5250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:25.205885 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baef89-16aa-4285-b88d-1f62ed5f5250 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:25.206164 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baef89-16aa-4285-b88d-1f62ed5f5250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:25.206436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baef89-16aa-4285-b88d-1f62ed5f5250 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:25.207170 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baef89-16aa-4285-b88d-1f62ed5f5250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:25.208805 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baef89-16aa-4285-b88d-1f62ed5f5250 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:25.218969 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1410/2838] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 14:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:01:25.222982 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2231b2-e4f4-4a15-867d-baa44855c7ec admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:25.232584 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2231b2-e4f4-4a15-867d-baa44855c7ec admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:25.237699 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa4198-e1c5-477b-8536-5fad8b924451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:25.238584 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa4198-e1c5-477b-8536-5fad8b924451 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:25.238861 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa4198-e1c5-477b-8536-5fad8b924451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:25.239131 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa4198-e1c5-477b-8536-5fad8b924451 admin admin] PATH_INFO: `/v3/projects/a96abf1c1e3c4308ba26559e57191ac0/users/882d77b7e3cd417a80ec5d805ce883be/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:25.253753 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa4198-e1c5-477b-8536-5fad8b924451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a96abf1c1e3c4308ba26559e57191ac0, user_id=882d77b7e3cd417a80ec5d805ce883be, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:25.256382 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa4198-e1c5-477b-8536-5fad8b924451 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:25.356752 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1429/2839] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 14:01:25 2022] PUT /identity/v3/projects/a96abf1c1e3c4308ba26559e57191ac0/users/882d77b7e3cd417a80ec5d805ce883be/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:25.361351 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baef89-16aa-4285-b88d-1f62ed5f5250 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:25.371124 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baef89-16aa-4285-b88d-1f62ed5f5250 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:25.426006 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051e408-f9e0-46d1-bc0f-d5ad34fcf11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:25.426686 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051e408-f9e0-46d1-bc0f-d5ad34fcf11c admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:25.426969 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051e408-f9e0-46d1-bc0f-d5ad34fcf11c admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:25.427245 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051e408-f9e0-46d1-bc0f-d5ad34fcf11c admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:25.427962 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051e408-f9e0-46d1-bc0f-d5ad34fcf11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:25.429592 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051e408-f9e0-46d1-bc0f-d5ad34fcf11c admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:25.439761 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1411/2840] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 14:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:01:25.443924 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa4198-e1c5-477b-8536-5fad8b924451 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:25.454050 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa4198-e1c5-477b-8536-5fad8b924451 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:25.459179 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debbdd3-ea25-4a5e-8dbf-5686dd1a9ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:25.460053 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debbdd3-ea25-4a5e-8dbf-5686dd1a9ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:25.460362 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debbdd3-ea25-4a5e-8dbf-5686dd1a9ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:25.460636 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debbdd3-ea25-4a5e-8dbf-5686dd1a9ed6 admin admin] PATH_INFO: `/v3/projects/a96abf1c1e3c4308ba26559e57191ac0/users/882d77b7e3cd417a80ec5d805ce883be/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:25.462699 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debbdd3-ea25-4a5e-8dbf-5686dd1a9ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a96abf1c1e3c4308ba26559e57191ac0, user_id=882d77b7e3cd417a80ec5d805ce883be, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:25.465458 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debbdd3-ea25-4a5e-8dbf-5686dd1a9ed6 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:25.475637 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1430/2841] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 14:01:25 2022] PUT /identity/v3/projects/a96abf1c1e3c4308ba26559e57191ac0/users/882d77b7e3cd417a80ec5d805ce883be/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:25.487499 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6e64a-5c58-4d26-bde1-647e2884b689 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:25.491072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6e64a-5c58-4d26-bde1-647e2884b689 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:25.491072 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6e64a-5c58-4d26-bde1-647e2884b689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:25.514314 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-48f6e64a-5c58-4d26-bde1-647e2884b689 None None] MFA Rules not processed for user `882d77b7e3cd417a80ec5d805ce883be`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:25.515637 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-48f6e64a-5c58-4d26-bde1-647e2884b689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:25.580519 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1412/2842] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:25.591895 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debbdd3-ea25-4a5e-8dbf-5686dd1a9ed6 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:25.594146 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-9debbdd3-ea25-4a5e-8dbf-5686dd1a9ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:25.649479 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debbdd3-ea25-4a5e-8dbf-5686dd1a9ed6 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:25.653029 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782ccd5-6be0-4024-b5a6-b89cb6f924a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:25.653668 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782ccd5-6be0-4024-b5a6-b89cb6f924a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:25.653950 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782ccd5-6be0-4024-b5a6-b89cb6f924a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:25.654231 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782ccd5-6be0-4024-b5a6-b89cb6f924a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:25.663503 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782ccd5-6be0-4024-b5a6-b89cb6f924a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:25.664969 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782ccd5-6be0-4024-b5a6-b89cb6f924a6 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:25.674975 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1431/2843] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:01:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:01:26.227428 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6e64a-5c58-4d26-bde1-647e2884b689 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:26.286409 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6e64a-5c58-4d26-bde1-647e2884b689 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:26.290963 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b8d1c-3f5e-40c9-a409-47bb1048e9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:26.291816 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b8d1c-3f5e-40c9-a409-47bb1048e9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:26.292100 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b8d1c-3f5e-40c9-a409-47bb1048e9af admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:26.292376 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b8d1c-3f5e-40c9-a409-47bb1048e9af admin admin] PATH_INFO: `/v3/users/af9119ba1b8c4e12983d03aa1f68efaa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:26.293605 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b8d1c-3f5e-40c9-a409-47bb1048e9af admin admin] RBAC: Authorizing `identity:delete_user(user_id=af9119ba1b8c4e12983d03aa1f68efaa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:26.295610 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b8d1c-3f5e-40c9-a409-47bb1048e9af admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:26.518699 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-9b1b8d1c-3f5e-40c9-a409-47bb1048e9af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9119ba1b8c4e12983d03aa1f68efaa'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:26.529923 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-9b1b8d1c-3f5e-40c9-a409-47bb1048e9af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9119ba1b8c4e12983d03aa1f68efaa'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:26.530701 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-9b1b8d1c-3f5e-40c9-a409-47bb1048e9af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9119ba1b8c4e12983d03aa1f68efaa'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:26.607680 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-9b1b8d1c-3f5e-40c9-a409-47bb1048e9af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9119ba1b8c4e12983d03aa1f68efaa'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:26.608370 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-9b1b8d1c-3f5e-40c9-a409-47bb1048e9af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9119ba1b8c4e12983d03aa1f68efaa'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:26.620718 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1413/2844] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 14:01:26 2022] DELETE /identity/v3/users/af9119ba1b8c4e12983d03aa1f68efaa => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:26.625855 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c82c9-e1f0-42a0-abd3-14bce2ce9fee None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:26.626319 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c82c9-e1f0-42a0-abd3-14bce2ce9fee None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:26.626437 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c82c9-e1f0-42a0-abd3-14bce2ce9fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:26.644210 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-e89c82c9-e1f0-42a0-abd3-14bce2ce9fee None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:26.645433 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e89c82c9-e1f0-42a0-abd3-14bce2ce9fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:26.702918 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1432/2845] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:26.712791 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b8d1c-3f5e-40c9-a409-47bb1048e9af admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:26.714204 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-9b1b8d1c-3f5e-40c9-a409-47bb1048e9af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:26.772142 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b8d1c-3f5e-40c9-a409-47bb1048e9af admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:26.775843 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43121854-1e92-439e-bc60-3e4fc2a70228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:26.776519 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43121854-1e92-439e-bc60-3e4fc2a70228 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:26.776827 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43121854-1e92-439e-bc60-3e4fc2a70228 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:26.777100 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43121854-1e92-439e-bc60-3e4fc2a70228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:26.786464 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43121854-1e92-439e-bc60-3e4fc2a70228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:26.787888 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43121854-1e92-439e-bc60-3e4fc2a70228 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:26.797909 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1414/2846] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:01:27.272005 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c82c9-e1f0-42a0-abd3-14bce2ce9fee None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:27.273564 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-e89c82c9-e1f0-42a0-abd3-14bce2ce9fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:27.286091 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c82c9-e1f0-42a0-abd3-14bce2ce9fee None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:27.290544 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa6693-6413-4833-b9ae-94d6cf115766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:27.291403 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa6693-6413-4833-b9ae-94d6cf115766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:27.291680 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa6693-6413-4833-b9ae-94d6cf115766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:27.291952 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa6693-6413-4833-b9ae-94d6cf115766 admin admin] PATH_INFO: `/v3/projects/abd806dcce0640b48d9621ace36dc212` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:27.293157 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa6693-6413-4833-b9ae-94d6cf115766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd806dcce0640b48d9621ace36dc212)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:27.303260 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa6693-6413-4833-b9ae-94d6cf115766 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:27.436417 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-b8aa6693-6413-4833-b9ae-94d6cf115766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd806dcce0640b48d9621ace36dc212', 'request_id': 'req-b8aa6693-6413-4833-b9ae-94d6cf115766'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:27.441787 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-b8aa6693-6413-4833-b9ae-94d6cf115766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd806dcce0640b48d9621ace36dc212', 'request_id': 'req-b8aa6693-6413-4833-b9ae-94d6cf115766'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:27.447832 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-b8aa6693-6413-4833-b9ae-94d6cf115766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd806dcce0640b48d9621ace36dc212', 'request_id': 'req-b8aa6693-6413-4833-b9ae-94d6cf115766'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:27.571715 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-b8aa6693-6413-4833-b9ae-94d6cf115766 admin admin] The token cache is being invalidate because project abd806dcce0640b48d9621ace36dc212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:01:27.571927 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-b8aa6693-6413-4833-b9ae-94d6cf115766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:27.572674 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-b8aa6693-6413-4833-b9ae-94d6cf115766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:27.574314 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1433/2847] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 14:01:27 2022] DELETE /identity/v3/projects/abd806dcce0640b48d9621ace36dc212 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:27.579012 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43121854-1e92-439e-bc60-3e4fc2a70228 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:27.589152 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43121854-1e92-439e-bc60-3e4fc2a70228 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:27.642977 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18299f-d7e9-4dbc-8961-e7b585ab67a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:27.643855 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18299f-d7e9-4dbc-8961-e7b585ab67a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:27.644136 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18299f-d7e9-4dbc-8961-e7b585ab67a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:27.644409 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18299f-d7e9-4dbc-8961-e7b585ab67a6 admin admin] PATH_INFO: `/v3/users/882d77b7e3cd417a80ec5d805ce883be` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:27.645618 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18299f-d7e9-4dbc-8961-e7b585ab67a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=882d77b7e3cd417a80ec5d805ce883be)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:27.647539 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18299f-d7e9-4dbc-8961-e7b585ab67a6 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:27.934995 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-0a18299f-d7e9-4dbc-8961-e7b585ab67a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '882d77b7e3cd417a80ec5d805ce883be'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:27.946802 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-0a18299f-d7e9-4dbc-8961-e7b585ab67a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '882d77b7e3cd417a80ec5d805ce883be'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:27.947465 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-0a18299f-d7e9-4dbc-8961-e7b585ab67a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '882d77b7e3cd417a80ec5d805ce883be'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:28.075999 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-0a18299f-d7e9-4dbc-8961-e7b585ab67a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '882d77b7e3cd417a80ec5d805ce883be'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:28.076624 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-0a18299f-d7e9-4dbc-8961-e7b585ab67a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '882d77b7e3cd417a80ec5d805ce883be'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:28.089504 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1415/2848] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 14:01:27 2022] DELETE /identity/v3/users/882d77b7e3cd417a80ec5d805ce883be => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:01:28.517256 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa6693-6413-4833-b9ae-94d6cf115766 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:28.518736 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-b8aa6693-6413-4833-b9ae-94d6cf115766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:28.532096 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa6693-6413-4833-b9ae-94d6cf115766 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:28.588328 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972101f7-afa6-4553-8959-61ec8f3f657f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:28.589257 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972101f7-afa6-4553-8959-61ec8f3f657f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:28.589541 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972101f7-afa6-4553-8959-61ec8f3f657f admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:28.589818 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972101f7-afa6-4553-8959-61ec8f3f657f admin admin] PATH_INFO: `/v3/projects/a96abf1c1e3c4308ba26559e57191ac0` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:28.591003 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972101f7-afa6-4553-8959-61ec8f3f657f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a96abf1c1e3c4308ba26559e57191ac0)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:28.593451 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972101f7-afa6-4553-8959-61ec8f3f657f admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:28.744851 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-972101f7-afa6-4553-8959-61ec8f3f657f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a96abf1c1e3c4308ba26559e57191ac0', 'request_id': 'req-972101f7-afa6-4553-8959-61ec8f3f657f'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:28.750156 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-972101f7-afa6-4553-8959-61ec8f3f657f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a96abf1c1e3c4308ba26559e57191ac0', 'request_id': 'req-972101f7-afa6-4553-8959-61ec8f3f657f'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:28.756058 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-972101f7-afa6-4553-8959-61ec8f3f657f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a96abf1c1e3c4308ba26559e57191ac0', 'request_id': 'req-972101f7-afa6-4553-8959-61ec8f3f657f'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:28.876447 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-972101f7-afa6-4553-8959-61ec8f3f657f admin admin] The token cache is being invalidate because project a96abf1c1e3c4308ba26559e57191ac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:01:28.876447 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-972101f7-afa6-4553-8959-61ec8f3f657f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:28.876447 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-972101f7-afa6-4553-8959-61ec8f3f657f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:28.876447 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1434/2849] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 14:01:28 2022] DELETE /identity/v3/projects/a96abf1c1e3c4308ba26559e57191ac0 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:28.878211 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766ac60-d238-4e5b-ac61-ef812f8a0241 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:28.878650 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766ac60-d238-4e5b-ac61-ef812f8a0241 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:28.878764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766ac60-d238-4e5b-ac61-ef812f8a0241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:28.896848 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-b766ac60-d238-4e5b-ac61-ef812f8a0241 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:28.898043 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-b766ac60-d238-4e5b-ac61-ef812f8a0241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:28.955380 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1416/2850] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:01:28.963311 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7b8b0-edaf-45e0-9e8f-38591a3e8e26 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:28.963626 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7b8b0-edaf-45e0-9e8f-38591a3e8e26 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:28.963886 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7b8b0-edaf-45e0-9e8f-38591a3e8e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:28.982375 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-06a7b8b0-edaf-45e0-9e8f-38591a3e8e26 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:28.983617 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-06a7b8b0-edaf-45e0-9e8f-38591a3e8e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:28.991555 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1435/2851] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:28.995541 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766ac60-d238-4e5b-ac61-ef812f8a0241 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:29.005104 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766ac60-d238-4e5b-ac61-ef812f8a0241 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:29.009579 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d29bc-044d-47aa-b38c-25ac8863ed55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:29.010214 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d29bc-044d-47aa-b38c-25ac8863ed55 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:29.010502 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d29bc-044d-47aa-b38c-25ac8863ed55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:29.010774 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d29bc-044d-47aa-b38c-25ac8863ed55 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:29.011487 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d29bc-044d-47aa-b38c-25ac8863ed55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:01:29.011820 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d29bc-044d-47aa-b38c-25ac8863ed55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:29.013519 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d29bc-044d-47aa-b38c-25ac8863ed55 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:29.025153 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1417/2852] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 14:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:01:29.029162 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7b8b0-edaf-45e0-9e8f-38591a3e8e26 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:29.038740 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7b8b0-edaf-45e0-9e8f-38591a3e8e26 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:29.043445 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c5c55-497a-4756-a5af-b82e66a6fb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:29.044090 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c5c55-497a-4756-a5af-b82e66a6fb86 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:29.044374 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c5c55-497a-4756-a5af-b82e66a6fb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:29.044651 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c5c55-497a-4756-a5af-b82e66a6fb86 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:29.045393 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c5c55-497a-4756-a5af-b82e66a6fb86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:29.047309 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c5c55-497a-4756-a5af-b82e66a6fb86 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:29.158025 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1436/2853] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 14:01:29 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:01:29.162094 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d29bc-044d-47aa-b38c-25ac8863ed55 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:29.172003 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d29bc-044d-47aa-b38c-25ac8863ed55 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:29.225881 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f7c2f-a601-447d-a1f6-449b72618ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:29.226564 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f7c2f-a601-447d-a1f6-449b72618ddb admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:29.226853 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f7c2f-a601-447d-a1f6-449b72618ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:29.227125 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f7c2f-a601-447d-a1f6-449b72618ddb admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:29.227839 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f7c2f-a601-447d-a1f6-449b72618ddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:29.229799 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f7c2f-a601-447d-a1f6-449b72618ddb admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:29.320695 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1418/2854] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 14:01:29 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:01:29.324769 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c5c55-497a-4756-a5af-b82e66a6fb86 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:29.336080 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c5c55-497a-4756-a5af-b82e66a6fb86 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:29.340981 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c2de5-d6f8-4205-8ef9-f573014099b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:29.341635 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c2de5-d6f8-4205-8ef9-f573014099b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:29.341920 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c2de5-d6f8-4205-8ef9-f573014099b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:29.342199 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c2de5-d6f8-4205-8ef9-f573014099b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:29.342965 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c2de5-d6f8-4205-8ef9-f573014099b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:29.344934 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c2de5-d6f8-4205-8ef9-f573014099b2 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:29.355546 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1437/2855] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 14:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:01:29.359534 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f7c2f-a601-447d-a1f6-449b72618ddb admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:29.369455 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f7c2f-a601-447d-a1f6-449b72618ddb admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:29.374468 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b2d4b-b4d8-4e05-9499-80a3c30a6ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:29.375113 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b2d4b-b4d8-4e05-9499-80a3c30a6ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:29.375396 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b2d4b-b4d8-4e05-9499-80a3c30a6ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:29.375673 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b2d4b-b4d8-4e05-9499-80a3c30a6ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:29.376393 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b2d4b-b4d8-4e05-9499-80a3c30a6ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:29.378033 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b2d4b-b4d8-4e05-9499-80a3c30a6ee0 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:29.387541 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1419/2856] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 14:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:01:29.392102 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c2de5-d6f8-4205-8ef9-f573014099b2 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:29.402094 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c2de5-d6f8-4205-8ef9-f573014099b2 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:29.406617 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecda49-05cd-499b-9a6a-6ab813562555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:29.407511 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecda49-05cd-499b-9a6a-6ab813562555 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:29.407798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecda49-05cd-499b-9a6a-6ab813562555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:29.408129 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecda49-05cd-499b-9a6a-6ab813562555 admin admin] PATH_INFO: `/v3/projects/531f7aaa0ce8486da5947c3c768975cd/users/5c65f8dc269b4fdd8a278feb58816d68/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:29.422346 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecda49-05cd-499b-9a6a-6ab813562555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=531f7aaa0ce8486da5947c3c768975cd, user_id=5c65f8dc269b4fdd8a278feb58816d68, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:29.425045 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecda49-05cd-499b-9a6a-6ab813562555 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:29.493612 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1438/2857] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 14:01:29 2022] PUT /identity/v3/projects/531f7aaa0ce8486da5947c3c768975cd/users/5c65f8dc269b4fdd8a278feb58816d68/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:29.549801 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c6a20-99ba-4ca5-9c4c-c3aae1bba360 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:29.550089 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c6a20-99ba-4ca5-9c4c-c3aae1bba360 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:29.550400 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c6a20-99ba-4ca5-9c4c-c3aae1bba360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:29.576572 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-696c6a20-99ba-4ca5-9c4c-c3aae1bba360 None None] MFA Rules not processed for user `5c65f8dc269b4fdd8a278feb58816d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:29.578512 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-696c6a20-99ba-4ca5-9c4c-c3aae1bba360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:29.640783 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1420/2858] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:29.645292 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecda49-05cd-499b-9a6a-6ab813562555 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:29.705804 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecda49-05cd-499b-9a6a-6ab813562555 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:29.710455 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b69b0-6472-47bf-9b71-203720b82e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:29.711103 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b69b0-6472-47bf-9b71-203720b82e31 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:29.711386 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b69b0-6472-47bf-9b71-203720b82e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:29.711662 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b69b0-6472-47bf-9b71-203720b82e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:29.712347 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b69b0-6472-47bf-9b71-203720b82e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:29.714281 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b69b0-6472-47bf-9b71-203720b82e31 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:29.836982 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1439/2859] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 14:01:29 2022] POST /identity/v3/projects => generated 383 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:01:29.841101 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c6a20-99ba-4ca5-9c4c-c3aae1bba360 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:29.851625 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c6a20-99ba-4ca5-9c4c-c3aae1bba360 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:29.904229 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc478f-8e13-47c6-bce9-d5aee7c05f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:29.904903 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc478f-8e13-47c6-bce9-d5aee7c05f45 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:29.905205 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc478f-8e13-47c6-bce9-d5aee7c05f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:29.905480 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc478f-8e13-47c6-bce9-d5aee7c05f45 admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:29.906163 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc478f-8e13-47c6-bce9-d5aee7c05f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:29.908129 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc478f-8e13-47c6-bce9-d5aee7c05f45 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:29.991000 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1421/2860] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 14:01:29 2022] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:01:29.994944 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b69b0-6472-47bf-9b71-203720b82e31 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:30.005966 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b69b0-6472-47bf-9b71-203720b82e31 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:30.010511 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777c9c5-1aaa-4aee-b002-622fc0bc1b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:30.011186 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777c9c5-1aaa-4aee-b002-622fc0bc1b3b admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:30.011465 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777c9c5-1aaa-4aee-b002-622fc0bc1b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:30.011739 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777c9c5-1aaa-4aee-b002-622fc0bc1b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:30.012489 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777c9c5-1aaa-4aee-b002-622fc0bc1b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:30.014105 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777c9c5-1aaa-4aee-b002-622fc0bc1b3b admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:30.025725 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1440/2861] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 14:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:01:30.029765 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc478f-8e13-47c6-bce9-d5aee7c05f45 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:30.039936 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc478f-8e13-47c6-bce9-d5aee7c05f45 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:30.044431 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfec1e8-5d85-446f-aa1e-4be65c2d77db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:30.045326 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfec1e8-5d85-446f-aa1e-4be65c2d77db admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:30.045604 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfec1e8-5d85-446f-aa1e-4be65c2d77db admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:30.046444 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfec1e8-5d85-446f-aa1e-4be65c2d77db admin admin] PATH_INFO: `/v3/projects/699210b9042745269454c1a6960feaff/users/7b3cf44ba7b34983acee898536757f5f/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:30.060375 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfec1e8-5d85-446f-aa1e-4be65c2d77db admin admin] RBAC: Authorizing `identity:create_grant(project_id=699210b9042745269454c1a6960feaff, user_id=7b3cf44ba7b34983acee898536757f5f, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:30.063131 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfec1e8-5d85-446f-aa1e-4be65c2d77db admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:30.174159 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1422/2862] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 14:01:30 2022] PUT /identity/v3/projects/699210b9042745269454c1a6960feaff/users/7b3cf44ba7b34983acee898536757f5f/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:30.178060 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777c9c5-1aaa-4aee-b002-622fc0bc1b3b admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:30.187862 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777c9c5-1aaa-4aee-b002-622fc0bc1b3b admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:30.242134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c64f57-cc16-4e5f-98bd-becc9c1874b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:30.242851 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c64f57-cc16-4e5f-98bd-becc9c1874b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:30.243137 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c64f57-cc16-4e5f-98bd-becc9c1874b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:30.243432 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c64f57-cc16-4e5f-98bd-becc9c1874b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:30.244150 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c64f57-cc16-4e5f-98bd-becc9c1874b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:30.245741 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c64f57-cc16-4e5f-98bd-becc9c1874b1 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:30.255174 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1441/2863] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 14:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:01:30.259410 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfec1e8-5d85-446f-aa1e-4be65c2d77db admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:30.269752 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfec1e8-5d85-446f-aa1e-4be65c2d77db admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:30.274397 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce7793-d088-49c9-b9ff-1856b93a80af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:30.275272 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce7793-d088-49c9-b9ff-1856b93a80af admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:30.275553 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce7793-d088-49c9-b9ff-1856b93a80af admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:30.275824 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce7793-d088-49c9-b9ff-1856b93a80af admin admin] PATH_INFO: `/v3/projects/699210b9042745269454c1a6960feaff/users/7b3cf44ba7b34983acee898536757f5f/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:30.277808 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce7793-d088-49c9-b9ff-1856b93a80af admin admin] RBAC: Authorizing `identity:create_grant(project_id=699210b9042745269454c1a6960feaff, user_id=7b3cf44ba7b34983acee898536757f5f, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:30.281123 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce7793-d088-49c9-b9ff-1856b93a80af admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:30.291088 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1423/2864] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 14:01:30 2022] PUT /identity/v3/projects/699210b9042745269454c1a6960feaff/users/7b3cf44ba7b34983acee898536757f5f/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:30.301718 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac59bd5-0aa2-4fe9-bf42-347cd2722f7a None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:30.302004 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac59bd5-0aa2-4fe9-bf42-347cd2722f7a None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:30.302276 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac59bd5-0aa2-4fe9-bf42-347cd2722f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:30.328588 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-aac59bd5-0aa2-4fe9-bf42-347cd2722f7a None None] MFA Rules not processed for user `7b3cf44ba7b34983acee898536757f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:30.330162 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-aac59bd5-0aa2-4fe9-bf42-347cd2722f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:30.397333 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1442/2865] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:30.419207 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce7793-d088-49c9-b9ff-1856b93a80af admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:30.420963 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-48ce7793-d088-49c9-b9ff-1856b93a80af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:30.476288 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce7793-d088-49c9-b9ff-1856b93a80af admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:30.479871 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a478e8-d13b-4a94-a3b0-a94f26cda738 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:30.480509 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a478e8-d13b-4a94-a3b0-a94f26cda738 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:30.480823 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a478e8-d13b-4a94-a3b0-a94f26cda738 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:30.481098 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a478e8-d13b-4a94-a3b0-a94f26cda738 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:30.534848 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a478e8-d13b-4a94-a3b0-a94f26cda738 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:30.536219 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a478e8-d13b-4a94-a3b0-a94f26cda738 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:30.544744 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1424/2866] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:01:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:01:35.788624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac59bd5-0aa2-4fe9-bf42-347cd2722f7a None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:35.790084 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-aac59bd5-0aa2-4fe9-bf42-347cd2722f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:35.802404 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac59bd5-0aa2-4fe9-bf42-347cd2722f7a None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:35.805862 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8414b6-87c4-4ab1-9d9e-18624dc0a97d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:35.806482 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8414b6-87c4-4ab1-9d9e-18624dc0a97d service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:35.806758 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8414b6-87c4-4ab1-9d9e-18624dc0a97d service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:35.807027 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8414b6-87c4-4ab1-9d9e-18624dc0a97d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:35.816536 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8414b6-87c4-4ab1-9d9e-18624dc0a97d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:35.817984 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8414b6-87c4-4ab1-9d9e-18624dc0a97d service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:35.827463 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1443/2867] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:01:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:01:41.869907 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a478e8-d13b-4a94-a3b0-a94f26cda738 service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:41.931745 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a478e8-d13b-4a94-a3b0-a94f26cda738 service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:41.936272 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd4158-b60a-49fe-b649-1a1fdc60be38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:41.937185 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd4158-b60a-49fe-b649-1a1fdc60be38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:41.937462 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd4158-b60a-49fe-b649-1a1fdc60be38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:41.937735 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd4158-b60a-49fe-b649-1a1fdc60be38 admin admin] PATH_INFO: `/v3/users/5c65f8dc269b4fdd8a278feb58816d68` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:41.938905 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd4158-b60a-49fe-b649-1a1fdc60be38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c65f8dc269b4fdd8a278feb58816d68)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:41.940855 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd4158-b60a-49fe-b649-1a1fdc60be38 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:42.139577 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-45bd4158-b60a-49fe-b649-1a1fdc60be38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c65f8dc269b4fdd8a278feb58816d68'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:42.151706 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-45bd4158-b60a-49fe-b649-1a1fdc60be38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c65f8dc269b4fdd8a278feb58816d68'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:42.152369 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-45bd4158-b60a-49fe-b649-1a1fdc60be38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c65f8dc269b4fdd8a278feb58816d68'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:42.257717 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-45bd4158-b60a-49fe-b649-1a1fdc60be38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c65f8dc269b4fdd8a278feb58816d68'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:42.258248 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-45bd4158-b60a-49fe-b649-1a1fdc60be38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c65f8dc269b4fdd8a278feb58816d68'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:42.270875 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1425/2868] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 14:01:41 2022] DELETE /identity/v3/users/5c65f8dc269b4fdd8a278feb58816d68 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:42.276756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8fac6-9980-4002-9931-80a30015cff7 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:42.276756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8fac6-9980-4002-9931-80a30015cff7 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:42.276756 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8fac6-9980-4002-9931-80a30015cff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:42.293243 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-26b8fac6-9980-4002-9931-80a30015cff7 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:42.294418 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-26b8fac6-9980-4002-9931-80a30015cff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:42.352348 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1444/2869] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:42.362467 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd4158-b60a-49fe-b649-1a1fdc60be38 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:42.363884 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-45bd4158-b60a-49fe-b649-1a1fdc60be38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:42.422994 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd4158-b60a-49fe-b649-1a1fdc60be38 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:42.426569 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca82c9-5c23-4a3e-8bbd-3c6339d98f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:42.427208 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca82c9-5c23-4a3e-8bbd-3c6339d98f05 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:42.427489 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca82c9-5c23-4a3e-8bbd-3c6339d98f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:42.427771 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca82c9-5c23-4a3e-8bbd-3c6339d98f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:42.436439 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca82c9-5c23-4a3e-8bbd-3c6339d98f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:42.438530 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca82c9-5c23-4a3e-8bbd-3c6339d98f05 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:42.447705 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1426/2870] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:01:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:01:42.906137 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8fac6-9980-4002-9931-80a30015cff7 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:42.907544 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-26b8fac6-9980-4002-9931-80a30015cff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:42.919635 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8fac6-9980-4002-9931-80a30015cff7 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:42.924446 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d7f95-582a-4136-b1e3-464a693f8f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:42.926026 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d7f95-582a-4136-b1e3-464a693f8f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:42.926026 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d7f95-582a-4136-b1e3-464a693f8f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:42.926026 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d7f95-582a-4136-b1e3-464a693f8f87 admin admin] PATH_INFO: `/v3/projects/531f7aaa0ce8486da5947c3c768975cd` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:42.927048 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d7f95-582a-4136-b1e3-464a693f8f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=531f7aaa0ce8486da5947c3c768975cd)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:42.928974 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d7f95-582a-4136-b1e3-464a693f8f87 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:43.075998 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-371d7f95-582a-4136-b1e3-464a693f8f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '531f7aaa0ce8486da5947c3c768975cd', 'request_id': 'req-371d7f95-582a-4136-b1e3-464a693f8f87'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:43.082420 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-371d7f95-582a-4136-b1e3-464a693f8f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '531f7aaa0ce8486da5947c3c768975cd', 'request_id': 'req-371d7f95-582a-4136-b1e3-464a693f8f87'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:43.088614 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-371d7f95-582a-4136-b1e3-464a693f8f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '531f7aaa0ce8486da5947c3c768975cd', 'request_id': 'req-371d7f95-582a-4136-b1e3-464a693f8f87'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:43.177884 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-371d7f95-582a-4136-b1e3-464a693f8f87 admin admin] The token cache is being invalidate because project 531f7aaa0ce8486da5947c3c768975cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:01:43.178172 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-371d7f95-582a-4136-b1e3-464a693f8f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:43.178795 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-371d7f95-582a-4136-b1e3-464a693f8f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:43.180324 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1445/2871] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 14:01:42 2022] DELETE /identity/v3/projects/531f7aaa0ce8486da5947c3c768975cd => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:43.184526 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca82c9-5c23-4a3e-8bbd-3c6339d98f05 service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:43.194764 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca82c9-5c23-4a3e-8bbd-3c6339d98f05 service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:43.248020 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789bc25-b06c-4bc4-b9ba-e82ff70147bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:43.248937 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789bc25-b06c-4bc4-b9ba-e82ff70147bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:43.249231 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789bc25-b06c-4bc4-b9ba-e82ff70147bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:43.249509 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789bc25-b06c-4bc4-b9ba-e82ff70147bf admin admin] PATH_INFO: `/v3/users/7b3cf44ba7b34983acee898536757f5f` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:43.250680 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789bc25-b06c-4bc4-b9ba-e82ff70147bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b3cf44ba7b34983acee898536757f5f)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:43.252600 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789bc25-b06c-4bc4-b9ba-e82ff70147bf admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:43.483623 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-8789bc25-b06c-4bc4-b9ba-e82ff70147bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b3cf44ba7b34983acee898536757f5f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:43.495630 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-8789bc25-b06c-4bc4-b9ba-e82ff70147bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b3cf44ba7b34983acee898536757f5f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:43.496293 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-8789bc25-b06c-4bc4-b9ba-e82ff70147bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b3cf44ba7b34983acee898536757f5f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:43.590056 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-8789bc25-b06c-4bc4-b9ba-e82ff70147bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b3cf44ba7b34983acee898536757f5f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:43.590660 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-8789bc25-b06c-4bc4-b9ba-e82ff70147bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b3cf44ba7b34983acee898536757f5f'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:43.603256 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1427/2872] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 14:01:43 2022] DELETE /identity/v3/users/7b3cf44ba7b34983acee898536757f5f => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:44.057400 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d7f95-582a-4136-b1e3-464a693f8f87 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:44.057400 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-371d7f95-582a-4136-b1e3-464a693f8f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:44.063114 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d7f95-582a-4136-b1e3-464a693f8f87 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:44.118018 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a4393-2d55-4340-b29d-854c3b04f37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:44.118851 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a4393-2d55-4340-b29d-854c3b04f37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:44.119133 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a4393-2d55-4340-b29d-854c3b04f37f admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:44.119402 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a4393-2d55-4340-b29d-854c3b04f37f admin admin] PATH_INFO: `/v3/projects/699210b9042745269454c1a6960feaff` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:44.120609 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a4393-2d55-4340-b29d-854c3b04f37f admin admin] RBAC: Authorizing `identity:delete_project(project_id=699210b9042745269454c1a6960feaff)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:44.122533 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a4393-2d55-4340-b29d-854c3b04f37f admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:44.252296 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-101a4393-2d55-4340-b29d-854c3b04f37f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '699210b9042745269454c1a6960feaff', 'request_id': 'req-101a4393-2d55-4340-b29d-854c3b04f37f'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:44.258399 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-101a4393-2d55-4340-b29d-854c3b04f37f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '699210b9042745269454c1a6960feaff', 'request_id': 'req-101a4393-2d55-4340-b29d-854c3b04f37f'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:44.264616 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-101a4393-2d55-4340-b29d-854c3b04f37f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '699210b9042745269454c1a6960feaff', 'request_id': 'req-101a4393-2d55-4340-b29d-854c3b04f37f'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:44.366422 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-101a4393-2d55-4340-b29d-854c3b04f37f admin admin] The token cache is being invalidate because project 699210b9042745269454c1a6960feaff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:01:44.366739 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-101a4393-2d55-4340-b29d-854c3b04f37f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:44.367353 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-101a4393-2d55-4340-b29d-854c3b04f37f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:44.368952 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1446/2873] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 14:01:44 2022] DELETE /identity/v3/projects/699210b9042745269454c1a6960feaff => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:44.375156 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1372d03-1505-432e-b94e-71164190f557 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:44.375615 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1372d03-1505-432e-b94e-71164190f557 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:44.375752 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1372d03-1505-432e-b94e-71164190f557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:44.393934 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-e1372d03-1505-432e-b94e-71164190f557 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:44.395209 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-e1372d03-1505-432e-b94e-71164190f557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:44.452500 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1428/2874] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:44.461881 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f64a0-18cb-4965-a592-8f93986ee4be None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:44.462188 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f64a0-18cb-4965-a592-8f93986ee4be None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:44.462512 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f64a0-18cb-4965-a592-8f93986ee4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:44.481153 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-cd0f64a0-18cb-4965-a592-8f93986ee4be None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:44.482344 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-cd0f64a0-18cb-4965-a592-8f93986ee4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:44.490549 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1447/2875] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:44.494926 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1372d03-1505-432e-b94e-71164190f557 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:44.504365 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1372d03-1505-432e-b94e-71164190f557 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:44.509931 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e94c7-7335-4f9f-89b7-69674a9db0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:44.510579 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e94c7-7335-4f9f-89b7-69674a9db0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:44.510883 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e94c7-7335-4f9f-89b7-69674a9db0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:44.511155 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e94c7-7335-4f9f-89b7-69674a9db0c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:44.511869 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e94c7-7335-4f9f-89b7-69674a9db0c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:01:44.512172 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e94c7-7335-4f9f-89b7-69674a9db0c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:44.513797 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e94c7-7335-4f9f-89b7-69674a9db0c7 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:44.525297 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1429/2876] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 14:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:01:44.529582 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f64a0-18cb-4965-a592-8f93986ee4be None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:44.539066 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f64a0-18cb-4965-a592-8f93986ee4be None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:44.543715 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20450ba0-1140-4abf-a2d7-72d92da3d36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:44.544354 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20450ba0-1140-4abf-a2d7-72d92da3d36e admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:44.544635 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20450ba0-1140-4abf-a2d7-72d92da3d36e admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:44.544941 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20450ba0-1140-4abf-a2d7-72d92da3d36e admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:44.545642 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20450ba0-1140-4abf-a2d7-72d92da3d36e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:44.547586 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20450ba0-1140-4abf-a2d7-72d92da3d36e admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:44.637882 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1448/2877] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 14:01:44 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:01:44.641856 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e94c7-7335-4f9f-89b7-69674a9db0c7 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:44.651838 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e94c7-7335-4f9f-89b7-69674a9db0c7 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:44.706543 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d241897-21f6-4418-ad16-09db1bdcddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:44.707199 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d241897-21f6-4418-ad16-09db1bdcddee admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:44.707482 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d241897-21f6-4418-ad16-09db1bdcddee admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:44.707757 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d241897-21f6-4418-ad16-09db1bdcddee admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:44.708432 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d241897-21f6-4418-ad16-09db1bdcddee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:44.710590 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d241897-21f6-4418-ad16-09db1bdcddee admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:44.858550 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1430/2878] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 14:01:44 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:01:44.862824 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20450ba0-1140-4abf-a2d7-72d92da3d36e admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:44.873505 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20450ba0-1140-4abf-a2d7-72d92da3d36e admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:44.877949 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22512fa-f8c1-45c8-9893-1d5545013a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:44.878595 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22512fa-f8c1-45c8-9893-1d5545013a90 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:44.878872 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22512fa-f8c1-45c8-9893-1d5545013a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:44.879145 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22512fa-f8c1-45c8-9893-1d5545013a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:44.879863 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22512fa-f8c1-45c8-9893-1d5545013a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:44.881491 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22512fa-f8c1-45c8-9893-1d5545013a90 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:44.891489 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1449/2879] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 14:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:01:44.895266 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d241897-21f6-4418-ad16-09db1bdcddee admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:44.905107 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d241897-21f6-4418-ad16-09db1bdcddee admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:44.909637 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4389dc2-8926-465f-a452-853a7c031865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:44.910282 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4389dc2-8926-465f-a452-853a7c031865 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:44.910560 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4389dc2-8926-465f-a452-853a7c031865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:44.910888 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4389dc2-8926-465f-a452-853a7c031865 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:44.911546 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4389dc2-8926-465f-a452-853a7c031865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:44.913703 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4389dc2-8926-465f-a452-853a7c031865 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:44.923226 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1431/2880] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 14:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:01:44.927362 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22512fa-f8c1-45c8-9893-1d5545013a90 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:44.937780 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22512fa-f8c1-45c8-9893-1d5545013a90 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:44.942207 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da7c4c-fe71-47f1-916a-497c35d2b901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:44.943075 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da7c4c-fe71-47f1-916a-497c35d2b901 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:44.943552 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da7c4c-fe71-47f1-916a-497c35d2b901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:44.943839 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da7c4c-fe71-47f1-916a-497c35d2b901 admin admin] PATH_INFO: `/v3/projects/127d719ceb32495cbdb2b5a535eda820/users/0193c2cac2d84ebbb9f878a4fc82a0b2/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:44.958361 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da7c4c-fe71-47f1-916a-497c35d2b901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=127d719ceb32495cbdb2b5a535eda820, user_id=0193c2cac2d84ebbb9f878a4fc82a0b2, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:44.962019 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da7c4c-fe71-47f1-916a-497c35d2b901 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:45.097640 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1450/2881] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 14:01:44 2022] PUT /identity/v3/projects/127d719ceb32495cbdb2b5a535eda820/users/0193c2cac2d84ebbb9f878a4fc82a0b2/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:45.110359 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236ae14-84c7-4911-a5b6-be72daa399a2 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:45.110646 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236ae14-84c7-4911-a5b6-be72daa399a2 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:45.110923 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236ae14-84c7-4911-a5b6-be72daa399a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:45.138120 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-6236ae14-84c7-4911-a5b6-be72daa399a2 None None] MFA Rules not processed for user `0193c2cac2d84ebbb9f878a4fc82a0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:45.139324 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6236ae14-84c7-4911-a5b6-be72daa399a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:45.200610 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1432/2882] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:45.212588 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da7c4c-fe71-47f1-916a-497c35d2b901 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:45.214279 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-78da7c4c-fe71-47f1-916a-497c35d2b901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:45.269415 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da7c4c-fe71-47f1-916a-497c35d2b901 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:45.273031 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1b0c5-79c8-4e26-86c7-3f3704f8a0d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:45.273667 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1b0c5-79c8-4e26-86c7-3f3704f8a0d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:45.273949 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1b0c5-79c8-4e26-86c7-3f3704f8a0d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:45.274223 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1b0c5-79c8-4e26-86c7-3f3704f8a0d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:45.282318 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1b0c5-79c8-4e26-86c7-3f3704f8a0d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:45.283746 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1b0c5-79c8-4e26-86c7-3f3704f8a0d1 service cinder] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:45.292496 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1451/2883] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:01:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:01:55.552712 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236ae14-84c7-4911-a5b6-be72daa399a2 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:55.612683 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236ae14-84c7-4911-a5b6-be72daa399a2 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:55.617033 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bf68f-2087-4307-9dde-43912577787e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:55.617885 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bf68f-2087-4307-9dde-43912577787e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:55.618165 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bf68f-2087-4307-9dde-43912577787e admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:55.618432 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bf68f-2087-4307-9dde-43912577787e admin admin] PATH_INFO: `/v3/users/0193c2cac2d84ebbb9f878a4fc82a0b2` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:55.619601 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bf68f-2087-4307-9dde-43912577787e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0193c2cac2d84ebbb9f878a4fc82a0b2)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:55.621542 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bf68f-2087-4307-9dde-43912577787e admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:55.923119 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-874bf68f-2087-4307-9dde-43912577787e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0193c2cac2d84ebbb9f878a4fc82a0b2'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:55.934265 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-874bf68f-2087-4307-9dde-43912577787e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0193c2cac2d84ebbb9f878a4fc82a0b2'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:55.934970 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-874bf68f-2087-4307-9dde-43912577787e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0193c2cac2d84ebbb9f878a4fc82a0b2'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:56.041223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-874bf68f-2087-4307-9dde-43912577787e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0193c2cac2d84ebbb9f878a4fc82a0b2'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:56.041848 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-874bf68f-2087-4307-9dde-43912577787e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0193c2cac2d84ebbb9f878a4fc82a0b2'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:56.054571 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1433/2884] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 14:01:55 2022] DELETE /identity/v3/users/0193c2cac2d84ebbb9f878a4fc82a0b2 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:56.059192 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaa0b8-ae96-4160-8dab-a3c0bf63da81 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:56.059689 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaa0b8-ae96-4160-8dab-a3c0bf63da81 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:56.059867 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaa0b8-ae96-4160-8dab-a3c0bf63da81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:56.077063 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-77aaa0b8-ae96-4160-8dab-a3c0bf63da81 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:56.078240 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-77aaa0b8-ae96-4160-8dab-a3c0bf63da81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:56.134551 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1452/2885] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:56.144683 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bf68f-2087-4307-9dde-43912577787e admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:56.146085 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-874bf68f-2087-4307-9dde-43912577787e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:56.201214 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bf68f-2087-4307-9dde-43912577787e admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:56.205036 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61feefba-b099-4624-acf1-1fa2862819ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:56.205674 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61feefba-b099-4624-acf1-1fa2862819ba service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:56.205957 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61feefba-b099-4624-acf1-1fa2862819ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:56.206234 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61feefba-b099-4624-acf1-1fa2862819ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:56.214874 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61feefba-b099-4624-acf1-1fa2862819ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:56.217058 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61feefba-b099-4624-acf1-1fa2862819ba service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:56.226186 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1434/2886] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:01:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:01:56.678555 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aaa0b8-ae96-4160-8dab-a3c0bf63da81 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:56.679988 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-77aaa0b8-ae96-4160-8dab-a3c0bf63da81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:56.692635 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aaa0b8-ae96-4160-8dab-a3c0bf63da81 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:56.697271 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba44db-bd2c-4e9e-9641-17f92ba19834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:56.698124 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba44db-bd2c-4e9e-9641-17f92ba19834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:56.698405 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba44db-bd2c-4e9e-9641-17f92ba19834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:56.698673 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba44db-bd2c-4e9e-9641-17f92ba19834 admin admin] PATH_INFO: `/v3/projects/127d719ceb32495cbdb2b5a535eda820` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:56.699874 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba44db-bd2c-4e9e-9641-17f92ba19834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=127d719ceb32495cbdb2b5a535eda820)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:56.702040 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba44db-bd2c-4e9e-9641-17f92ba19834 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:56.823007 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-65ba44db-bd2c-4e9e-9641-17f92ba19834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127d719ceb32495cbdb2b5a535eda820', 'request_id': 'req-65ba44db-bd2c-4e9e-9641-17f92ba19834'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:56.828180 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-65ba44db-bd2c-4e9e-9641-17f92ba19834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127d719ceb32495cbdb2b5a535eda820', 'request_id': 'req-65ba44db-bd2c-4e9e-9641-17f92ba19834'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:56.834541 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-65ba44db-bd2c-4e9e-9641-17f92ba19834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127d719ceb32495cbdb2b5a535eda820', 'request_id': 'req-65ba44db-bd2c-4e9e-9641-17f92ba19834'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:56.972446 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-65ba44db-bd2c-4e9e-9641-17f92ba19834 admin admin] The token cache is being invalidate because project 127d719ceb32495cbdb2b5a535eda820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:01:56.972761 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-65ba44db-bd2c-4e9e-9641-17f92ba19834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:56.973445 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-65ba44db-bd2c-4e9e-9641-17f92ba19834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:56.975051 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1453/2887] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 14:01:56 2022] DELETE /identity/v3/projects/127d719ceb32495cbdb2b5a535eda820 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:56.979834 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd263cfb-486a-4f2b-8a83-5ed4e9e0e587 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:56.980285 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd263cfb-486a-4f2b-8a83-5ed4e9e0e587 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:56.980395 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd263cfb-486a-4f2b-8a83-5ed4e9e0e587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:56.997615 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-bd263cfb-486a-4f2b-8a83-5ed4e9e0e587 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:56.998804 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-bd263cfb-486a-4f2b-8a83-5ed4e9e0e587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:57.057311 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1435/2888] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:57.065806 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe42fa-30c9-49ff-af5e-bfc99f428728 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:57.066263 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe42fa-30c9-49ff-af5e-bfc99f428728 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:57.066384 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe42fa-30c9-49ff-af5e-bfc99f428728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:57.085130 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-1dbe42fa-30c9-49ff-af5e-bfc99f428728 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:57.086244 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-1dbe42fa-30c9-49ff-af5e-bfc99f428728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:57.094031 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1454/2889] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:57.097977 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd263cfb-486a-4f2b-8a83-5ed4e9e0e587 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:57.107385 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd263cfb-486a-4f2b-8a83-5ed4e9e0e587 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:57.111839 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1e124-3546-4732-bce4-af76d063adcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:57.112502 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1e124-3546-4732-bce4-af76d063adcf admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:57.112810 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1e124-3546-4732-bce4-af76d063adcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:57.113081 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1e124-3546-4732-bce4-af76d063adcf admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:57.113789 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1e124-3546-4732-bce4-af76d063adcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:01:57.114090 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1e124-3546-4732-bce4-af76d063adcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:57.115677 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1e124-3546-4732-bce4-af76d063adcf admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:57.127260 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1436/2890] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 14:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:01:57.131454 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe42fa-30c9-49ff-af5e-bfc99f428728 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:57.141481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe42fa-30c9-49ff-af5e-bfc99f428728 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:57.146130 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be5b1d-2d11-42ba-b137-ac95abf30c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:57.146771 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be5b1d-2d11-42ba-b137-ac95abf30c50 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:57.147054 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be5b1d-2d11-42ba-b137-ac95abf30c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:57.147328 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be5b1d-2d11-42ba-b137-ac95abf30c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:57.148020 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be5b1d-2d11-42ba-b137-ac95abf30c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:57.149943 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be5b1d-2d11-42ba-b137-ac95abf30c50 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:57.240902 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1455/2891] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 14:01:57 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:01:57.245464 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1e124-3546-4732-bce4-af76d063adcf admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:57.256013 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1e124-3546-4732-bce4-af76d063adcf admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:57.310194 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501f679-1753-4464-aa03-da39ca892b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:57.311015 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501f679-1753-4464-aa03-da39ca892b98 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:57.311299 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501f679-1753-4464-aa03-da39ca892b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:57.311573 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501f679-1753-4464-aa03-da39ca892b98 admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:57.312256 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501f679-1753-4464-aa03-da39ca892b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:57.314194 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501f679-1753-4464-aa03-da39ca892b98 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:57.407187 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1437/2892] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 14:01:57 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:01:57.411352 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be5b1d-2d11-42ba-b137-ac95abf30c50 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:57.422124 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be5b1d-2d11-42ba-b137-ac95abf30c50 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:57.426612 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4078f5d-0b52-4b85-af71-47489c8c3493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:57.427287 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4078f5d-0b52-4b85-af71-47489c8c3493 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:57.427578 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4078f5d-0b52-4b85-af71-47489c8c3493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:57.427855 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4078f5d-0b52-4b85-af71-47489c8c3493 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:57.428574 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4078f5d-0b52-4b85-af71-47489c8c3493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:57.430312 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4078f5d-0b52-4b85-af71-47489c8c3493 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:57.441117 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1456/2893] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 14:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:01:57.446236 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501f679-1753-4464-aa03-da39ca892b98 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:57.456480 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501f679-1753-4464-aa03-da39ca892b98 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:57.461071 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bb78f-1aa1-49d7-8ffb-adbc228491a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:57.461716 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bb78f-1aa1-49d7-8ffb-adbc228491a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:57.462025 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bb78f-1aa1-49d7-8ffb-adbc228491a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:57.462321 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bb78f-1aa1-49d7-8ffb-adbc228491a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:57.463026 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bb78f-1aa1-49d7-8ffb-adbc228491a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:57.464698 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bb78f-1aa1-49d7-8ffb-adbc228491a3 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:57.474525 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1438/2894] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 14:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:01:57.478493 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4078f5d-0b52-4b85-af71-47489c8c3493 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:57.488777 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4078f5d-0b52-4b85-af71-47489c8c3493 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:57.493419 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3026559-ad94-44c1-af96-ce8338b2298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:57.494290 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3026559-ad94-44c1-af96-ce8338b2298d admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:57.494568 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3026559-ad94-44c1-af96-ce8338b2298d admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:57.494836 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3026559-ad94-44c1-af96-ce8338b2298d admin admin] PATH_INFO: `/v3/projects/8275802a439249849eb3c8d81c564a0d/users/808ebcb29124499f9df67603f0b96511/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:57.510569 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3026559-ad94-44c1-af96-ce8338b2298d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8275802a439249849eb3c8d81c564a0d, user_id=808ebcb29124499f9df67603f0b96511, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:57.513402 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3026559-ad94-44c1-af96-ce8338b2298d admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:57.600397 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1457/2895] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 14:01:57 2022] PUT /identity/v3/projects/8275802a439249849eb3c8d81c564a0d/users/808ebcb29124499f9df67603f0b96511/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:01:57.611894 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8344e4-9f97-4590-909d-ccfaf63deb42 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:57.612183 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8344e4-9f97-4590-909d-ccfaf63deb42 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:57.612457 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8344e4-9f97-4590-909d-ccfaf63deb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:57.638155 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-8b8344e4-9f97-4590-909d-ccfaf63deb42 None None] MFA Rules not processed for user `808ebcb29124499f9df67603f0b96511`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:57.639355 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-8b8344e4-9f97-4590-909d-ccfaf63deb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:57.704871 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1439/2896] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:01:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:57.716287 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3026559-ad94-44c1-af96-ce8338b2298d admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:57.718109 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a3026559-ad94-44c1-af96-ce8338b2298d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:57.774091 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3026559-ad94-44c1-af96-ce8338b2298d admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:57.777668 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44452983-dcfc-454a-a528-2356f3a9742f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81124c3324d7427a9f29270b88e88f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:57.778786 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44452983-dcfc-454a-a528-2356f3a9742f service glance] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:57.779085 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44452983-dcfc-454a-a528-2356f3a9742f service glance] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:57.779356 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44452983-dcfc-454a-a528-2356f3a9742f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:57.787436 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44452983-dcfc-454a-a528-2356f3a9742f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:57.788883 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44452983-dcfc-454a-a528-2356f3a9742f service glance] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:57.798178 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1458/2897] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:01:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:02:26.171112 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8344e4-9f97-4590-909d-ccfaf63deb42 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:02:26.230223 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8344e4-9f97-4590-909d-ccfaf63deb42 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:02:26.234635 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff907f5f-265c-4cc4-b0fe-868451b5f692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:02:26.235488 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff907f5f-265c-4cc4-b0fe-868451b5f692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:26.235763 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff907f5f-265c-4cc4-b0fe-868451b5f692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:26.236032 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff907f5f-265c-4cc4-b0fe-868451b5f692 admin admin] PATH_INFO: `/v3/users/808ebcb29124499f9df67603f0b96511` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:26.237861 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff907f5f-265c-4cc4-b0fe-868451b5f692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=808ebcb29124499f9df67603f0b96511)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:02:26.239772 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff907f5f-265c-4cc4-b0fe-868451b5f692 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:02:26.410120 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ff907f5f-265c-4cc4-b0fe-868451b5f692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '808ebcb29124499f9df67603f0b96511'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:02:26.421547 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ff907f5f-265c-4cc4-b0fe-868451b5f692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '808ebcb29124499f9df67603f0b96511'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:02:26.422247 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ff907f5f-265c-4cc4-b0fe-868451b5f692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '808ebcb29124499f9df67603f0b96511'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:02:26.525985 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ff907f5f-265c-4cc4-b0fe-868451b5f692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '808ebcb29124499f9df67603f0b96511'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:02:26.526593 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-ff907f5f-265c-4cc4-b0fe-868451b5f692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '808ebcb29124499f9df67603f0b96511'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:02:26.539420 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1440/2898] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 14:02:26 2022] DELETE /identity/v3/users/808ebcb29124499f9df67603f0b96511 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:02:26.543850 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa2a57-f4e4-4219-b866-f38b53d5d775 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:26.544322 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa2a57-f4e4-4219-b866-f38b53d5d775 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:26.544427 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa2a57-f4e4-4219-b866-f38b53d5d775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:26.560942 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-01aa2a57-f4e4-4219-b866-f38b53d5d775 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:02:26.562013 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-01aa2a57-f4e4-4219-b866-f38b53d5d775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:02:26.617979 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1459/2899] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:02:26.627436 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff907f5f-265c-4cc4-b0fe-868451b5f692 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:02:26.628882 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-ff907f5f-265c-4cc4-b0fe-868451b5f692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:02:26.683980 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff907f5f-265c-4cc4-b0fe-868451b5f692 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:02:26.687597 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a8496-b2d8-4c87-a39a-ea094da79375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:02:26.688234 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a8496-b2d8-4c87-a39a-ea094da79375 service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:26.688516 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a8496-b2d8-4c87-a39a-ea094da79375 service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:26.688835 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a8496-b2d8-4c87-a39a-ea094da79375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:26.697627 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a8496-b2d8-4c87-a39a-ea094da79375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:02:26.699143 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a8496-b2d8-4c87-a39a-ea094da79375 service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:02:26.709724 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1441/2900] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:02:27.193117 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa2a57-f4e4-4219-b866-f38b53d5d775 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:02:27.194582 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-01aa2a57-f4e4-4219-b866-f38b53d5d775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:02:27.207842 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa2a57-f4e4-4219-b866-f38b53d5d775 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:02:27.212491 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81ad15-08fd-424a-a25a-067ff82a0ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:02:27.213393 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81ad15-08fd-424a-a25a-067ff82a0ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:27.213809 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81ad15-08fd-424a-a25a-067ff82a0ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:27.214094 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81ad15-08fd-424a-a25a-067ff82a0ca5 admin admin] PATH_INFO: `/v3/projects/8275802a439249849eb3c8d81c564a0d` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:27.215266 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81ad15-08fd-424a-a25a-067ff82a0ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8275802a439249849eb3c8d81c564a0d)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:02:27.217403 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81ad15-08fd-424a-a25a-067ff82a0ca5 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:02:27.354706 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ed81ad15-08fd-424a-a25a-067ff82a0ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8275802a439249849eb3c8d81c564a0d', 'request_id': 'req-ed81ad15-08fd-424a-a25a-067ff82a0ca5'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:02:27.360167 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ed81ad15-08fd-424a-a25a-067ff82a0ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8275802a439249849eb3c8d81c564a0d', 'request_id': 'req-ed81ad15-08fd-424a-a25a-067ff82a0ca5'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:02:27.372255 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ed81ad15-08fd-424a-a25a-067ff82a0ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8275802a439249849eb3c8d81c564a0d', 'request_id': 'req-ed81ad15-08fd-424a-a25a-067ff82a0ca5'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:02:27.514134 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ed81ad15-08fd-424a-a25a-067ff82a0ca5 admin admin] The token cache is being invalidate because project 8275802a439249849eb3c8d81c564a0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:02:27.514349 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ed81ad15-08fd-424a-a25a-067ff82a0ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:02:27.515040 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-ed81ad15-08fd-424a-a25a-067ff82a0ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:02:27.516615 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1460/2901] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 14:02:27 2022] DELETE /identity/v3/projects/8275802a439249849eb3c8d81c564a0d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:02:27.522078 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e744fb-db01-4cc0-8093-679caf9d8ec7 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:27.530531 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e744fb-db01-4cc0-8093-679caf9d8ec7 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:27.530531 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e744fb-db01-4cc0-8093-679caf9d8ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:27.539896 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-53e744fb-db01-4cc0-8093-679caf9d8ec7 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:02:27.541102 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-53e744fb-db01-4cc0-8093-679caf9d8ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:02:27.597478 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1442/2902] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:02:27.605300 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a748b-7785-4987-bf7d-5ffcf9502933 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:27.605758 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a748b-7785-4987-bf7d-5ffcf9502933 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:27.605855 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a748b-7785-4987-bf7d-5ffcf9502933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:27.623989 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-351a748b-7785-4987-bf7d-5ffcf9502933 None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:02:27.625198 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-351a748b-7785-4987-bf7d-5ffcf9502933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:02:27.633424 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1461/2903] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:02:27.637461 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e744fb-db01-4cc0-8093-679caf9d8ec7 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:02:27.646817 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e744fb-db01-4cc0-8093-679caf9d8ec7 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:02:27.651370 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaabee-496e-4344-a95e-2c4addfaba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:02:27.652041 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaabee-496e-4344-a95e-2c4addfaba12 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:27.652321 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaabee-496e-4344-a95e-2c4addfaba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:27.652597 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaabee-496e-4344-a95e-2c4addfaba12 admin admin] PATH_INFO: `/v3/domains` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:27.653382 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaaabee-496e-4344-a95e-2c4addfaba12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:02:27.653690 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaaabee-496e-4344-a95e-2c4addfaba12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:02:27.655315 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaaabee-496e-4344-a95e-2c4addfaba12 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:02:27.667041 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1443/2904] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 14:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:02:27.671121 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a748b-7785-4987-bf7d-5ffcf9502933 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:02:27.680677 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a748b-7785-4987-bf7d-5ffcf9502933 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:02:27.696282 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecbb60-3c9f-47e1-9b07-9ea645cb3565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:02:27.696282 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecbb60-3c9f-47e1-9b07-9ea645cb3565 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:27.696282 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecbb60-3c9f-47e1-9b07-9ea645cb3565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:27.696282 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecbb60-3c9f-47e1-9b07-9ea645cb3565 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:27.696638 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecbb60-3c9f-47e1-9b07-9ea645cb3565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:02:27.696638 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecbb60-3c9f-47e1-9b07-9ea645cb3565 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:02:27.885968 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1462/2905] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 14:02:27 2022] POST /identity/v3/projects => generated 373 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:02:27.889732 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaabee-496e-4344-a95e-2c4addfaba12 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:02:27.899480 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaabee-496e-4344-a95e-2c4addfaba12 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:02:27.954281 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcb061-f7fc-4994-93d2-9d547efe7645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:02:27.954937 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcb061-f7fc-4994-93d2-9d547efe7645 admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:27.955220 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcb061-f7fc-4994-93d2-9d547efe7645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:27.955495 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcb061-f7fc-4994-93d2-9d547efe7645 admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:27.956173 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcb061-f7fc-4994-93d2-9d547efe7645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:02:27.958138 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcb061-f7fc-4994-93d2-9d547efe7645 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:02:28.057085 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1444/2906] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 14:02:27 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:02:28.061211 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecbb60-3c9f-47e1-9b07-9ea645cb3565 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:02:28.071436 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecbb60-3c9f-47e1-9b07-9ea645cb3565 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:02:28.075947 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f928b1-4847-4657-b2de-517273ab1593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:02:28.076590 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f928b1-4847-4657-b2de-517273ab1593 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:28.076906 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f928b1-4847-4657-b2de-517273ab1593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:28.077186 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f928b1-4847-4657-b2de-517273ab1593 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:28.078164 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f928b1-4847-4657-b2de-517273ab1593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:02:28.079762 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f928b1-4847-4657-b2de-517273ab1593 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:02:28.091379 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1463/2907] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 14:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:02:28.095278 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcb061-f7fc-4994-93d2-9d547efe7645 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:02:28.105956 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcb061-f7fc-4994-93d2-9d547efe7645 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:02:28.110402 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2529fc-d79a-4e08-9310-b0f83ae32a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:02:28.111046 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2529fc-d79a-4e08-9310-b0f83ae32a01 admin admin] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:28.111326 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2529fc-d79a-4e08-9310-b0f83ae32a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:28.111726 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2529fc-d79a-4e08-9310-b0f83ae32a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:28.112457 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2529fc-d79a-4e08-9310-b0f83ae32a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:02:28.114075 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2529fc-d79a-4e08-9310-b0f83ae32a01 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:02:28.123803 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1445/2908] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 14:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:02:28.127840 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f928b1-4847-4657-b2de-517273ab1593 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:02:28.137751 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f928b1-4847-4657-b2de-517273ab1593 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:02:28.142245 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540e299-3643-4ddb-9b89-04a249d5a892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:02:28.143797 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540e299-3643-4ddb-9b89-04a249d5a892 admin admin] REQUEST_METHOD: `PUT` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:28.144128 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540e299-3643-4ddb-9b89-04a249d5a892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:28.144438 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540e299-3643-4ddb-9b89-04a249d5a892 admin admin] PATH_INFO: `/v3/projects/0e2b64e03b8c4c5ba1501eb1594b623c/users/a82d20d6d26448918d2ecf82e8545c19/roles/e34b765cca514a83bef6eb9cff7ef871` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:28.159259 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540e299-3643-4ddb-9b89-04a249d5a892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2b64e03b8c4c5ba1501eb1594b623c, user_id=a82d20d6d26448918d2ecf82e8545c19, role_id=e34b765cca514a83bef6eb9cff7ef871)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:02:28.161947 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540e299-3643-4ddb-9b89-04a249d5a892 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:02:28.240074 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1464/2909] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 14:02:28 2022] PUT /identity/v3/projects/0e2b64e03b8c4c5ba1501eb1594b623c/users/a82d20d6d26448918d2ecf82e8545c19/roles/e34b765cca514a83bef6eb9cff7ef871 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:02:28.245234 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462bf22-06d8-448c-b29d-c688f4e5f92f None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:28.245527 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462bf22-06d8-448c-b29d-c688f4e5f92f None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:28.245806 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462bf22-06d8-448c-b29d-c688f4e5f92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:28.263409 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-6462bf22-06d8-448c-b29d-c688f4e5f92f None None] MFA Rules not processed for user `ea423af17abb444a87ac0e8ed4f3af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:02:28.264613 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-6462bf22-06d8-448c-b29d-c688f4e5f92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:02:28.320521 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1446/2910] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:02:28.330849 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540e299-3643-4ddb-9b89-04a249d5a892 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:02:28.332775 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-5540e299-3643-4ddb-9b89-04a249d5a892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:02:28.398929 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540e299-3643-4ddb-9b89-04a249d5a892 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:02:28.402187 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32ab42-6a91-4208-889a-38fb33d80a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:02:28.402830 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32ab42-6a91-4208-889a-38fb33d80a63 service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:28.403106 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32ab42-6a91-4208-889a-38fb33d80a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:28.403371 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32ab42-6a91-4208-889a-38fb33d80a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:28.414695 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32ab42-6a91-4208-889a-38fb33d80a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:02:28.416138 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32ab42-6a91-4208-889a-38fb33d80a63 service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:02:28.426542 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1465/2911] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:02:34.332863 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a01966-02d5-43f5-92e6-addadf46e10c None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:34.333308 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a01966-02d5-43f5-92e6-addadf46e10c None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:34.334119 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a01966-02d5-43f5-92e6-addadf46e10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:34.366748 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-a2a01966-02d5-43f5-92e6-addadf46e10c None None] MFA Rules not processed for user `a82d20d6d26448918d2ecf82e8545c19`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:02:34.367977 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-a2a01966-02d5-43f5-92e6-addadf46e10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:02:34.438673 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1447/2912] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:02:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:02:34.444110 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32ab42-6a91-4208-889a-38fb33d80a63 service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:02:34.454165 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32ab42-6a91-4208-889a-38fb33d80a63 service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:02:34.459560 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca43ae-949a-4f5c-82ad-9916c24482b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:02:34.460238 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca43ae-949a-4f5c-82ad-9916c24482b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:34.460521 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca43ae-949a-4f5c-82ad-9916c24482b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:34.460825 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca43ae-949a-4f5c-82ad-9916c24482b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:34.461520 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca43ae-949a-4f5c-82ad-9916c24482b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:02:34.463415 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca43ae-949a-4f5c-82ad-9916c24482b9 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:02:34.562638 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1466/2913] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 14:02:34 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:02:34.567388 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a01966-02d5-43f5-92e6-addadf46e10c None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:02:34.578557 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a01966-02d5-43f5-92e6-addadf46e10c None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:02:34.635507 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe87962-c1ef-4712-a743-88be4c993fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:02:34.636181 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe87962-c1ef-4712-a743-88be4c993fef admin admin] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:34.636462 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe87962-c1ef-4712-a743-88be4c993fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:34.636769 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe87962-c1ef-4712-a743-88be4c993fef admin admin] PATH_INFO: `/v3/users` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:34.637467 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe87962-c1ef-4712-a743-88be4c993fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:02:34.639385 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe87962-c1ef-4712-a743-88be4c993fef admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:02:34.731127 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1448/2914] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 14:02:34 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:02:34.735310 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca43ae-949a-4f5c-82ad-9916c24482b9 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:02:34.746432 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca43ae-949a-4f5c-82ad-9916c24482b9 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:02:34.751080 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc99fa-e90f-49e0-9f6b-35afcac868fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:02:34.751737 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc99fa-e90f-49e0-9f6b-35afcac868fb admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:34.752574 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc99fa-e90f-49e0-9f6b-35afcac868fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:34.752883 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc99fa-e90f-49e0-9f6b-35afcac868fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:34.753698 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc99fa-e90f-49e0-9f6b-35afcac868fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:02:34.755284 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc99fa-e90f-49e0-9f6b-35afcac868fb admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:02:34.765818 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1467/2915] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 14:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:02:34.770096 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe87962-c1ef-4712-a743-88be4c993fef admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:02:34.779996 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe87962-c1ef-4712-a743-88be4c993fef admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:02:34.784611 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e9ea9-998d-459d-be4d-801990c0c295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:02:34.785564 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e9ea9-998d-459d-be4d-801990c0c295 admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:34.785889 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e9ea9-998d-459d-be4d-801990c0c295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:34.786164 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e9ea9-998d-459d-be4d-801990c0c295 admin admin] PATH_INFO: `/v3/projects/fd05e7da453d4f32bfe08e833f233a93/users/cb247c1bbbfe4c15b6a526d4c03dbb77/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:34.801623 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e9ea9-998d-459d-be4d-801990c0c295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd05e7da453d4f32bfe08e833f233a93, user_id=cb247c1bbbfe4c15b6a526d4c03dbb77, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:02:34.804388 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e9ea9-998d-459d-be4d-801990c0c295 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:02:34.874973 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1449/2916] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 14:02:34 2022] PUT /identity/v3/projects/fd05e7da453d4f32bfe08e833f233a93/users/cb247c1bbbfe4c15b6a526d4c03dbb77/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:02:34.879663 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc99fa-e90f-49e0-9f6b-35afcac868fb admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:02:34.889429 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc99fa-e90f-49e0-9f6b-35afcac868fb admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:02:34.942469 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79e085-5632-4a05-a48d-83bd0915d4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:02:34.943113 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79e085-5632-4a05-a48d-83bd0915d4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:34.943391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79e085-5632-4a05-a48d-83bd0915d4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:34.943662 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79e085-5632-4a05-a48d-83bd0915d4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:34.944368 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79e085-5632-4a05-a48d-83bd0915d4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:02:34.946001 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79e085-5632-4a05-a48d-83bd0915d4f4 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:02:34.956103 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1468/2917] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 14:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:02:34.960180 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e9ea9-998d-459d-be4d-801990c0c295 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:02:34.970270 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e9ea9-998d-459d-be4d-801990c0c295 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:02:34.974818 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021cea7-89cd-4da5-8a20-30ad6146a54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:02:34.975683 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021cea7-89cd-4da5-8a20-30ad6146a54b admin admin] REQUEST_METHOD: `PUT` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:34.975961 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021cea7-89cd-4da5-8a20-30ad6146a54b admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:34.976237 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021cea7-89cd-4da5-8a20-30ad6146a54b admin admin] PATH_INFO: `/v3/projects/fd05e7da453d4f32bfe08e833f233a93/users/cb247c1bbbfe4c15b6a526d4c03dbb77/roles/f9ec85924a914e078096b38cae4e6caa` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:34.978202 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021cea7-89cd-4da5-8a20-30ad6146a54b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd05e7da453d4f32bfe08e833f233a93, user_id=cb247c1bbbfe4c15b6a526d4c03dbb77, role_id=f9ec85924a914e078096b38cae4e6caa)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:02:34.980866 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021cea7-89cd-4da5-8a20-30ad6146a54b admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:02:34.992374 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1450/2918] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 14:02:34 2022] PUT /identity/v3/projects/fd05e7da453d4f32bfe08e833f233a93/users/cb247c1bbbfe4c15b6a526d4c03dbb77/roles/f9ec85924a914e078096b38cae4e6caa => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:02:40.755151 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e432b3-575a-4d2a-91be-95b79ebf37a0 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:40.755683 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e432b3-575a-4d2a-91be-95b79ebf37a0 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:40.755763 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e432b3-575a-4d2a-91be-95b79ebf37a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:40.786253 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-16e432b3-575a-4d2a-91be-95b79ebf37a0 None None] MFA Rules not processed for user `cb247c1bbbfe4c15b6a526d4c03dbb77`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:02:40.787481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-16e432b3-575a-4d2a-91be-95b79ebf37a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:02:40.865063 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1469/2919] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:02:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:02:40.877677 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021cea7-89cd-4da5-8a20-30ad6146a54b admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:02:40.879412 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-d021cea7-89cd-4da5-8a20-30ad6146a54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:02:40.963305 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021cea7-89cd-4da5-8a20-30ad6146a54b admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:02:40.968831 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab752f5-efa0-4bd1-8ce4-551146c1e923 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:02:40.969475 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab752f5-efa0-4bd1-8ce4-551146c1e923 service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:40.969762 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab752f5-efa0-4bd1-8ce4-551146c1e923 service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:40.970066 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab752f5-efa0-4bd1-8ce4-551146c1e923 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:41.024212 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab752f5-efa0-4bd1-8ce4-551146c1e923 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:02:41.025833 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab752f5-efa0-4bd1-8ce4-551146c1e923 service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:02:41.035003 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1451/2920] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:02:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:02:44.247721 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b61ce-0953-40a7-ab2e-2ff924aa4612 None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:44.248225 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b61ce-0953-40a7-ab2e-2ff924aa4612 None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:44.248318 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b61ce-0953-40a7-ab2e-2ff924aa4612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:44.265984 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-cd1b61ce-0953-40a7-ab2e-2ff924aa4612 None None] MFA Rules not processed for user `a82d20d6d26448918d2ecf82e8545c19`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:02:44.271674 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-cd1b61ce-0953-40a7-ab2e-2ff924aa4612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:02:44.274734 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1470/2921] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 14:02:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:02:59.863188 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab752f5-efa0-4bd1-8ce4-551146c1e923 service nova] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:02:59.864562 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-cab752f5-efa0-4bd1-8ce4-551146c1e923 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:02:59.918895 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab752f5-efa0-4bd1-8ce4-551146c1e923 service nova] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:02:59.922447 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63f6c4-50cb-4c13-9545-14122eb72f32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a2746615c14162be82dea409930590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:02:59.923224 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63f6c4-50cb-4c13-9545-14122eb72f32 service cinder] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:59.923509 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63f6c4-50cb-4c13-9545-14122eb72f32 service cinder] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:59.923787 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63f6c4-50cb-4c13-9545-14122eb72f32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:59.925528 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7b63f6c4-50cb-4c13-9545-14122eb72f32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:02:59.939101 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63f6c4-50cb-4c13-9545-14122eb72f32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:02:59.940526 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63f6c4-50cb-4c13-9545-14122eb72f32 service cinder] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:02:59.951564 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1452/2922] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:02:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:03:00.229665 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b61ce-0953-40a7-ab2e-2ff924aa4612 None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:03:00.282124 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b61ce-0953-40a7-ab2e-2ff924aa4612 None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:03:00.285626 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2104a-c7f8-4b7a-9c3f-d65ccb9317db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:03:00.286252 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2104a-c7f8-4b7a-9c3f-d65ccb9317db service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:03:00.286527 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2104a-c7f8-4b7a-9c3f-d65ccb9317db service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:03:00.286798 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2104a-c7f8-4b7a-9c3f-d65ccb9317db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:03:00.288526 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-30d2104a-c7f8-4b7a-9c3f-d65ccb9317db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:03:00.298391 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2104a-c7f8-4b7a-9c3f-d65ccb9317db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:03:00.299746 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2104a-c7f8-4b7a-9c3f-d65ccb9317db service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:03:00.307562 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1471/2923] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:03:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:03:01.180388 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63f6c4-50cb-4c13-9545-14122eb72f32 service cinder] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:03:01.181873 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-7b63f6c4-50cb-4c13-9545-14122eb72f32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:03:01.250249 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63f6c4-50cb-4c13-9545-14122eb72f32 service cinder] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:03:01.255700 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda2587-4470-4f5c-9f9b-c138823fbe84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b917ce4f7f34b289218f7d36a43983e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:03:01.256349 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda2587-4470-4f5c-9f9b-c138823fbe84 service placement] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:03:01.256637 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda2587-4470-4f5c-9f9b-c138823fbe84 service placement] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:03:01.256959 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda2587-4470-4f5c-9f9b-c138823fbe84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:03:01.258804 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-1cda2587-4470-4f5c-9f9b-c138823fbe84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:03:01.270833 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda2587-4470-4f5c-9f9b-c138823fbe84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:03:01.272449 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda2587-4470-4f5c-9f9b-c138823fbe84 service placement] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:03:01.282508 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1453/2924] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:03:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:03:14.856279 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2104a-c7f8-4b7a-9c3f-d65ccb9317db service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:03:14.857792 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-30d2104a-c7f8-4b7a-9c3f-d65ccb9317db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:03:14.913107 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2104a-c7f8-4b7a-9c3f-d65ccb9317db service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:03:14.918709 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbb2af-754c-4fca-bcc8-31ff6164b334 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:03:14.919343 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbb2af-754c-4fca-bcc8-31ff6164b334 service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:03:14.919624 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbb2af-754c-4fca-bcc8-31ff6164b334 service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:03:14.919893 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbb2af-754c-4fca-bcc8-31ff6164b334 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:03:14.921676 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-69fbb2af-754c-4fca-bcc8-31ff6164b334 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:03:14.933990 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbb2af-754c-4fca-bcc8-31ff6164b334 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:03:14.935553 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbb2af-754c-4fca-bcc8-31ff6164b334 service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:03:14.945926 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1472/2925] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:03:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:03:18.973089 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda2587-4470-4f5c-9f9b-c138823fbe84 service placement] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:03:18.982509 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda2587-4470-4f5c-9f9b-c138823fbe84 service placement] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:03:18.986331 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4b8f6-4c26-4529-8d71-800d18eeccec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:03:18.986969 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4b8f6-4c26-4529-8d71-800d18eeccec service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:03:18.987255 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4b8f6-4c26-4529-8d71-800d18eeccec service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:03:18.987533 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4b8f6-4c26-4529-8d71-800d18eeccec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:03:18.996310 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4b8f6-4c26-4529-8d71-800d18eeccec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:03:18.997780 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4b8f6-4c26-4529-8d71-800d18eeccec service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:03:19.007018 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1454/2926] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:03:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:03:29.427202 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbb2af-754c-4fca-bcc8-31ff6164b334 service nova] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:03:29.448750 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbb2af-754c-4fca-bcc8-31ff6164b334 service nova] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:03:29.453839 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05053ad-61af-4676-8f6b-2c03cab0f04b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b917ce4f7f34b289218f7d36a43983e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:03:29.459950 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05053ad-61af-4676-8f6b-2c03cab0f04b service placement] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:03:29.459950 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05053ad-61af-4676-8f6b-2c03cab0f04b service placement] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:03:29.459950 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05053ad-61af-4676-8f6b-2c03cab0f04b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:03:29.459950 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a05053ad-61af-4676-8f6b-2c03cab0f04b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:03:29.480649 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05053ad-61af-4676-8f6b-2c03cab0f04b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:03:29.482292 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05053ad-61af-4676-8f6b-2c03cab0f04b service placement] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:03:29.499087 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1473/2927] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:03:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:05:17.081736 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4b8f6-4c26-4529-8d71-800d18eeccec service neutron] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:05:17.083198 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-a0d4b8f6-4c26-4529-8d71-800d18eeccec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:05:17.104074 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4b8f6-4c26-4529-8d71-800d18eeccec service neutron] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:05:17.108594 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690a8fe-1a08-41f1-bbcf-dfe125f5e2db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:05:17.109273 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690a8fe-1a08-41f1-bbcf-dfe125f5e2db service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:05:17.109555 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690a8fe-1a08-41f1-bbcf-dfe125f5e2db service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:05:17.109828 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690a8fe-1a08-41f1-bbcf-dfe125f5e2db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:05:17.111595 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-0690a8fe-1a08-41f1-bbcf-dfe125f5e2db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:05:17.138671 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690a8fe-1a08-41f1-bbcf-dfe125f5e2db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:05:17.140117 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690a8fe-1a08-41f1-bbcf-dfe125f5e2db service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:05:17.160525 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1455/2928] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:05:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:05:23.138900 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05053ad-61af-4676-8f6b-2c03cab0f04b service placement] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:05:23.157505 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05053ad-61af-4676-8f6b-2c03cab0f04b service placement] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:05:23.161045 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d7e70-d198-4282-b211-e0301724ec3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:05:23.161681 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d7e70-d198-4282-b211-e0301724ec3c service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:05:23.161968 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d7e70-d198-4282-b211-e0301724ec3c service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:05:23.162235 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d7e70-d198-4282-b211-e0301724ec3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:05:23.164022 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-108d7e70-d198-4282-b211-e0301724ec3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:05:23.173928 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d7e70-d198-4282-b211-e0301724ec3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:05:23.175352 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d7e70-d198-4282-b211-e0301724ec3c service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:05:23.183193 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1474/2929] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:05:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:05:32.849646 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba1aac-cbfb-4bd7-8055-d1493ddf223d None None] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:05:32.850091 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba1aac-cbfb-4bd7-8055-d1493ddf223d None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:05:32.850235 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba1aac-cbfb-4bd7-8055-d1493ddf223d None None] PATH_INFO: `/` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:05:32.852019 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1456/2930] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 14:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:05:32.858703 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae957c6-2124-45a6-9d3f-b7c4f6f41d7f None None] REQUEST_METHOD: `POST` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:05:32.862158 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae957c6-2124-45a6-9d3f-b7c4f6f41d7f None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:05:32.862158 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae957c6-2124-45a6-9d3f-b7c4f6f41d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:05:32.918794 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.auth.core [None req-eae957c6-2124-45a6-9d3f-b7c4f6f41d7f None None] MFA Rules not processed for user `22bf06400d8f47f4bb3badd7f65bc205`. Rule list: `[]` (Enabled: `True`). {{(pid=79793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:05:32.920009 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-eae957c6-2124-45a6-9d3f-b7c4f6f41d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:05:32.926610 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1475/2931] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 14:05:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:05:32.939014 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba1aac-cbfb-4bd7-8055-d1493ddf223d None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:05:32.950256 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba1aac-cbfb-4bd7-8055-d1493ddf223d None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:05:32.953799 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2aaf4-5df1-455c-8f3c-ed26675779de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:05:32.954426 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2aaf4-5df1-455c-8f3c-ed26675779de service neutron] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:05:32.954710 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2aaf4-5df1-455c-8f3c-ed26675779de service neutron] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:05:32.954988 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2aaf4-5df1-455c-8f3c-ed26675779de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:05:32.961928 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2aaf4-5df1-455c-8f3c-ed26675779de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:05:32.963361 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2aaf4-5df1-455c-8f3c-ed26675779de service neutron] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:05:32.971077 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1457/2932] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:05:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:05:34.066141 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a4b1f-9e7c-432a-a39c-c772ac313b0b None None] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:05:34.066638 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a4b1f-9e7c-432a-a39c-c772ac313b0b None None] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:05:34.066748 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a4b1f-9e7c-432a-a39c-c772ac313b0b None None] PATH_INFO: `/` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:05:34.068501 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1476/2933] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 14:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:05:34.074373 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a9b53-745b-4287-b0bc-349b735bfbf5 None None] REQUEST_METHOD: `POST` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:05:34.074831 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a9b53-745b-4287-b0bc-349b735bfbf5 None None] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:05:34.075050 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a9b53-745b-4287-b0bc-349b735bfbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:05:34.110542 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.auth.core [None req-2d3a9b53-745b-4287-b0bc-349b735bfbf5 None None] MFA Rules not processed for user `72d4ac44d04943a5b24c7a1d6a31b7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:05:34.111728 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-2d3a9b53-745b-4287-b0bc-349b735bfbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:05:34.120768 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1458/2934] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 14:05:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:05:34.130976 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a4b1f-9e7c-432a-a39c-c772ac313b0b None None] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:05:34.141868 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a4b1f-9e7c-432a-a39c-c772ac313b0b None None] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:05:34.145302 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e32837-52b4-4bb5-958e-0851eb8d738b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf06400d8f47f4bb3badd7f65bc205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:05:34.145923 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e32837-52b4-4bb5-958e-0851eb8d738b service neutron] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:05:34.146205 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e32837-52b4-4bb5-958e-0851eb8d738b service neutron] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:05:34.146481 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e32837-52b4-4bb5-958e-0851eb8d738b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:05:34.156873 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e32837-52b4-4bb5-958e-0851eb8d738b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:05:34.158294 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e32837-52b4-4bb5-958e-0851eb8d738b service neutron] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:05:34.169307 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1477/2935] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:05:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:07:07.876151 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a9b53-745b-4287-b0bc-349b735bfbf5 None None] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:07:07.888942 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a9b53-745b-4287-b0bc-349b735bfbf5 None None] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:07:07.894740 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab66f34-3729-459a-a19c-418b4773076e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:07:07.895386 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab66f34-3729-459a-a19c-418b4773076e service nova] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:07:07.895674 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab66f34-3729-459a-a19c-418b4773076e service nova] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:07:07.895948 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab66f34-3729-459a-a19c-418b4773076e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:07:07.898063 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-fab66f34-3729-459a-a19c-418b4773076e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:07:07.910866 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab66f34-3729-459a-a19c-418b4773076e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:07:07.912489 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab66f34-3729-459a-a19c-418b4773076e service nova] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:07:07.924189 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1459/2936] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:07:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:07:10.329865 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e32837-52b4-4bb5-958e-0851eb8d738b service neutron] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:07:10.341653 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e32837-52b4-4bb5-958e-0851eb8d738b service neutron] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:07:10.347119 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4d598-4977-4b20-8571-220df461fa0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72d4ac44d04943a5b24c7a1d6a31b7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:07:10.347957 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4d598-4977-4b20-8571-220df461fa0b service nova] REQUEST_METHOD: `GET` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:07:10.348054 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4d598-4977-4b20-8571-220df461fa0b service nova] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:07:10.348279 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4d598-4977-4b20-8571-220df461fa0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:07:10.350052 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-28c4d598-4977-4b20-8571-220df461fa0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:07:10.362242 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4d598-4977-4b20-8571-220df461fa0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:07:10.363809 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4d598-4977-4b20-8571-220df461fa0b service nova] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:07:10.374192 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1478/2937] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:07:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:07:20.720834 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab66f34-3729-459a-a19c-418b4773076e service nova] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:07:20.807868 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab66f34-3729-459a-a19c-418b4773076e service nova] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:07:20.813041 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7f839-0df7-46e7-ae24-d4dcfac297c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:07:20.813933 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7f839-0df7-46e7-ae24-d4dcfac297c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:07:20.814215 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7f839-0df7-46e7-ae24-d4dcfac297c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:07:20.814489 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7f839-0df7-46e7-ae24-d4dcfac297c6 admin admin] PATH_INFO: `/v3/users/a82d20d6d26448918d2ecf82e8545c19` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:07:20.815721 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7f839-0df7-46e7-ae24-d4dcfac297c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82d20d6d26448918d2ecf82e8545c19)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:07:20.817970 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7f839-0df7-46e7-ae24-d4dcfac297c6 admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:07:21.016853 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-24a7f839-0df7-46e7-ae24-d4dcfac297c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82d20d6d26448918d2ecf82e8545c19'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:07:21.030017 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-24a7f839-0df7-46e7-ae24-d4dcfac297c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82d20d6d26448918d2ecf82e8545c19'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:07:21.030767 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-24a7f839-0df7-46e7-ae24-d4dcfac297c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82d20d6d26448918d2ecf82e8545c19'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:07:21.099376 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-24a7f839-0df7-46e7-ae24-d4dcfac297c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82d20d6d26448918d2ecf82e8545c19'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:07:21.099917 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-24a7f839-0df7-46e7-ae24-d4dcfac297c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82d20d6d26448918d2ecf82e8545c19'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:07:21.111966 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1460/2938] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 14:07:20 2022] DELETE /identity/v3/users/a82d20d6d26448918d2ecf82e8545c19 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:07:21.339767 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4d598-4977-4b20-8571-220df461fa0b service nova] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:07:21.351724 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4d598-4977-4b20-8571-220df461fa0b service nova] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:07:21.412622 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bd3d4-7430-464c-aafd-d2cc312c1575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:07:21.413523 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd3d4-7430-464c-aafd-d2cc312c1575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:07:21.413807 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd3d4-7430-464c-aafd-d2cc312c1575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:07:21.414081 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd3d4-7430-464c-aafd-d2cc312c1575 admin admin] PATH_INFO: `/v3/projects/0e2b64e03b8c4c5ba1501eb1594b623c` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:07:21.415277 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bd3d4-7430-464c-aafd-d2cc312c1575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e2b64e03b8c4c5ba1501eb1594b623c)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:07:21.417255 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bd3d4-7430-464c-aafd-d2cc312c1575 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:07:21.548470 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a94bd3d4-7430-464c-aafd-d2cc312c1575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e2b64e03b8c4c5ba1501eb1594b623c', 'request_id': 'req-a94bd3d4-7430-464c-aafd-d2cc312c1575'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:07:21.554909 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a94bd3d4-7430-464c-aafd-d2cc312c1575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e2b64e03b8c4c5ba1501eb1594b623c', 'request_id': 'req-a94bd3d4-7430-464c-aafd-d2cc312c1575'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:07:21.560814 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a94bd3d4-7430-464c-aafd-d2cc312c1575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e2b64e03b8c4c5ba1501eb1594b623c', 'request_id': 'req-a94bd3d4-7430-464c-aafd-d2cc312c1575'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:07:21.654486 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a94bd3d4-7430-464c-aafd-d2cc312c1575 admin admin] The token cache is being invalidate because project 0e2b64e03b8c4c5ba1501eb1594b623c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:07:21.654673 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a94bd3d4-7430-464c-aafd-d2cc312c1575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:07:21.655289 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-a94bd3d4-7430-464c-aafd-d2cc312c1575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:07:21.656875 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1479/2939] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 14:07:21 2022] DELETE /identity/v3/projects/0e2b64e03b8c4c5ba1501eb1594b623c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:07:21.660818 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7f839-0df7-46e7-ae24-d4dcfac297c6 admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:07:21.662257 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-24a7f839-0df7-46e7-ae24-d4dcfac297c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:07:21.676004 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7f839-0df7-46e7-ae24-d4dcfac297c6 admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:07:21.730474 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846544b-204c-4a8b-9c1b-b564d40dbbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:07:21.731335 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846544b-204c-4a8b-9c1b-b564d40dbbac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:07:21.731613 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846544b-204c-4a8b-9c1b-b564d40dbbac admin admin] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:07:21.731884 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846544b-204c-4a8b-9c1b-b564d40dbbac admin admin] PATH_INFO: `/v3/users/cb247c1bbbfe4c15b6a526d4c03dbb77` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:07:21.733096 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846544b-204c-4a8b-9c1b-b564d40dbbac admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb247c1bbbfe4c15b6a526d4c03dbb77)` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:07:21.735009 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846544b-204c-4a8b-9c1b-b564d40dbbac admin admin] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:07:21.921495 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-c846544b-204c-4a8b-9c1b-b564d40dbbac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb247c1bbbfe4c15b6a526d4c03dbb77'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:07:21.932904 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-c846544b-204c-4a8b-9c1b-b564d40dbbac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb247c1bbbfe4c15b6a526d4c03dbb77'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:07:21.933566 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-c846544b-204c-4a8b-9c1b-b564d40dbbac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb247c1bbbfe4c15b6a526d4c03dbb77'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:07:21.996641 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-c846544b-204c-4a8b-9c1b-b564d40dbbac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb247c1bbbfe4c15b6a526d4c03dbb77'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:07:21.997292 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.notifications [None req-c846544b-204c-4a8b-9c1b-b564d40dbbac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb247c1bbbfe4c15b6a526d4c03dbb77'} {{(pid=79792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:07:22.009496 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1461/2940] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 14:07:21 2022] DELETE /identity/v3/users/cb247c1bbbfe4c15b6a526d4c03dbb77 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:07:22.287132 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bd3d4-7430-464c-aafd-d2cc312c1575 admin admin] Authenticating user token {{(pid=79793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:07:22.289454 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.fernet_utils [None req-a94bd3d4-7430-464c-aafd-d2cc312c1575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:07:22.302884 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bd3d4-7430-464c-aafd-d2cc312c1575 admin admin] Validating token access rules against request {{(pid=79793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:07:22.359280 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9119c-f4bf-4534-8e62-523a3c814fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea423af17abb444a87ac0e8ed4f3af6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bf8304032614352a7ca4a6088a17c23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:07:22.360143 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9119c-f4bf-4534-8e62-523a3c814fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:07:22.360428 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9119c-f4bf-4534-8e62-523a3c814fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:07:22.360730 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9119c-f4bf-4534-8e62-523a3c814fe7 admin admin] PATH_INFO: `/v3/projects/fd05e7da453d4f32bfe08e833f233a93` {{(pid=79793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:07:22.361916 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9119c-f4bf-4534-8e62-523a3c814fe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd05e7da453d4f32bfe08e833f233a93)` {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:07:22.363833 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9119c-f4bf-4534-8e62-523a3c814fe7 admin admin] RBAC: Authorization granted {{(pid=79793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:07:22.542066 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-48a9119c-f4bf-4534-8e62-523a3c814fe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd05e7da453d4f32bfe08e833f233a93', 'request_id': 'req-48a9119c-f4bf-4534-8e62-523a3c814fe7'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:07:22.548103 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-48a9119c-f4bf-4534-8e62-523a3c814fe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd05e7da453d4f32bfe08e833f233a93', 'request_id': 'req-48a9119c-f4bf-4534-8e62-523a3c814fe7'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:07:22.554495 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-48a9119c-f4bf-4534-8e62-523a3c814fe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd05e7da453d4f32bfe08e833f233a93', 'request_id': 'req-48a9119c-f4bf-4534-8e62-523a3c814fe7'} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:07:22.670483 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-48a9119c-f4bf-4534-8e62-523a3c814fe7 admin admin] The token cache is being invalidate because project fd05e7da453d4f32bfe08e833f233a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:07:22.670768 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-48a9119c-f4bf-4534-8e62-523a3c814fe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:07:22.671414 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: DEBUG keystone.notifications [None req-48a9119c-f4bf-4534-8e62-523a3c814fe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:07:22.672991 dv-cinder-830091-2-iscsi devstack@keystone.service[79793]: [pid: 79793|app: 0|req: 1480/2941] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 14:07:22 2022] DELETE /identity/v3/projects/fd05e7da453d4f32bfe08e833f233a93 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:08:32.343112 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846544b-204c-4a8b-9c1b-b564d40dbbac admin admin] Authenticating user token {{(pid=79792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:08:32.344532 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-c846544b-204c-4a8b-9c1b-b564d40dbbac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:08:32.412360 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846544b-204c-4a8b-9c1b-b564d40dbbac admin admin] Validating token access rules against request {{(pid=79792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:08:32.468551 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a36c5-d2a3-4b0c-8b6e-711b48887b13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b917ce4f7f34b289218f7d36a43983e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b478af53391486eb72c85c786ed4abb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:08:32.469288 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a36c5-d2a3-4b0c-8b6e-711b48887b13 service placement] REQUEST_METHOD: `GET` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:08:32.469569 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a36c5-d2a3-4b0c-8b6e-711b48887b13 service placement] SCRIPT_NAME: `/identity` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:08:32.469841 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a36c5-d2a3-4b0c-8b6e-711b48887b13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:08:32.471605 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.fernet_utils [None req-d39a36c5-d2a3-4b0c-8b6e-711b48887b13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:08:32.483217 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a36c5-d2a3-4b0c-8b6e-711b48887b13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:08:32.484837 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a36c5-d2a3-4b0c-8b6e-711b48887b13 service placement] RBAC: Authorization granted {{(pid=79792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:08:32.494524 dv-cinder-830091-2-iscsi devstack@keystone.service[79792]: [pid: 79792|app: 0|req: 1462/2942] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 14:08:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)